Video Screencast Help

Increase FSA reporting scan speed?

Created: 11 Apr 2013 • Updated: 05 May 2013 | 2 comments
This issue has been solved. See solution.

We have recently added the FSA portion of vault to our environment. We currently have 2 file servers targetted for FSA reporting, FS1 takes about 4 hours to run its scan and FS2 takes about 14 hours to run its scan.  The configurations are as follows:

 

FS1 has 2 archive targets-

  • E$ - 2.2TB - 125k files
  • G$ - 1.6TB - 1.5M files

FS2 has 1 archive target-

  • E$ - 2.1TB - 7M files

 

As you can see the size of the disks is somewhat similar, but the number of files is much different. This leads me to beleive the number of files influences the scan time. Is there anything I can do to speed this up? I have thought about running more archive points and staggering their scans, but then I get stale data. The main problem with this is that we cant really use the reports until the very end of the day.  I found lots of information about troubleshooting errors in FSA reporting, but nothing about performance tuning for that reporting. Does anyone have any suggestions for me with this?

 

Thanks!

 

Operating Systems:

Comments 2 CommentsJump to latest comment

JesusWept3's picture

well the amount of files definitely will slow things down because examining one 50GB file is quicker than say 50,000 x 1MB files, so if you were to do a copy through windows explorer, you'd see the same thing
Unfortunately though i'm not aware of any way to increase the scan times (like upping the amount of threads or what not)
 

SOLUTION
Nate.D's picture

Thank you JesusWept3, the only thing I could think of was to just break the FS into more archive points, and then roll those through the week so that by friday I have a 'weekly rollup' of reports - OR - just run them on the weekend.

 

I cant imagine how long this crawl would take if you had a 50TB server with 100M files...how do the bigger environments manage their reporting scans?

If I was helpful in solving your issue please mark my post with a thumbs up or a solution!  Have a great day :)