Video Screencast Help
Symantec to Separate Into Two Focused, Industry-Leading Technology Companies. Learn more.

How to know if my entire VaultStore has complete the "Collection" process ?

Created: 09 Jul 2014 • Updated: 14 Jul 2014 | 12 comments
This issue has been solved. See solution.

Hi people,

In my EV 9.0.4 I have successfully enabled the EV collection process in all of my 17 Closed vault stores.

So how do I know if the entire VaultStore has been converted into .CAB or collection files ?

Operating Systems:

Comments 12 CommentsJump to latest comment

John Santana's picture

because when I brose to some of the VaultStore partition, I can see still some in .CAB while some is in .DVS files

Kind regards,

John Santana
IT Professional

--------------------------------------------------

Please be nice to me as I'm newbie in this forum.

Rob.Wilcox's picture

*everything* won't end up in CABs, if that's what you're expecting.

There needs to be sufficient numbers to form a CAB, and CABs themselves also have limits.

SOLUTION
John Santana's picture

ah so In this case een with the collection enabled, I would still see the .DVS files around in my closed partition ?

Kind regards,

John Santana
IT Professional

--------------------------------------------------

Please be nice to me as I'm newbie in this forum.

Rob.Wilcox's picture

Yes, and have a look in the registry guide. A long with the settings you see in the UI there are other reasons why collections may or may not have hoovered up all your files.

 

The secret in the end is to look at the event id's.

GabeV's picture

John,

If your collection setting is set to 10 days (default value for 'Collect files older than'), then you should always see DVS files in the partitions if the partition is open. After 10 days. EV will collect them in a CAB file. Now, if the partition is closed, you need to make sure that all the items were backed up and the archive bit reset it or the trigger file created. Otherwise, EV will not collect them. You can always setup a dtrace for StorageOnlineOpns and go to the partition properties > collection tab and click on 'Run Now'.

I hope this helps.

“Success is not final, failure is not fatal: it is the courage to continue that counts.”–Winston Churchill

SOLUTION
Merv's picture

Yes EV will not collect them untill the dvs files are marked backed up. There is a SQL query I have which can tell you more besides the collection completion runs events. I'll have to dig that up.

The process doing collection is not storageonlineopns which is more for saveset viewing/retrievals but storagefilewatch - the full list is here
http://www.symantec.com/business/support/index?pag...

SOLUTION
John Santana's picture

Yes please, can you share the SQL script for that Merv ?

That'd be awesome.

Kind regards,

John Santana
IT Professional

--------------------------------------------------

Please be nice to me as I'm newbie in this forum.

Merv's picture

john, here you go...

1. This simple query will give you the number of items not yet collected per partition - run all these queries against the vault store DB:

 

select count (*) as NoOfItems, idpartition
from saveset
where collectionidentity IS NULL
group by idpartition

2. You will know which partitions are the problem partitions check if there is a backup problem for that partition :

select count (*) as NoOfItems, idpartition

from watchfile
group by idpartition

3 Daily collection rate:

select "Created Date" = left (convert (varchar, CreationDate,20),10), "Daily Rate" = count (*)

from Collection

where CreationDate between '2014-07-01' and '2014-07-11'

group by left (convert (varchar, CreationDate,20),10)

order by "Created Date" desc

4. Check your collection schedule in the partition properties and they should match up with your daily collection events as mentioned in Rob Wilcox's post  http://thingsilearnedtoday.net/2012/12/13/events-logged-for-collections/ 

- some versions of EV have different Event ID numbers like - 

e.g.

Event ID: 6976

A Partition's Collector/Migrator run has started. 
Partition Root Path: G:\Enterprise Vault Stores\JournalVS Ptn1 

Event ID: 7134

A Partition's Collector/Migrator run has finished. 

Some files were not collected because they have not been backed up. 

Partition Root Path: I:\Enterprise Vault Stores\JournalVS Ptn3 

Archived items: 0 
Files added to collections: 0 
Collections: 0 
Files migrated to secondary storage: 0

Time taken for the run [H:M:S]: 7:41:20 

5. If all is good you can get:

 
Event ID: 6917 
 
A Partition's Collector/Migrator run has finished. 
Partition Root Path: Z:\Enterprise Vault Stores\Partition1

34 Saveset(s) were collected into 2 Collection(s). 
0 file(s) were migrated to secondary storage. 
The run completed in 0 hour(s), 8 minute(s), 14 second(s)

 

If the problem is backup look at these tn

http://www.symantec.com/business/support/index?pag...

http://www.symantec.com/business/support/index?pag...

SOLUTION
John Santana's picture

Cool. many thanks guys.

Kind regards,

John Santana
IT Professional

--------------------------------------------------

Please be nice to me as I'm newbie in this forum.

Merv's picture

no worries - left out one line in query 2 - just edited it.

anyway after i edited it I realized i might as well make it simpler to give the partition name and path in the results:

1. Items not Collected by partition:

select count (*) as NoOfItems, saveset.IdPartition, PartitionName, PartitionRootPath
from saveset
join EnterpriseVaultDirectory.dbo.PartitionEntry PE on Saveset.IdPartition = PE.IdPartition
where collectionidentity IS NULL
group by saveset.IdPartition,
PartitionName,
PartitionRootPath

2. Items not backed up by partition:

select count (*) as NoOfItems, watchfile.IdPartition, PartitionName, PartitionRootPath

from watchfile
join EnterpriseVaultDirectory.dbo.PartitionEntry PE on WatchFile.IdPartition = PE.IdPartition
group by 
watchfile.IdPartition,
PartitionName,
PartitionRootPath

 

3. Collection rate by partition:

select "Created Date" = left (convert (varchar, CreationDate,20),10), "Daily Rate" = count (*),collection.IdPartition,PE.PartitionName,PE.PartitionRootPath

from Collection
join EnterpriseVaultDirectory.dbo.PartitionEntry PE on Collection.IdPartition = PE.IdPartition

where CreationDate between '2014-07-01' and '2014-07-11'

group by left (convert (varchar, CreationDate,20),10),
collection.IdPartition,
PE.PartitionName,
PE.PartitionRootPath

Hope that helps

John Santana's picture

Thanks mate !

you're really helpful in sharing the knowledge for the people here.

Kind regards,

John Santana
IT Professional

--------------------------------------------------

Please be nice to me as I'm newbie in this forum.