Complex SISparts cause StorageCrawler to hang

Article:TECH210783  |  Created: 2013-09-23  |  Updated: 2015-01-12  |  Article URL http://www.symantec.com/docs/TECH210783
Article Type
Technical Solution


Issue



Certain types of items containing large or complex shared parts can cause the StorageCrawler process to hang and fail to clean up its temporary files. This results in a loop that eventually fills the disk drive with temporary files and shuts down the EV services.


Error



A dtrace of the StorageCrawler process shows the looping:
 

3070       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:M     Reading part from: \\vaultserver\Vault_Stores14\Vault_Store-04-Ptn08\2013\08-14\4\0D6\40D6C2976EAD1F65751E5CF910E0D3E1~ED~649A8147~00~1.DVSSP
3071       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L                {EVCommandExecutor::ExecuteCommand} (Entry)
3072       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L                {OpenStreamOnFileCommand::Execute} (Entry)
3099       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L                {OpenStreamOnFileCommand::Execute} (Exit) Status: [Success]
3101       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L                {EVCommandExecutor::ExecuteCommand} (Exit) Status: [Success]
3102       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L                {CNTFSStorageDeviceReader::LoadFile} (Exit) Status: [Success]
3103       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L                {CNTFSStorageDeviceReader::GetFileStream} (Exit) Status: [Success]
3105       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L                {CNTFSStorageDeviceReader::GetSisPartStream} (Exit) Status: [Success]
3109       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L       {CStorageSisPartReader<class CVaultStoreEMCCentera>::DecompressStream} (Entry)
3113       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] Position: 0 hr:0x0
3145       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] SetPosition: 0 hr:0x0
3147       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] Position: 21 hr:0x0
3150       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] SetCapacity:402548224 hr:0x0
3151       09:18:11.176       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] Position: 33 hr:0x0
5835       09:18:11.410       [39020]                (StorageCrawler)             <20832>               EV:H                CEVByteStreamMemoryFileImpl::UseFileStreamNow Swapping to using a file stream
5886       09:18:11.410       [39020]                (StorageCrawler)             <20832>               EV:H                CEVByteStreamMemoryFileImpl::UseFileStreamNow Stream created on D:\Temp\User\EV$2566.tmp
90486    09:18:18.586       [39020]                (StorageCrawler)             <20832>               EV:L       CSequentialStream::Read: Bytes to read: 32768, Bytes actually read: 19386. hr=False (0x1)
90487    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] SetPosition: 47139803 hr:0x0
90488    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] Position: 402548224 hr:0x0
90489    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] SetLength:402548224 hr:0x0
90490    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       Compression header:Ok [Header:47139774:402548224 Decompression:47139774:402548224]
90491    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       [class CIStreamSequentialStream] Flush hr:0x0
90492    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       [CCompressor] Decompress|Type: class CZlibCompressor|Header: Y|Thin: 47139770|Fat: 402548224|Fat guess good: 402548224|CRC: 2119885927
90493    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       {CStorageSisPartReader<class CVaultStoreEMCCentera>::DecompressStream} (Exit) Status: [Success]
90494    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       {CStorageSisPartReader<class CVaultStoreEMCCentera>::GetSisPart} (Exit) Status: [Success]
90495    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L                {GetSisPartContentCommand::Execute} (Exit) Status: [Success]
90496    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L                {EVCommandExecutor::ExecuteCommand} (Exit) Status: [Success]
90497    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       {CStorageSavesetReader<class CVaultStoreEMCCentera>::GetSisPart} (Exit) Status: [Success]
90498    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L       {CSaveset2::RestoreSharedPart} (Entry)
90499    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L                {CSavesetOnIStg2::RestoreSharableContent} (Entry)
90500    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L                {CSavesetOnIStg2::OpenSharableContent} (Entry)
90501    09:18:18.602       [39020]                (StorageCrawler)             <20832>               EV:L                {CSavesetOnIStg2::OpenSharableContent} (Exit) Status: [Success]
90504    09:18:20.084       [39020]                (StorageCrawler)             <20832>               EV:H                CEVByteStreamMemoryFileImpl::UseFileStreamNow Swapping to using a file stream
90505    09:18:20.084       [39020]                (StorageCrawler)             <20832>               EV:H                CEVByteStreamMemoryFileImpl::UseFileStreamNow Stream created on D:\Temp\User\EV$4749.tmp


Solution



This issue has been addressed in the following release:

Enterprise Vault 11.0.1 – Release Details
http://www.symantec.com/docs/DOC8024

 

Supplemental Materials

SourceETrack
Value3319069
Description

StorageCrawler generates two tmp files for SIS parts on one thread and hangs



Article URL http://www.symantec.com/docs/TECH210783


Terms of use for this information are found in Legal Notices