Index verify task fails with error "Failed to search the index volume - search did not complete within the required time"

Article:TECH212437  |  Created: 2013-11-12  |  Updated: 2014-11-10  |  Article URL http://www.symantec.com/docs/TECH212437
Article Type
Technical Solution


Issue



Index verify task fails with error "Failed to search the index volume - search did not complete within the required time" against particular index volumes. Also getting another error "There was an error verifying the index entries against the vault store database.The conversion of the nvarchar value '1341847213418472' overflowed an int column" while verify task running against the same index volume.


Error



Dtrace log entries of EVIndexVerifyTask regarding the time out error:

WinHttpRequest::Callback from WinHttp. Code=0x10, context=0x0686E644
WinHttpRequest::Callback from WinHttp. Code=0x20, context=0x0686E644
WinHttpRequest::Callback from WinHttp. Code=0x400000, context=0x0686E644
WinHttpRequest::OnCallback. WINHTTP_CALLBACK_STATUS_SENDREQUEST_COMPLETE. Calling WinHttpReceiveResponse.
WinHttpRequest::Callback from WinHttp. Code=0x40, context=0x0686E644
WinHttpRequest::Callback from WinHttp. Code=0x200000, context=0x0686E644
WinHttpRequest::OnCallback. WINHTTP_CALLBACK_STATUS_REQUEST_ERROR.
WinHttpRequest::OnCallback. WINHTTP_CALLBACK_STATUS_REQUEST_ERROR - Result=1, Error=12002|
WinHttpRequest::OnCallback exit. ERROR HR=0x8001011f.
WinHttpRequest::Callback from WinHttp. pRequest->OnCallback failed with HR=0x8001011f. Calling pRequest->OnResponseComplete.
IndexQueryServerRequest: OnResponseComplete - HR=This operation returned because the timeout period expired.  (0x8001011f)
IndexQueryServerRequest: WaitForSingleObject returned 0.
Response received. Result = The search timed out.      (0x80041c71), Status = 0
CIndexQueryServerSearch::Search2. Request FAILED HR=0x80041c71.
WinHttpRequest::Shutdown entry. Closing Winhttp handle
WinHttpHandle: Closing handle.
WinHttpRequest::Callback from WinHttp. Code=0x800, context=0x0686E644
WinHttpRequest::OnCallback. WINHTTP_CALLBACK_STATUS_HANDLE_CLOSING.
WinHttpRequest::Shutdown. Handle closed.  Waiting for callbacks to complete.
WinHttpRequest::WaitForCallbacksFromWinHttpToFinish entry. Max wait = 60000ms
WinHttpRequest::Shutdown exit.
~WinHttpRequest entry.
~WinHttpRequest exit.
WinHttpHandle: Closing handle.
CIndexSearch2::PerformSearch request failed. Attempt:1 ArchiveId:121AD0F63E739C443937F8B78A2E1058D1110000EVSG51|hr=The search timed out.   (0x80041c71)
CIndexSearch2::PerformSearch Search failed with 'normal' error: hr=The search timed out.      (0x80041c71).

{ITEMVERIFICATIONPHASE.EN_US} Exception: The search timed out.      (0x80041c71) Info: Diag:HRESULT: 80041c71 Type:System.Runtime.InteropServices.COMException ST:   at KVS.EnterpriseVault.Interop.IndexSearch2Class.SearchToXML(String bsQuery, Int32 startResult, Int32 maximumResults, String reserved, String processingInstruction, Int32 xmlFormatOptions)|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.GetItemsInIndex(UInt64 chunkLow, UInt64 chunkHigh) Inner:None

{IndexingSubTaskProcessor`2.HandleIndexingToolException} Exception: Failed to search the index volume - search did not complete within the required time. Info:An indexing exception has been caught. Diag: Type:Symantec.EnterpriseVault.Indexing.Common.Tools.IndexVolumeSearchFailedException ST:|Server stack trace: |   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.GetItemsInIndex(UInt64 chunkLow, UInt64 chunkHigh)|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.ProcessChunk(UInt64 chunkLow, UInt64 chunkHigh, Int32 archivePointIdentity)|   at System.Runtime.Remoting.Messaging.StackBuilderSink._PrivateProcessMessage(IntPtr md, Object[] args, Object server, Int32 methodPtr, Boolean fExecuteInContext, Object[]& outArgs)|   at System.Runtime.Remoting.Messaging.StackBuilderSink.PrivateProcessMessage(RuntimeMethodHandle md, Object[] args, Object server, Int32 methodPtr, Boolean fExecuteInContext, Object[]& outArgs)

{INDEXINGSUBTASKREPORT.EN_US} 05/11/2013 18:02:16 The verify subtask has failed: Failed to search the index volume - search did not complete within the required time.
 

Dtrace log entries regarding "The conversion of the nvarchar value '1341847213418472' overflowed an int column":

{ITEMVERIFICATIONPHASE.EN_US} Exception: The conversion of the nvarchar value '1341847213418472' overflowed an int column.|The statement has been terminated. Info: Diag:Num:248 State:1 Sev:16 Svr:PWEVSDBOS52\EVSGDB02,1442 Proc:VerifyIndexingEntries64 Line:41 Type:System.Data.SqlClient.SqlException ST:   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)|   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)|   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)|   at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)|   at System.Data.SqlClient.SqlDataReader.SetMetaData(_SqlMetaDataSet metaData, Boolean moreInfo)|   at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)|   at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()|   at System.Data.SqlClient.SqlDataReader.get_MetaData()|   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)|   at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)|   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)|   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)|   at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)|   at System.Data.SqlClient.SqlCommand.ExecuteReader()|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.FindProblemItems(SqlConnection conn, String xmlItems, UInt64 chunkLow, UInt64 chunkHigh, Int32 archivePointIdentity) Inner:None

{IndexingSubTaskProcessor`2.HandleIndexingToolException} Exception: There was an error verifying the index entries against the vault store database. Info:An indexing exception has been caught. Diag: Type:Symantec.EnterpriseVault.Indexing.Common.Tools.VaultStoreAccessException ST:|Server stack trace: |   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.FindProblemItems(SqlConnection conn, String xmlItems, UInt64 chunkLow, UInt64 chunkHigh, Int32 archivePointIdentity)|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.ProcessChunk(UInt64 chunkLow, UInt64 chunkHigh, Int32 archivePointIdentity)|   at System.Runtime.Remoting.Messaging.StackBuilderSink._PrivateProcessMessage(IntPtr md, Object[] args, Object server, Int32 methodPtr, Boolean fExecuteInContext, Object[]& outArgs)|   at System.Runtime.Remoting.Messaging.StackBuilderSink.PrivateProcessMessage(RuntimeMethodHandle md, Object[] args, Object server, Int32 methodPtr, Boolean fExecuteInContext, Object[]& outArgs)|   at System.Runtime.Remoting.Messaging.StackBuilderSink.AsyncProcessMessage(IMessage msg, IMessageSink replySink)|Exception rethrown at [0]: |   at System.Runtime.Remoting.Proxies.RealProxy.EndInvokeHelper(Message reqMsg, Boolean bProxyCase)|   at System.Runtime.Remoting.Proxies.RemotingProxy.Invoke(Object NotUsed, MessageData& msgData)|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.HandleItemProcessing.EndInvoke(IAsyncResult result)|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.VerifyChunk(UInt64 chunkLow, UInt64 chunkHigh, Int32 archivePointIdentity)|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.Verify()|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.Run()|   at KVS.EnterpriseVault.EVIndexVerifyTask.VerifyTaskProcessor.ItemVerificationPhase()|   at Symantec.EnterpriseVault.Indexing.Common.Tools.IndexingSubTaskProcessor`2.RunPhase(phaseDelegate phaseMethod)|   at KVS.EnterpriseVault.EVIndexVerifyTask.VerifyTaskProcessor.ProcessSubtask(String[] args) Inner:System.Data.SqlClient.SqlException: The conversion of the nvarchar value '1341847213418472' overflowed an int column.|The statement has been terminated.|   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)|   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)|   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)|   at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)|   at System.Data.SqlClient.SqlDataReader.SetMetaData(_SqlMetaDataSet metaData, Boolean moreInfo)|   at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)|   at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()|   at System.Data.SqlClient.SqlDataReader.get_MetaData()|   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)|   at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)|   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)|   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)|   at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)|   at System.Data.SqlClient.SqlCommand.ExecuteReader()|   at KVS.EnterpriseVault.EVIndexVerifyTask.ItemVerificationPhase.FindProblemItems(SqlConnection conn, String xmlItems, UInt64 chunkLow, UInt64 chunkHigh, Int32 archivePointIdentity)

{INDEXINGSUBTASKREPORT.EN_US} 05/11/2013 18:42:19 The verify subtask has failed: There was an error verifying the index entries against the vault store database.The conversion of the nvarchar value '1341847213418472' overflowed an int column.|The statement has been terminated.


Cause



During an index verify operation a timeout value is not specified and therefore the default value 120 seconds is used. Since the index volume is so large it takes a long time to load and therefore the index verify operation times out. 


Solution



This issue has been addressed in the following release:
 
Enterprise Vault 11.0.0 Cumulative Hotfix 2 Release
http://www.symantec.com/docs/TECH224298

Supplemental Materials

SourceETrack
Value3273989
Description

 Index Verify periodically times out on some Index Volumes



Article URL http://www.symantec.com/docs/TECH212437


Terms of use for this information are found in Legal Notices