Video Screencast Help

Processing failed-even after rerun post-processing - Consolidation Lock

Created: 13 Feb 2013 | 6 comments

I continue to get processor error trying to process a set of NSF archives.  Anyone ever see these?

 

Failed to acquire Consolidation Lock due to timeout 0 milliseconds. Lock hold by following Writer - null Readers -
com.teneo.esa.consolidationframework.ConsolidationException: [#600100] Failed to acquireLock
com.teneo.esa.consolidationframework.ConsolidationLockManagerImpl.acquireLock(ConsolidationLockManagerImpl.java:76)
com.teneo.esa.consolidationframework.ConsolidationLockManagerImpl.acquireLock(ConsolidationLockManagerImpl.java:56)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.acquireLock(ConsolidationManagerImpl.java:685)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.swapOrRevert(ConsolidationManagerImpl.java:358)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.consolidate(ConsolidationManagerImpl.java:203)
com.teneo.esa.common.core.PostProcessingComponent.cleanupNormal(PostProcessingComponent.java:623)
com.teneo.esa.common.core.PostProcessingComponent.execute(PostProcessingComponent.java:458)
com.teneo.esa.common.core.PostProcessingTask.execute(PostProcessingTask.java:201)
com.teneo.esa.common.core.PostProcessingTask.cwRun(PostProcessingTask.java:116)
com.teneo.esa.common.core.PostProcessingTask.run(PostProcessingTask.java:298)
com.teneo.esa.system.scheduler.ScheduledJobDescriptor$ScheduleJob.run(ScheduledJobDescriptor.java:77)
com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:152)
com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:137)
com.teneo.esa.jobmanager.JobRunner.access$000(JobRunner.java:59)
com.teneo.esa.jobmanager.JobRunner$1.call(JobRunner.java:184)
com.teneo.esa.common.ThreadPool.Task.cwRun(Task.java:288)
com.teneo.esa.common.util.CWRunnableImpl.run(CWRunnableImpl.java:46)
com.teneo.esa.common.util.CWThread.run(CWThread.java:88)
Caused by: com.teneo.esa.common.lock.DistributedLockTimeoutException: [#730100] 600,000
com.teneo.esa.common.lock.MasterDistributedLockImpl.lockWrite(MasterDistributedLockImpl.java:155)
com.teneo.esa.common.lock.LocalLocker.getPreLockWriteLocal(LocalLocker.java:144)
com.teneo.esa.common.lock.RemoteLocker$3.call(RemoteLocker.java:129)
com.teneo.esa.common.lock.RemoteLocker$3.call(RemoteLocker.java:122)
com.teneo.esa.common.remote.ServerSideRemoteExecutor.callTask(ServerSideRemoteExecutor.java:115)
com.teneo.esa.common.remote.RemotingService.callTask(RemotingService.java:60)
com.teneo.esa.common.remote.ClientSideRemoteExecutor.call(ClientSideRemoteExecutor.java:111)
com.teneo.esa.common.lock.RemoteLocker.get(RemoteLocker.java:122)
com.teneo.esa.consolidationframework.ConsolidationLockManagerImpl.acquireLock(ConsolidationLockManagerImpl.java:122)
com.teneo.esa.consolidationframework.ConsolidationLockManagerImpl.acquireLock(ConsolidationLockManagerImpl.java:68)
com.teneo.esa.consolidationframework.ConsolidationLockManagerImpl.acquireLock(ConsolidationLockManagerImpl.java:56)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.acquireLock(ConsolidationManagerImpl.java:685)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.swapOrRevert(ConsolidationManagerImpl.java:358)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.consolidate(ConsolidationManagerImpl.java:203)
com.teneo.esa.common.core.PostProcessingComponent.cleanupNormal(PostProcessingComponent.java:623)
com.teneo.esa.common.core.PostProcessingComponent.execute(PostProcessingComponent.java:458)
com.teneo.esa.common.core.PostProcessingTask.execute(PostProcessingTask.java:201)
com.teneo.esa.common.core.PostProcessingTask.cwRun(PostProcessingTask.java:116)
com.teneo.esa.common.core.PostProcessingTask.run(PostProcessingTask.java:298)
com.teneo.esa.system.scheduler.ScheduledJobDescriptor$ScheduleJob.run(ScheduledJobDescriptor.java:77)
com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:152)
com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:137)
com.teneo.esa.jobmanager.JobRunner.access$000(JobRunner.java:59)
com.teneo.esa.jobmanager.JobRunner$1.call(JobRunner.java:184)
com.teneo.esa.common.ThreadPool.Task.cwRun(Task.java:288)
com.teneo.esa.common.util.CWRunnableImpl.run(CWRunnableImpl.java:46)
com.teneo.esa.common.util.CWThread.run(CWThread.java:88)
Caused by: java.util.concurrent.TimeoutException
com.teneo.esa.common.lock.MasterDistributedLockImpl.lockWrite(MasterDistributedLockImpl.java:155)
com.teneo.esa.common.lock.LocalLocker.getPreLockWriteLocal(LocalLocker.java:144)
com.teneo.esa.common.lock.RemoteLocker$3.call(RemoteLocker.java:129)
com.teneo.esa.common.lock.RemoteLocker$3.call(RemoteLocker.java:122)
com.teneo.esa.common.remote.ServerSideRemoteExecutor.callTask(ServerSideRemoteExecutor.java:115)
com.teneo.esa.common.remote.RemotingService.callTask(RemotingService.java:60)
com.teneo.esa.common.remote.ClientSideRemoteExecutor.call(ClientSideRemoteExecutor.java:111)
com.teneo.esa.common.remote.RemoteExecutorImpl.call(RemoteExecutorImpl.java:48)
com.teneo.esa.common.lock.RemoteLocker.remoteExec(RemoteLocker.java:199)
com.teneo.esa.common.lock.RemoteLocker.get(RemoteLocker.java:122)
com.teneo.esa.consolidationframework.ConsolidationLockManagerImpl.acquireLock(ConsolidationLockManagerImpl.java:122)
com.teneo.esa.consolidationframework.ConsolidationLockManagerImpl.acquireLock(ConsolidationLockManagerImpl.java:68)
com.teneo.esa.consolidationframework.ConsolidationLockManagerImpl.acquireLock(ConsolidationLockManagerImpl.java:56)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.acquireLock(ConsolidationManagerImpl.java:685)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.swapOrRevert(ConsolidationManagerImpl.java:358)
com.teneo.esa.consolidationframework.ConsolidationManagerImpl.consolidate(ConsolidationManagerImpl.java:203)
com.teneo.esa.common.core.PostProcessingComponent.cleanupNormal(PostProcessingComponent.java:623)
com.teneo.esa.common.core.PostProcessingComponent.execute(PostProcessingComponent.java:458)
com.teneo.esa.common.core.PostProcessingTask.execute(PostProcessingTask.java:201)
com.teneo.esa.common.core.PostProcessingTask.cwRun(PostProcessingTask.java:116)
com.teneo.esa.common.core.PostProcessingTask.run(PostProcessingTask.java:297)
com.teneo.esa.system.scheduler.ScheduledJobDescriptor$ScheduleJob.run(ScheduledJobDescriptor.java:75)
com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:152)
com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:137)
com.teneo.esa.jobmanager.JobRunner.access$000(JobRunner.java:59)
com.teneo.esa.jobmanager.JobRunner$1.call(JobRunner.java:184)
com.teneo.esa.common.ThreadPool.Task.cwRun(Task.java:288)
com.teneo.esa.common.util.CWRunnableImpl.run(CWRunnableImpl.java:45)
com.teneo.esa.common.util.CWThread.run(CWThread.java:88)
02/13/2013 16:46:12    System            Fatally shutting down component due to errors: Fatal Failure
02/13/2013 16:46:12   System            Total Progress: 100%
02/13/2013 16:46:12   System            Processing Summary
02/13/2013 16:46:12   System                        Indexer       01h 04m 19.385s
02/13/2013 16:46:12   System                      Validator               31.419s
02/13/2013 16:46:12   System                       Threader               32.401s
02/13/2013 16:46:12   System                SearchAnalytics               29.546s
02/13/2013 16:46:12   System                     Statistics               13.167s
02/13/2013 16:46:12   System               DistributedMerge               00.858s
02/13/2013 16:46:12   System               CentralizedMerge               00.171s
02/13/2013 16:46:12   System                   Consolidator           10m 00.258s
02/13/2013 16:46:12   System            Total Processing Time : 01h 16m 07.205s

 

Comments 6 CommentsJump to latest comment

Liam Finn's picture

Has the collection finished or if you are just processing a directory on a drive are any of the files locked open by an app?

 

Can you detail the steps you have taken to get to this error

 

Also what Version are you running and what SP or Hotfixes

 

Thanks

 

Liam Finn's picture

The more i think about this it sounds like you trying to access case content while processing is happening

 

During processing the consolidation process applies locks on the content and the case while consolidation is in process. 

 

Can you check if the processing is still in progress?

Liam Finn's picture

Did you find a solution to this. If yes please post it so others can learn.

Thanks

Max_S's picture

All,

 

I rebooted the server and it appears the source file or a source file was locked.
I am running Clearwell 7.1.2 with the latest hotfix to date.
I re-ran "Rerun Post Processing" and it completed successfully.

Thanks for the follow up.  I will look deeper into the logs and share any findings that may be of value to the post.

 

 

Liam Finn's picture

Happy to assist. File locks happen during processing for many reasons> one of which is the file being held open because of it being written to by the collector.

 

Also if Anti-virus was running on that directory ( which should be an exclusion in the AV policy) that could cause the file to lock and create an issue similar to this

 

If you need further assistance please post on the forums as they are monitored closely

 

Liam Finn's picture

Any updates on this? If not can you mark a post as the solution so it can be closed and no longer listed as an open issue

 

Thanks