VTL issue
Updated: 26 May 2011 | 27 comments
This issue has been solved. See solution.
Hi,
I have just installed a virtual tape library on a linux machine, then installed NBU Media server on it.
NBU version 6.5 on both master/media servers and clients.
I've configured the tape library from the master server (Windows 2003) and when I'm trying to run a backup I'm continually getting "resource request failed(800)" error.
There are 4 drives installed and also a lot of tapes. Any help is much appreciated.
Thanks and regs,
Virgil.
Discussion Filed Under:
Group Ownership:
Comments
Please post all info in
Please post all info in Details tab.
This will hopefully give an indication of WHICH resource allocation is failing...
Have you verified VTL functionality with robtest?
Was Robot inventory successful?
Maybe also consider upgrade to 6.5.6 - not that it will solve your problem, but status 800 is replaced with more meaningful status codes and error messages.
Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links
Hi, I haven't tested the
Hi,
I haven't tested the functionality with 'robtest', but the Robot inventory was successful.
Please find below info fron the Details tab:
25/10/2010 18:00:00 - requesting resource MediaSTU2
25/10/2010 18:00:00 - requesting resource nbu-win-svr.NBU_CLIENT.MAXJOBS.winclient
25/10/2010 18:00:00 - requesting resource nbu-win-svr.NBU_POLICY.MAXJOBS.Client2Media_VTL
25/10/2010 06:58:17 - collecting BMR information
25/10/2010 06:58:17 - connecting
25/10/2010 06:58:18 - connected; connect time: 00:00:01
25/10/2010 06:58:18 - transferring BMR infomation to the master server
25/10/2010 06:58:18 - connecting
25/10/2010 06:58:18 - connected; connect time: 00:00:00
25/10/2010 18:00:00 - granted resource nbu-win-svr.NBU_CLIENT.MAXJOBS.winclient
25/10/2010 18:00:00 - granted resource nbu-win-svr.NBU_POLICY.MAXJOBS.Client2Media_VTL
25/10/2010 18:00:00 - granted resource LT06L1
25/10/2010 18:00:00 - granted resource drive1
25/10/2010 18:00:00 - granted resource MediaSTU2
25/10/2010 18:00:02 - estimated 0 kbytes needed
25/10/2010 18:00:02 - begin Parent Job
25/10/2010 18:00:02 - begin Bare Metal Restore , Start Notify Script
Status 26
25/10/2010 18:00:02 - end Bare Metal Restore , Start Notify Script; elapsed time: 00:00:00
25/10/2010 18:00:02 - begin Bare Metal Restore , BMR Save
25/10/2010 18:00:03 - started process bpbrm (14885)
25/10/2010 06:58:23 - Error bpbrm(pid=14885) BMRERR: Received BMR error: Failed to import Config file. (1)
25/10/2010 06:58:23 - Error bpbrm(pid=14885) BMRERR: Received BMR error: Failed sending the discovery. (1)
25/10/2010 06:58:24 - Error bpbrm(pid=14885) BMRERR: Received BMR error: The NBU client version is incompatible with the master server. (1)
25/10/2010 18:00:14 - end writing
Status 1
25/10/2010 18:00:14 - end Bare Metal Restore , BMR Save; elapsed time: 00:00:12
25/10/2010 18:00:14 - begin Bare Metal Restore , Policy Execution Manager Preprocessed
Status 800
25/10/2010 18:24:45 - end Bare Metal Restore , Policy Execution Manager Preprocessed; elapsed time: 00:24:31
25/10/2010 18:24:45 - begin Bare Metal Restore , Stop On Error
Status 0
25/10/2010 18:24:45 - end Bare Metal Restore , Stop On Error; elapsed time: 00:00:00
25/10/2010 18:24:45 - begin Bare Metal Restore , End Notify Script
Status 26
25/10/2010 18:24:45 - end Bare Metal Restore , End Notify Script; elapsed time: 00:00:00
Status 800
25/10/2010 18:24:45 - end Parent Job; elapsed time: 00:24:43
resource request failed(800)
Regards,
Virgil.
Looks like a issue with the PARTED
Chk this technote
http://www.symantec.com/business/support/index?page=content&id=TECH60242
Ensure that PARTED is available on the client. Else the PARTED package needs to be installed to the client.
Seems physical resources were
Seems physical resources were allocated correctly:
25/10/2010 18:00:00 - granted resource LT06L1
25/10/2010 18:00:00 - granted resource drive1
25/10/2010 18:00:00 - granted resource MediaSTU2
Please disable BMR in the backup policy to test basic functionality.
Once that is working, troubleshoot the BMR error.
Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links
Regarding BMR error: Error
Regarding BMR error:
Error bpbrm(pid=14885) BMRERR: Received BMR error: The NBU client version is incompatible with the master server. (1)
Please can you confirm NBU client version installed on your client machine. Also what is your client OS/Version? I suspect either of these has supportability issue.
BMR master server logs (119 id) will help to confirm this problem.
Thanks.
-Mandar
Sorry for the delay but I was
Sorry for the delay but I was very busy today.
@Mandar
I'm using NBU 6.5 on all machines..
@Marianne
I've disabled BMR in the backup policy as you suggested, but I have the same problem.. The job freezes on the mount operation for a long time and then gives a similar error:
26/10/2010 16:14:16 - requesting resource MediaSTU2
26/10/2010 16:14:16 - requesting resource nbu-win-svr.NBU_CLIENT.MAXJOBS.winclient
26/10/2010 16:14:16 - requesting resource nbu-win-svr.NBU_POLICY.MAXJOBS.Client2Media_VTL
26/10/2010 16:14:16 - granted resource nbu-win-svr.NBU_CLIENT.MAXJOBS.winclient
26/10/2010 16:14:16 - granted resource nbu-win-svr.NBU_POLICY.MAXJOBS.Client2Media_VTL
26/10/2010 16:14:16 - granted resource 8MM002
26/10/2010 16:14:16 - granted resource drive1_Quantum
26/10/2010 16:14:16 - granted resource MediaSTU2
26/10/2010 16:14:16 - estimated 0 kbytes needed
26/10/2010 16:14:18 - started process bpbrm (22510)
26/10/2010 16:14:21 - connecting
26/10/2010 16:14:21 - connected; connect time: 00:00:00
26/10/2010 16:14:26 - mounting 8MM002
26/10/2010 05:46:23 - Error bptm(pid=22511) error requesting media, TpErrno = Robot operation failed
26/10/2010 05:46:24 - Warning bptm(pid=22511) media id 8MM002 load operation reported an error
26/10/2010 16:28:38 - current media 8MM002 complete, requesting next media Any
26/10/2010 05:46:32 - Error bptm(pid=22511) NBJM returned an extended error status: resource request failed (800)
26/10/2010 16:28:48 - end writing
extended error status has been encountered, check logs(252)
Thanks a lot for your help.
Regards,
Virgil.
If you see the below you are
If you see the below you are getting initial problem in mounting. So the problem getting narrow. See closely the Tape Drive and Media
26/10/2010 16:14:26 - mounting 8MM002
26/10/2010 05:46:23 - Error bptm(pid=22511) error requesting media, TpErrno = Robot operation failed
Then very next you got the below error ("resource request failed") . this insist us that verify the Drive and Media
26/10/2010 16:28:38 - current media 8MM002 complete, requesting next media Any
26/10/2010 05:46:32 - Error bptm(pid=22511) NBJM returned an extended error status: resource request failed (800)
Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb
zahidhaseeb.wordpress.com
...looks like an almost
...looks like an almost direct copy of the post below...?
If you find this is a solution, please mark it as such.
Robot operation failed
error requesting media, TpErrno = Robot operation failed
Warning bptm(pid=22511) media id 8MM002 load operation reported an error
Please use robtest on the media server to test mount/dismount. Let us know what the outcome is.
Also ensure that you have bptm log as well as VERBOSE entry in vm.conf on media server (restart NBU daemons after adding VERBOSE entry). Media Manager errors will be logged to /var/log/messages.
Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links
For BMR error: Please attach
For BMR error:
Please attach your bmrd (119) log on master server. Please make sure debug level in nblog.conf is set to 6. If level is not 6 then please set it, restart services, take another bmr enabled backup, collect 119 log.
Thanks.
-Mandar
Hi, Well, the BMR error
Hi,
Well, the BMR error apears only when backing up on VTL, on DSU works fine - so the problem is VTL related.
I've run the robtest and attached the output from the console. The robot seems to be OK, but there is a problem with the drives I think.
When I run drive diagnostics it failes for all of the drives with "Unable to allocate resources for diagnostics"
Thank you All!
Regards,
Virgil.
Hi Mandar, I have also
Hi Mandar,
I have also attached the bmrd (119) log from master server. However I think the problem is with the VTL as the backups on DSU (with BMR enabled) are successful.
Cheers,
Virgil.
Regards,
Virgil.
As you said that backups on
As you said that backups on DSU are successful. its mean that your Tape Drives performing well. So the problem is with VTL. did you try to reconfigure / reinstall the VTL again ? try to reinstall the VTL it may help you
Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb
zahidhaseeb.wordpress.com
Which VTL are you using .
Which VTL are you using . Media server is windows or linux ?
If it is a windows , in device manager check all the VTL drives has proper driver installed . I have encountered lot of issues in windows like driver missing for VTL drives after reboot.
Run the below command on the media server and check whether all the drives are up or not .
Volmgr\bin>tpconfig -d
Run Robtest and verify the command excute and try to load a media and unload .
I've downloaded the vtl from
I've downloaded the vtl from the link: http://sites.google.com/site/linuxvtl2/ and I'm trying to use them in a test environment.
I've installed NBU media server on the server where I've loaded the vtl and the master server is on a W2003 machine.
Volmgr\bin>tpconfig -d shows all drives UP.
Using robtest all seems to be OK, I am able to load/unload media without problems.
Thanks.
Regards,
Virgil.
Have you applied VTL license
Have you applied VTL license ? , it seems to be license missing . Please verify your license whether you have applied or not , it will be like "Vitural Tape Option" .
Please do the following test
Please do the following test again:
Use robtest to mount a tape (preferably 8MM002).
In another window, check drive status:
vmoprcmd -d
Also check drive status from O/S point of view:
mt -f /dev/rmt...... status
If I look at robtest output - there seems to be a mix of SDLT, 8MM and ULT media. Are there matching tape drives for all these media types? And different STU's?
How was the media and tape drives configured in NBU? Hopefully different densities?
Please post output of:
On master:
vmquery -a -bx
bpstulist -U
On media server:
tpconfig -l
Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links
Have you tried contacting the VTL author?
Just out of curiosity, since you are using the MHVTL, have you tried contacting the Author? He is listed (with emails) on the link page you posted, and is an employee of Symantec tech support in Australia. You also don't mention what version of the MHVTL you are using... is it a stable release vs dev release, etc.
Also, I should probably assume you are using iSCSI initiators in the Windows machine (since the VTL is running in a remote linux VM), so the versioning of that would be relevant as well, possibly.
I don't ask these questions for myself, as I wouldn't be able to troubleshoot this, but this is the type of thing that would probably be relevant.
T
Principal Learning Consultant with Symantec Education Course Development
Did you run robtest on the
Were you able to successfully move a tape into the drive in question and back again (without any SCSI sense code errors) ?
The 'robtest' only showed a listing of the library. no attempts to move media around.
Can you please supply the output of the following commands also:
/usr/openv/volmgr/bin/tpconfig -d
/usr/openv/volmgr/bin/vmoprcmd -d
/usr/openv/volmgr/bin/vmquery -a -j
/usr/openv/volmgr/bin/bpstulist -U
The 'tpconfig -d' shows the tape/library configuration from NetBackups point of view
The 'vmoprcmd -d' reports on the daemon status and if the devices are operational.
The 'vmquery -a -j' reports the status of all media (volumes) known to NetBackup.
The 'bpstulist -U' reports the configuration NetBackups storage unit(s).
Cheers
Mark
Thanks a lot for your
Thanks a lot for your help.
In seems that I don't have the Vitural Tape Option key. I didn't know that I need a license in order to work with VTL in NBU 6.5.
Cheers
Virgil
Regards,
Virgil.
License key check
The 'mhvtl' is designed not as a Virtual Tape Library, but to behave like a real library (as far as NetBackup is concerned).
i.e. It's primary design critera was to assist trouble-shooting NetBackup. Hence the mhvtl contains features like 'TapeAlert', cleaning tapes, Media Access Ports etc. which don't make sense for a commercial VTL.
Hence a VTL license is not strictly required, however you DO need a library & drive licenses.
If you would like me to confirm your license key(s) will work with the mhvtl, please forward a private email to 'mark_harvey@symantec.com' with your license key(s). (Please do NOT post your license keys to this forum).
Although I've not tested, I doubt the resource broker would grant the resources if the license key dis-allowed such functionality. As the job details clearly show the the resources granted, but the actual mount failed. This is typically as a result of an error returned from the tldcd -> robotic controller (one of the mhvtl daemons in this instance).
Cheers
Mark
Status update
For anybody reading this thread in the future, a status update.
The backups were always failing with "resource request failed(800)"
The license key in use was an expired Time Limited Demo license.
Note: You can always check the validity of a license key by using "bpminlicense -verbose" command.
Hi Mark, I've updated both
Hi Mark,
I've updated both master (W2003) and media (Suse Linux) servers to NBU7 and I have the same identical issue.
Cheers,
Virgil.
Regards,
Virgil.
Identical Issue
Hello Virgil,
When you say you have the same identical issue, I assume you now have a new temporary NetBackup license key that is valid.
From the VTL side of things, please :
- edit the /etc/mhvtl/mhvtl.conf and enable VERBOSE = 3
- Re-start the daemons
Re-test and create the fault symptoms using NetBackup.
Can you then supply me with:
/var/log/messages
The output of the following commands (I still have not seen them)
/usr/openv/volmgr/bin/tpconfig -d
/usr/openv/volmgr/bin/vmoprcmd -d
/usr/openv/volmgr/bin/vmquery -a -j
/usr/openv/volmgr/bin/bpstulist -U
Cheers
Hi Mark, Sorry to come back
Hi Mark,
Sorry to come back to you so late, but I have been involved in other projects and let this apart. :)
Yes, I have a temporary license available until January 2012.
From within the NBU console, robot diagnostic is successful but the drive diagnostics fail for all the drives with "unable to allocate resources for diagnostics" and all the backups fail with status 96. Also notice that the robtest works all right.
Please find attached the messages log and the output for the requested commands.
Thanks a lot for your help. Cheers.
Regards,
Virgil.
I see a couple of things that
I see a couple of things that need to change.
The storage units are defined for one drive a piece when there are 2 of them:
Label: HCART-STU1
Storage Unit Type: Media Manager
Host Connection: nbu-media
Number of Drives: 1
On Demand Only: no
Max MPX/drive: 1
Density: hcart - 1/2 Inch Cartridge
Robot Type/Number: TLD / 0
Max Fragment Size: 1048575 MB
Label: HCART2-STU1
Storage Unit Type: Media Manager
Host Connection: nbu-media
Number of Drives: 1
On Demand Only: no
Max MPX/drive: 1
Density: hcart2 - 1/2 Inch Cartridge 2
Robot Type/Number: TLD / 0
Max Fragment Size: 1048575 MB
EX:
****************************************************************************
3 IBM.ULT3580-TD4.003 hcart TLD(0) DRIVE=3
/dev/nst2 UP
5 IBM.ULT3580-TD5.000 hcart2 TLD(0) DRIVE=2
/dev/nst1 UP
6 IBM.ULT3580-TD4.005 hcart TLD(0) DRIVE=4
/dev/nst3 UP
7 IBM.ULT3580-TD5.001 hcart2 TLD(0) DRIVE=1
/dev/nst0 UP
Change the # of drives to be 2 for each storage unit.
The real problem though is that your media is defined as DLT and the drives are defined as hcart and hcart2. These do not match your media type so, you receive the status 96 errors. See below.
VOLUME5.0 1001L4 - DLT E01001L4 nbu-media TLD 0 1 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1002L4 - DLT E01002L4 nbu-media TLD 0 2 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1003L4 - DLT E01003L4 nbu-media TLD 0 3 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1004L4 - DLT E01004L4 nbu-media TLD 0 4 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1005L4 - DLT E01005L4 nbu-media TLD 0 5 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1006L4 - DLT E01006L4 nbu-media TLD 0 6 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1007L4 - DLT E01007L4 nbu-media TLD 0 7 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1008L4 - DLT E01008L4 nbu-media TLD 0 8 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1009L4 - DLT E01009L4 nbu-media TLD 0 9 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1010L4 - DLT E01010L4 nbu-media TLD 0 10 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1011L4 - DLT E01011L4 nbu-media TLD 0 11 - 000_00000_TLD Scratch 0 0 - 1302247003 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1012L4 - DLT E01012L4 nbu-media TLD 0 12 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1013L4 - DLT E01013L4 nbu-media TLD 0 13 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1014L4 - DLT E01014L4 nbu-media TLD 0 14 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1015L4 - DLT E01015L4 nbu-media TLD 0 15 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1016L4 - DLT E01016L4 nbu-media TLD 0 16 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1017L4 - DLT E01017L4 nbu-media TLD 0 17 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1018L4 - DLT E01018L4 nbu-media TLD 0 18 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1019L4 - DLT E01019L4 nbu-media TLD 0 19 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1020L4 - DLT E01020L4 nbu-media TLD 0 20 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1030L5 - DLT F01030L5 nbu-media TLD 0 30 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1031L5 - DLT F01031L5 nbu-media TLD 0 31 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1032L5 - DLT F01032L5 nbu-media TLD 0 32 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1033L5 - DLT F01033L5 nbu-media TLD 0 33 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1034L5 - DLT F01034L5 nbu-media TLD 0 34 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1035L5 - DLT F01035L5 nbu-media TLD 0 35 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1036L5 - DLT F01036L5 nbu-media TLD 0 36 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1037L5 - DLT F01037L5 nbu-media TLD 0 37 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1038L5 - DLT F01038L5 nbu-media TLD 0 38 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 1039L5 - DLT F01039L5 nbu-media TLD 0 39 - 000_00000_TLD NetBackup 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 N101L4 - DLT CLN101L4 nbu-media TLD 0 22 - 000_00000_TLD None 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
VOLUME5.0 N102L5 - DLT CLN102L5 nbu-media TLD 0 23 - 000_00000_TLD None 0 0 - 1302247004 0 0 0 0 0 - 0 0 - - 50 - Added by Media Manager
There are a couple of ways this can be fixed. Re-inventory the L4 media as hcart media and the L5 media as hcart2.
CLN101L4 -- also needs to be added a hcart cleaning tape versus a regular data tape, tape CLN102L5 needs to be added as a hcart 2 cleaning tape.
The other way would be to update the drive types to DLT instead of hcart and hcart2, if you go this route the storage units would need to be changed as well.
Hope this helps, questions let me know...
Brad, you were ritght. I
Regards,
Virgil.
Would you like to reply?
Login or Register to post your comment.