Video Screencast Help

awaiting resource A00013 A pending request has been generated for this resource request.

Created: 01 May 2013 • Updated: 05 May 2013 | 21 comments
Zahid.Haseeb's picture
This issue has been solved. See solution.

Environment

Primary Site:

NBU Master/Media Server 7.5.0.3 (32bit)

OS = Windows 2003 SP2 (32bit)

Tape Drive = Standalone Tape Drive

Secondary Site:

NBU Media Server 7.5.0.3 (32bit)

OS = Windows 2003 SP2 (32bit)

Tape Drive = Standalone Tape Drive

(Primary Site and Secondary Site are connected via VPN)

Query

I have taken a backup on Tape Cartridge from Primary Site Master/Media Server. Send this Tape Cartridge to Secondary Site. Insert the Tape Cartridge in to the Media Server of Secondary Site. I open Backup Archive and Restore of Media Server at Secondary Site, select few backup images and hit restore on the Media Server at Secondary Site(Just to check restore and its very tiny backup images). After hit restore I can see the below situation:

Master/Media Server of Primary Site:

5/1/2013 7:36:25 PM - begin Restore
5/1/2013 7:36:30 PM - 1 images required
5/1/2013 7:36:31 PM - media A00013 required
5/1/2013 7:36:31 PM - restoring image 192.168.1.102_1356932098
5/1/2013 7:36:37 PM - Info bpbrm(pid=2856) fileserver-me.XXXXXXXX.com is the host to restore to      
5/1/2013 7:36:37 PM - Info bpbrm(pid=2856) telling media manager to start restore on client     
5/1/2013 7:36:43 PM - requesting resource A00013
5/1/2013 7:36:43 PM - awaiting resource A00013 A pending request has been generated for this resource request.
     Operator action may be required. Pending Action: No action.,
     Media ID: A00013, Barcode: --------, Density: 4mm, Access Mode: Read,
     Action Drive Name: N/A, Action Media Server: N/A, Robot Number: N/A, Robot Type: NONE,
     Volume Group: ---, Action Acs: N/A, Action Lsm: N/A
    
5/1/2013 7:36:44 PM - Info bpbrm(pid=5748) fileserver-me.XXXXXXXX.com is the host to restore to      
5/1/2013 7:36:44 PM - connecting
5/1/2013 7:36:49 PM - Info bpbrm(pid=5748) start tar32 on client         
5/1/2013 7:36:53 PM - Info tar32(pid=2520) Restore started.           
5/1/2013 7:36:53 PM - connected; connect time: 00:00:09
5/1/2013 7:37:43 PM - awaiting resource A00013 A pending request has been generated for this resource request.
     Operator action may be required. Pending Action: No action.,
     Media ID: A00013, Barcode: --------, Density: 4mm, Access Mode: Read,
     Action Drive Name: N/A, Action Media Server: N/A, Robot Number: N/A, Robot Type: NONE,
     Volume Group: ---, Action Acs: N/A, Action Lsm: N/A
  

 

Media Server of Secondary Site:

 

DENY.JPG

 

Operating Systems:

Comments 21 CommentsJump to latest comment

sazz.'s picture

This is because the media was written by the master server or media server at the primary site, when you have moved the tapes to secondary site media server and trying the restore it is still wainting to restore the data from the media server that has written the data on the tape.

To resolve this issue either change the media ownership of this tape to secondary site media server or use the media host override options in the master server properties.

Edit: bpmedia -movedb -m media_id -newserver newservername or FORCE_RESTORE_MEDIA_SERVER entry forces restores to go to a specific server, regardless of where the files were backed up.

SOLUTION
Zahid.Haseeb's picture

use the media host override options in the master server properties.

I add the MasterServer/MediaServer name in Orignal Backup attribute and add the name of Media Server under Restore Server attribute.  (under General Server =>Media Host Override) but now face the below status

Activity Monitor

5/2/2013 10:29:47 AM - begin Restore
5/2/2013 10:29:53 AM - 1 images required
5/2/2013 10:29:53 AM - media A00013 required
5/2/2013 10:29:59 AM - restoring image 192.168.1.102_1356932098
5/2/2013 10:30:00 AM - Info bpbrm(pid=1872) fileserver-me.XXXXXX.com is the host to restore to      
5/2/2013 10:30:03 AM - Info bpbrm(pid=1872) telling media manager to start restore on client     
5/2/2013 10:30:05 AM - Info bpbrm(pid=1476) fileserver-me.XXXXXX.com is the host to restore to      
5/2/2013 10:30:05 AM - connecting
5/2/2013 10:30:05 AM - Info bpbrm(pid=1476) start tar32 on client         
5/2/2013 10:30:08 AM - requesting resource A00013
5/2/2013 10:30:08 AM - awaiting resource A00013 Reason: Tape media server is not active, Media Server: fileserver-me.XXXXXX.com,
     Robot Number: NONE, Robot Type: NONE, Media ID: N/A, Drive Name: N/A,
     Volume Pool: N/A, Storage Unit: N/A, Drive Scan Host: N/A
    
5/2/2013 10:30:09 AM - Info tar32(pid=3848) Restore started.           
5/2/2013 10:30:09 AM - connected; connect time: 00:00:04

 

(Restart the Netbackup Service  "BPDOWN/BPUP")

========================================================

I also ran the command from command prompt as below

C:\Program Files\VERITAS\NetBackup\bin\Admincmd>bpmedia.exe -movedb -m A00013 -n
ewserver fileserver-me

Activity Monitor

5/2/2013 10:55:11 AM - begin Restore
5/2/2013 10:55:17 AM - 1 images required
5/2/2013 10:55:17 AM - media A00013 required
5/2/2013 10:55:23 AM - restoring image 192.168.1.102_1356932098
5/2/2013 10:55:24 AM - Info bpbrm(pid=1804) fileserver-me.XXXXX.com is the host to restore to      
5/2/2013 10:55:24 AM - Info bpbrm(pid=1804) telling media manager to start restore on client     
5/2/2013 10:55:26 AM - Info bpbrm(pid=3388) fileserver-me.XXXXX.com is the host to restore to      
5/2/2013 10:55:26 AM - connecting
5/2/2013 10:55:26 AM - Info bpbrm(pid=3388) start tar32 on client         
5/2/2013 10:55:28 AM - requesting resource A00013
5/2/2013 10:55:28 AM - awaiting resource A00013 Reason: Tape media server is not active, Media Server: fileserver-me.XXXXX.com,
     Robot Number: NONE, Robot Type: NONE, Media ID: N/A, Drive Name: N/A,
     Volume Pool: N/A, Storage Unit: N/A, Drive Scan Host: N/A
    
5/2/2013 10:55:30 AM - Info tar32(pid=3560) Restore started.           
5/2/2013 10:55:30 AM - connected; connect time: 00:00:04

 

(Restart the Netbackup Service  "BPDOWN/BPUP")

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Marianne's picture

Tape media server is not active, Media Server: fileserver-me.XXXXXX.com,

 

Have you managed to use this Media server up to now for backups at remote site?

Please post output of the following commands on the master server:

nbemmcmd -listhosts -verbose

nbemmcmd -getemmserver

 

PS: your original issues has actually been resolved by sazz - this is a different issue.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

sazz.'s picture

Marianne is right seems media server is not active

 

Zahid.Haseeb's picture

(Leave tpsbkp2/Dont take tpsbkp2 in your consideration please)

C:\Program Files\VERITAS\NetBackup\bin\Admincmd>nbemmcmd -listhosts -verbose
NBEMMCMD, Version: 7.5.0.3
The following hosts were found:
tpsbkp
        MachineName = "tpsbkp"
        FQName = "tpsbkp.XXXXX.com"
        MachineDescription = ""
        MachineNbuType = server (6)
tpsbkp
        ClusterName = ""
        MachineName = "tpsbkp"
        FQName = "tpsbkp.XXXXX.com"
        GlobalDriveSeed = "VEND:#.:PROD:#.:IDX"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0xb7
        MachineNbuType = master (3)
        MachineState = active for tape and disk jobs (14)
        NetBackupVersion = 7.5.0.3 (750300)
        OperatingSystem = windows (11)
        ScanAbility = 5
tpsbkp2.XXXXX.com
        ClusterName = ""
        MachineName = "tpsbkp2.XXXXX.com"
        FQName = "tpsbkp2.XXXXX.com"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0xb7
        MachineNbuType = media (1)
        MachineState = not reachable by master (4)
        MasterServerName = "tpsbkp"
        NetBackupVersion = 7.1.0.0 (710000)
        OperatingSystem = windows (11)
        ScanAbility = 5
192.168.1.230
        MachineName = "192.168.1.230"
        FQName = "192.168.1.230"
        MachineDescription = ""
        MachineNbuType = virtual_machine (10)
fileserver-me.XXXXX.com
        ClusterName = ""
        MachineName = "fileserver-me.XXXXX.com"
        FQName = "fileserver-me.XXXXX.com"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0xb7
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "tpsbkp"
        NetBackupVersion = 7.5.0.0 (750000)
        OperatingSystem = windows (11)
        ScanAbility = 5
Command completed successfully.

C:\Program Files\VERITAS\NetBackup\bin\Admincmd>

==========================================================

C:\Program Files\VERITAS\NetBackup\bin\Admincmd>nbemmcmd -getemmserver
NBEMMCMD, Version: 7.5.0.3
These hosts were found in this domain: fileserver-me.XXXXX.com, tpsbkp, tpsb
kp2.XXXXX.com

Checking with the host "fileserver-me.XXXXX.com"...
Checking with the host "tpsbkp"...
Checking with the host "tpsbkp2.XXXXX.com"...

Server Type    Host Version        Host Name                     EMM Server

MEDIA          7.5                 fileserver-me.XXXXX.com   tpsbkp

MASTER         7.5                 tpsbkp                        tpsbkp

<unknown>      UNKNOWN RELEASE (-2)tpsbkp2.XXXXX.com         <unknown>

*Failed to get the configuration for the host "tpsbkp2.XXXXX.com". client ho
stname could not be found(48)

One or more hosts had mismatched EMM Servers.
There were problems getting information on one or more hosts.
The consistency check either failed or was incomplete.
Command did not complete successfully.

C:\Program Files\VERITAS\NetBackup\bin\Admincmd>

=================================================

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Zahid.Haseeb's picture

Ahh OK. You mean its Licensing issue ?

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Marianne's picture

tpsbkp
        MachineState = active for tape and disk jobs (14)

fileserver-me.XXXXX.com
        MachineState = active for disk jobs (12)

Licensing on fileserver-me allows it to be used for disk jobs only.

Ensure this media server functions normally as a media server for tape backups before you try restores.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

Zahid.Haseeb's picture

Ensure this media server functions normally as a media server for tape backups before you try restores.

What I understand you are suggesting me to verify the Tape Drive license.

Correct ?

(WIll verify that the license is entered correctly)

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Marianne's picture

Correct. 

Compare licenses on media server with licenses on master.

My understanding is that standalone tape drives do not need library based tape drive license.

You can possibly try to force it as follows:

 

nbemmcmd -updatehost -machinename <media-server> -machinestateop set_tape_active -machinetype media -masterserver <master>

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

Zahid.Haseeb's picture

 .. Why you are so intelligent :)

Thanks

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Zahid.Haseeb's picture

I feel there is also something which I am missing. Searching the problem too

Restore Activity Monitor

5/2/2013 4:05:58 PM - begin Restore
5/2/2013 4:06:04 PM - Info bpbrm(pid=1856) fileserver-me.XXXXX.com is the host to restore to      
5/2/2013 4:06:05 PM - 1 images required
5/2/2013 4:06:05 PM - media A00013 required
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:05 PM - Info bpbrm(pid=1856) telling media manager to start restore on client     
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:06 PM - Info bpbrm(pid=3796) fileserver-me.XXXXX.com is the host to restore to      
5/2/2013 4:06:06 PM - connecting
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:06 PM - Info bpbrm(pid=3796) start tar32 on client         
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:10 PM - Info tar32(pid=840) Restore started.           
5/2/2013 4:06:10 PM - connected; connect time: 00:00:04
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:13 PM - Info bptm(pid=2764) Waiting for mount of media id A00013 (copy 1) on server fileserver-me.XXXXX.com.
5/2/2013 4:06:13 PM - started process bptm (2764)
5/2/2013 4:06:13 PM - mounting A00013
5/2/2013 4:06:13 PM - Info bptm(pid=2764) INF - Waiting for mount of media id A00013 on server fileserver-me.XXXXX.com for reading.
5/2/2013 4:06:16 PM - requesting resource A00013
5/2/2013 4:06:16 PM - granted resource A00013
5/2/2013 4:06:16 PM - granted resource SEAGATE.DATDAT72-000.001
5/2/2013 4:06:24 PM - mounted; mount time: 00:00:11
5/2/2013 4:06:24 PM - Info bptm(pid=2764) A00013            
5/2/2013 4:06:25 PM - Info bptm(pid=2764) INF - Waiting for positioning of media id A00013 on server fileserver-me.XXXXX.com for reading.
5/2/2013 4:06:25 PM - positioning A00013 to file 1
5/2/2013 4:06:25 PM - positioned A00013; position time: 00:00:00
5/2/2013 4:08:07 PM - begin reading
5/2/2013 4:08:09 PM - Info tar32(pid=840) done. status: 0          
5/2/2013 4:08:09 PM - Info bpbrm(pid=1856) child done, status 5         
5/2/2013 4:08:09 PM - Info bpbrm(pid=1856) sending message to media manager: STOP RESTORE 192.168.1.102_1356932098     
5/2/2013 4:08:32 PM - Info bpbrm(pid=1856) media manager for backup id 192.168.1.102_1356932098 exited with status 150: termination requested by administrator
5/2/2013 4:08:33 PM - restored image 192.168.1.102_1356932098 - (the restore failed to recover the requested files(5)); restore time 00:02:22
5/2/2013 4:08:40 PM - Warning bprd(pid=6056) Restore must be resumed prior to first image expiration on INFINITY      
5/2/2013 4:08:46 PM - end Restore; elapsed time: 00:02:48
Restore error(2850)

=================================

=================================

Restore Activity Monitor

5/2/2013 4:20:37 PM - begin Restore
5/2/2013 4:20:43 PM - 1 images required
5/2/2013 4:20:43 PM - media A00013 required
5/2/2013 4:20:50 PM - restoring image tech-server1_1356955091
5/2/2013 4:21:02 PM - Info bpbrm(pid=1264) fileserver-me.XXXXX.com is the host to restore to      
5/2/2013 4:21:02 PM - Info bpbrm(pid=1264) telling media manager to start restore on client     
5/2/2013 4:21:03 PM - Info bpbrm(pid=2304) fileserver-me.XXXXX.com is the host to restore to      
5/2/2013 4:21:03 PM - connecting
5/2/2013 4:21:04 PM - Info bpbrm(pid=2304) start tar32 on client         
5/2/2013 4:21:07 PM - requesting resource A00013
5/2/2013 4:21:07 PM - granted resource A00013
5/2/2013 4:21:07 PM - granted resource SEAGATE.DATDAT72-000.001
5/2/2013 4:21:08 PM - Info tar32(pid=2016) Restore started.           
5/2/2013 4:21:08 PM - connected; connect time: 00:00:05
5/2/2013 4:21:19 PM - mounted
5/2/2013 4:21:19 PM - Info bptm(pid=2212) A00013            
5/2/2013 4:21:19 PM - Info bptm(pid=2212) INF - Waiting for positioning of media id A00013 on server fileserver-me.XXXXX.com for reading.
5/2/2013 4:21:19 PM - positioning A00013 to file 7
5/2/2013 4:22:47 PM - positioned A00013; position time: 00:01:28
5/2/2013 4:23:30 PM - begin reading
5/2/2013 4:43:40 PM - restored image tech-server1_1356955091 - (media read error(85)); restore time 00:22:50
5/2/2013 4:43:42 PM - Error bptm(pid=2212) cannot read image from media id A00013, drive index 0, err = 23
5/2/2013 4:43:43 PM - Warning bptm(pid=2212) TapeAlert Code: 0x03, Type: Warning, Flag: HARD ERROR, from drive SEAGATE.DATDAT72-000.001 (index 0), Media Id A00013
5/2/2013 4:43:43 PM - Error bptm(pid=2212) TapeAlert Code: 0x05, Type: Critical, Flag: READ FAILURE, from drive SEAGATE.DATDAT72-000.001 (index 0), Media Id A00013
5/2/2013 4:43:43 PM - Error bptm(pid=2212) TapeAlert Code: 0x14, Type: Critical, Flag: CLEAN NOW, from drive SEAGATE.DATDAT72-000.001 (index 0), Media Id A00013
5/2/2013 4:43:47 PM - Info bpbrm(pid=1264) child done, status 13         
5/2/2013 4:43:47 PM - Info bpbrm(pid=1264) sending message to media manager: STOP RESTORE tech-server1_1356955091     
5/2/2013 4:43:52 PM - Warning bprd(pid=5520) Restore must be resumed prior to first image expiration on INFINITY      
5/2/2013 4:43:58 PM - end Restore; elapsed time: 00:23:21
Restore error(2850)

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Marianne's picture

This is problem number 3 all in the same discussion!!!

Have you checked the 'view status' tab in the BAR gui?
Please share contents.

Check the following logs to troubleshoot:

On media server: bpbrm and bptm

On destination client: bpcd and tar

*** EDIT ***

I notice that you have edited your previous post in the meantime with new restore attempt details.

The error message is quite clear - drive needs cleaning.

Please ensure that all required log folders exist - see above.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

Zahid.Haseeb's picture

I have a dynamic DNS environment but I also manually add the Master Server name in the host file of Media Server. and also add the entry of Media Server in to the Master Server host file. After that I feel that the problem is resolved which I asked above. But what I feel that I restored some very small file which too a long time but restored.

================

Question: As per my environment:

One Master/Media Server is at Primary Site and one Media Server is at Secondary Site. Both Sites(Primary and Secondary are connected via VPN). The link is around 8mb. 

I dont think that my connectivity between Primary and Secondary could be the reason of slow restore

 

 

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Will Restore's picture

 Critical, Flag: CLEAN NOW

 

seems pretty obvious

Will Restore -- where there is a Will there is a way

Zahid.Haseeb's picture

@Marianne Logs attached

AttachmentSize
Logs.rar 34.62 KB

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Marianne's picture

Have you cleaned the tape drive yet? 

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

Zahid.Haseeb's picture

I saw the Drive Status but could not see any status message "Need Cleaning" from GUI.

Although I ran the below command:

tpclean -M DRIVE_NAME

=====================================

=====================================

=====================================

I also tried to clean but receive below.

DriveCleaning_0.png

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Marianne's picture

Seems the logs were collected while restore is in progress and files are actually getting restored.

See bottom of tar and bpbrm logs.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

Zahid.Haseeb's picture

Some very little files(in kb size) were restored but some 1GB files are taking an hour and keep going but dont completing the restore

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com

Marianne's picture

Zahid, please look at your opening post.

That issue has been resolved long time ago, right?

Your current problem is with slow restore which is a totally different issue.

Please mark sazz's post as solution and start a new discussion for slow restore speed.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

Zahid.Haseeb's picture

Thanks Sazz for your kind supports and other too :)

Marking your post as solution + thumb for others too :)

Any comment will be appreciated. Mark as Solution if your query is resolved
__________________
Thanks in Advance
Zahid Haseeb

zahidhaseeb.wordpress.com