Video Screencast Help

RMAN backup is aborted with status code 6

Created: 05 May 2013 | 7 comments

 

Dear All,

need urgunt assistance below is the output of RMAN backup intigrted with netbackup 7.5

Enviroment info --master solaris 7.5.0.4 /solaris

Media server (Which is backed up )  7.5.0.4 / AIX

 

Below is the error in RMAN output script

 

RMAN-03009: failure of backup command on ch01 channel at 05/05/2013 21:45:56
ORA-19506: failed to create sequential file, name="bk_97917_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch01 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch10 channel at 05/05/2013 21:45:57
ORA-19506: failed to create sequential file, name="bk_97926_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch10 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch03 channel at 05/05/2013 21:45:58
ORA-19506: failed to create sequential file, name="bk_97919_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch03 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch05 channel at 05/05/2013 21:45:58
ORA-19506: failed to create sequential file, name="bk_97921_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch05 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch08 channel at 05/05/2013 21:45:58
ORA-19506: failed to create sequential file, name="bk_97924_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch08 disabled, job failed on it will be run on another channel

 

######################################3

 

Policy details are attached in txt pad

FYI ..daily policy happened yesterday properly.

Expecting prompt assistance .

 

Thanks

 

 

Operating Systems:

Comments 7 CommentsJump to latest comment

Raaavan's picture

Below is the job details form activity monitor

 

05/05/2013 20:37:56 - Info nbjm (pid=27784) starting backup job (jobid=105868) for client HBCampDBnew, policy DAKC_W_HBCampDBnew, schedule Default-Application-Backup
05/05/2013 20:37:56 - Info nbjm (pid=27784) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=105868, request id:{90E23C26-B595-11E2-8EF7-002128FA3172})
05/05/2013 20:37:56 - requesting resource HBCampDBnew-hcart2-robot-tld-2
05/05/2013 20:37:56 - requesting resource dakcmstnetbkp.NBU_CLIENT.MAXJOBS.HBCampDBnew
05/05/2013 20:37:56 - requesting resource dakcmstnetbkp.NBU_POLICY.MAXJOBS.DAKC_W_HBCampDBnew
05/05/2013 20:39:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:41:31 - awaiting resource HBCampDBnew-hcart2-robot-tld-2. Waiting for resources.
          Reason: Drives are in use, Media server: HBCampDBnew,
          Robot Type(Number): TLD(2), Media ID: N/A, Drive Name: N/A,
          Volume Pool: DAKC_weekly_pool, Storage Unit: HBCampDBnew-hcart2-robot-tld-2, Drive Scan Host: N/A,
          Disk Pool: N/A, Disk Volume: N/A
05/05/2013 20:41:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:43:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:45:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:47:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:49:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:51:35 - Waiting for scan drive stop Drive009, Media server: HBCampDBnew
05/05/2013 20:51:35 - granted resource  dakcmstnetbkp.NBU_CLIENT.MAXJOBS.HBCampDBnew
05/05/2013 20:51:35 - granted resource  dakcmstnetbkp.NBU_POLICY.MAXJOBS.DAKC_W_HBCampDBnew
05/05/2013 20:51:35 - granted resource  DD0009
05/05/2013 20:51:35 - granted resource  Drive009
05/05/2013 20:51:35 - granted resource  HBCampDBnew-hcart2-robot-tld-2
05/05/2013 20:51:39 - estimated 0 kbytes needed
05/05/2013 20:51:39 - Info nbjm (pid=27784) started backup (backupid=HBCampDBnew_1367767299) job for client HBCampDBnew, policy DAKC_W_HBCampDBnew, schedule Default-Application-Backup on storage unit HBCampDBnew-hcart2-robot-tld-2
05/05/2013 20:51:42 - connecting
05/05/2013 20:51:47 - connected; connect time: 0:00:00
05/05/2013 20:55:51 - Info bpbrm (pid=47383014) HBCampDBnew is the host to backup data from
05/05/2013 20:55:51 - Info bpbrm (pid=47383014) telling media manager to start backup on client
05/05/2013 20:55:51 - Info bptm (pid=55574798) using 262144 data buffer size
05/05/2013 20:55:51 - Info bptm (pid=55574798) using 64 data buffers
05/05/2013 20:55:51 - Info bpbrm (pid=47383014) spawning a brm child process
05/05/2013 20:55:51 - Info bpbrm (pid=47383014) child pid: 17432974
05/05/2013 20:55:52 - Info bpbrm (pid=47383014) sending bpsched msg: CONNECTING TO CLIENT FOR HBCampDBnew_1367767299
05/05/2013 20:55:52 - Info bpbrm (pid=47383014) listening for client connection
05/05/2013 20:55:56 - Info bpbrm (pid=47383014) INF - Client read timeout = 3000
05/05/2013 20:55:57 - Info bpbrm (pid=47383014) accepted connection from client
05/05/2013 21:41:49 - end writing
05/05/2013 21:45:58 - Error bpbrm (pid=17432974) client HBCampDBnew EXIT STATUS = 6: the backup failed to back up the requested files
05/05/2013 21:45:58 - Info bpbkar (pid=0) done. status: 6
05/05/2013 21:45:58 - Info bpbrm (pid=47383014) sending message to media manager: STOP BACKUP HBCampDBnew_1367767299
05/05/2013 21:45:58 - Info bpbrm (pid=47383014) media manager for backup id HBCampDBnew_1367767299 exited with status 150: termination requested by administrator
the backup failed to back up the requested files  (6)

Nagalla's picture

 VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the server

it looks like communication broken between the client to Master server.

though you might see the good FS backups  , you will see the communcation issue in DB backups as DB backups requred the commnication back to master.

what is the output of 

bpcltncmd -pn

bpcltncmd -self  command from client

and also check the logs of bpclent and bphdb

 

Marianne's picture

I think Nagalla meant dbclient log.

If this folder does not exist on the client, please create it under /usr/openv/netbackup/logs followed by 'chmod 777 dbclient'.

The log that we need on the master is bprd. If this log folder does not exist, please create it and restart NBU.

Please check on the client that the master server is listed as first SERVER entry in bp.conf.
Check that /etc/hosts entry for the master is correct.
One of the above two entries may have been changed or removed.

bpclntcmd -pn will tell us if client can connect to bprd on the master.
bprd log on the master should contain record of this connection attempt.

bpclntcmd -self will tell us if client name corresponds with client name in the policy.

 

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

Raaavan's picture

./bpclntcmd -pn

./bptestbpcd -client hostname

were responding properly

“avrd” process was in hang status & become defunct which was not allowing net backup services to start & stop gracefully

So killed that & bounce back NBU services which solved the issue

 

I suspect “Error received from media manager layer, error text:” may be stands for that

 

Thanks

Raaavan's picture

Thanks bot of you for the prompt responce

Do we have any tech note which will brief me about errors occurred in RMAN backup integrated with netbackup

Because first time I came across such error & want to investigate more about such issue

Raaavan's picture

Dear all,

 

again RMAN backup aborted with below error . & stause code 6

 

ORA-27028: skgfqcre: sbtbackup returned error ORA-19511: Error received from media manager layer, error text: Server does not have a valid Oracle Agent license channel ch08 disabled, job failed on it will be run on another channel RMAN-03009: failure of backup command on ch09 channel at 05/08/2013 02:09:43 ORA-19506: failed to create sequential file, name="bk_98551_1_814846180", parms="" ORA-27028: skgfqcre: sbtbackup returned error ORA-19511: Error received from media manager layer, error text: Server does not have a valid Oracle Agent license channel ch09 disabled, job failed on it will be run on another channel RMAN-03009: failure of backup command on ch10 channel at 05/08/2013 02:09:43 ORA-19506: failed to create sequential file, name="bk_98552_1_814846180", parms="" ORA-27028: skgfqcre: sbtbackup returned error ORA-19511: Error received from media manager layer, error text: Server does not have a valid Oracle Agent license channel ch10 disabled, job failed on it will be run on another channel released channel: ch00 released channel: ch01 released channel: ch02 released channel: ch03 released channel: ch04 released channel: ch05 released channel: ch06 released channel: ch07 released channel: ch08 released channel: ch09 released channel: ch10 released channel: ch11 RMAN-00571: =========================================================== RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS =============== RMAN-00571: =========================================================== RMAN-03009: failure of backup command on ch11 channel at 05/08/2013 02:09:44 ORA-19506: failed to create sequential file, name="bk_98553_1_814846181", parms="" ORA-27028: skgfqcre: sbtbackup returned error ORA-19511: Error received from media manager layer, error text: Server does not have a valid Oracle Agent license RMAN> RMAN> Recovery Manager complete. Script /usr/openv/netbackup/ext/db_ext/oracle/samples/rman/rman_incremental_bkp_sundays.sh ==== ended in error on Wed May 8 02:09:47 IST 2013 ====

Yogi_OraDBA's picture

 

Please, check the output of commands

cd /usr/openv/netbackup/bin

 

# ./bpclntcmd -pn
expecting response from server <host name of netbackup server>
<client hostname>  <client hostname> <ip address> .. 
 
# ./bpclntcmd -self
yp_get_default_domain failed: (6) internal yp server or client error
NIS does not seem to be running: (1) args to yp function are bad
gethostname() returned: <hostname of client>
host  <hostname of client>:  <hostname of client> at <host ip of client>
aliases:      <hostname of client>      <hostname of client>    <host ip of client>
 
Check the output of all above commands and verify that hostname of client in the output is same as that you have used in backup policy, also check it is present in /etc/hosts and bp.conf files. If not then edit bp.conf file and change the client hostname entry..
 
After that run the policy it will run successfully...
 
I have have trouble shoot this issue, now my backups are going well..