Video Screencast Help

sql backup failing

Created: 20 Jun 2013 • Updated: 24 Jun 2013 | 17 comments
This issue has been solved. See solution.
When i m firing an SQL backup,, my backup fails witht the following message.
Aslo in client the dbbackex.exe gets hanged.
 
 
6/20/2013 1:14:14 PM - Info dbclient(pid=16212) INF - Created VDI object for SQL Server instance <RILHPBSERV111>. Connection timeout is <300> seconds.
6/20/2013 1:14:28 PM - Info dbclient(pid=16212) ERR - Error in VxBSACreateObject: 3.       
6/20/2013 1:14:28 PM - Info dbclient(pid=16212)     CONTINUATION: - System detected error, operation aborted.  
6/20/2013 1:14:28 PM - Info dbclient(pid=16212) ERR - Internal error. See the dbclient log for more information.  
6/20/2013 1:14:28 PM - Info dbclient(pid=16212) ERR - Error in CPipeServer::CreateAgentMetadata: 6.       
6/20/2013 1:14:28 PM - Info dbclient(pid=16212)     CONTINUATION: - The system cannot find the file specified.
6/20/2013 1:14:28 PM - Info dbclient(pid=16212) ERR - Error in VxBSACreateObject: 6.       
6/20/2013 1:14:28 PM - Info dbclient(pid=16212)     CONTINUATION: - The handle used to associate this call with a previous VxBSAInit() call is invalid.
6/20/2013 1:35:43 PM - Info bphdb(pid=13940) done. status: 150: termination requested by administrator  
 
 
Thanks
AVC 
Operating Systems:

Comments 17 CommentsJump to latest comment

inn_kam's picture

A comprehensive list of solutions for the most common NetBackup for Microsoft SQL Server database agent backup and restore issues

Article:TECH74475  |  Created: 2009-01-15  |  Updated: 2011-04-22  |  Article URL http://www.symantec.com/docs/TECH74475

 

 

Marianne's picture

Have you enabled dbclient log on the SQL server?

We will need the full dbclient log as well as the progress log:

<install_path>\veritas\netbackup\logs\dbclient
<install_path>\veritas\netbackup\logs\user_ops\mssql\logs
 
SQL logs may be useful as well:
ERRORLOG and vdi.log in <install_path>\mssql\log directory
 

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

Mark_Solutions's picture

Any sql failures automatically get logged to \netbackup\logs\mssql_backup_failures\ so those logs should be there to look at

It is always worth checking the system and application event logs on the client too as VSS can play a part here and depending on its O/S there are some VSS rollup packages that resolve a lot of VDI errors.

Whilst on the client make sure that the netbackup processes (bpcd, vnetd, bpbar32, bpfis and dbbackex) are all excluded from anti-virus scanning.

Post the logs and tell us the Master, Media and Client versions of NetBackup so that we can assist further

Authorised Symantec Consultant

Don't forget to "Mark as Solution" if someones advice has solved your issue - and please bring back the Thumbs Up!!.

Arun VC's picture

Sorry for the delay..

My current version was 7.5

i was actually looking for a solution online... and i found solution that upgrading to 7.5.0.5 can solve the issues. so i upgraded my media/master server to 7.5.0.5 and also my sql client to 7.5.0.5..

before the upgrade there used to run 2 jobs when i run the sql policy, after upgrade also i see 2 jobs running.

 on my activity monitor i see the following..

when i run a sql policy, 2 jobs run...

FIRST JOB ACTIVITY MONITOR LOG SHOWS

====================

9:03:32 PM - Info dbclient(pid=10044) INF - backup database "IndiaBOMTeamHR" to VIRTUAL_DEVICE='VNBU0-10044-3496-1371742411' with  stats = 10, blocksize = 65536, maxtransfersize = 4194304, buffercount = 2
6/20/2013 9:03:32 PM - Info dbclient(pid=10044) INF - Number of stripes: 1, Number of buffers per stripe 2. 
6/20/2013 9:03:32 PM - Info dbclient(pid=10044) INF - Created VDI object for SQL Server instance <RILHPBSERV111>. Connection timeout is <300> seconds.
6/20/2013 9:03:45 PM - Info dbclient(pid=10044) ERR - Error in VxBSACreateObject: 3.       
6/20/2013 9:03:45 PM - Info dbclient(pid=10044)     CONTINUATION: - System detected error, operation aborted.  
6/20/2013 9:03:45 PM - Info dbclient(pid=10044) ERR - Error in GetCommand: 0x80770004.       
6/20/2013 9:03:45 PM - Info dbclient(pid=10044)     CONTINUATION: - An abort request is preventing anything except termination actions.
6/20/2013 9:03:49 PM - Info dbclient(pid=10044) ERR - Error in VDS->Close: 0x80770004.       
6/20/2013 9:03:49 PM - Info dbclient(pid=10044)     CONTINUATION: - An abort request is preventing anything except termination actions.
6/20/2013 9:03:49 PM - Info dbclient(pid=10044) INF - OPERATION #1 of batch C:\Program Files\Veritas\NetBackup\DbExt\MsSql\IndiaBOMTeamHR_After_upgrade.bch FAILED with STATUS 1 (0 is normal). Elapsed time = 19(19) seconds.
6/20/2013 9:03:51 PM - Info dbclient(pid=10044) INF - Results of executing <C:\Program Files\Veritas\NetBackup\DbExt\MsSql\IndiaBOMTeamHR_After_upgrade.bch>:      
6/20/2013 9:03:51 PM - Info dbclient(pid=10044) <0> operations succeeded. <1> operations failed.       
6/20/2013 9:03:51 PM - Info dbclient(pid=10044) INF - The following object(s) were not backed up successfully.   
6/20/2013 9:03:51 PM - Info dbclient(pid=10044) INF - IndiaBOMTeamHR          
6/20/2013 9:03:51 PM - Error bpbrm(pid=3992) from client XXXXXXXX111: ERR - command failed: none of the requested files were backed up (2)
6/20/2013 9:03:51 PM - Error bpbrm(pid=3992) from client XXXXXXXXX111: ERR - bphdb exit status = 2: none of the requested files were backed up
6/20/2013 9:03:53 PM - Info bphdb(pid=9344) done. status: 2: none of the requested files were backed up  
6/20/2013 9:03:53 PM - end writing
none of the requested files were backed up(2)
 
===============================================================
 
SECOND JOB ACTIVITY MONITOR LOG SHOWS
 
6/20/2013 9:03:40 PM - Info nbjm(pid=7072) starting backup job (jobid=81) for client RILHPBSERV111, policy RILHPBSERV111_FULL_DB, schedule Default-Application-Backup  
6/20/2013 9:03:40 PM - Info nbjm(pid=7072) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=81, request id:{0F207FEC-0DBB-4132-9E64-38A83D6399AE})  
6/20/2013 9:03:40 PM - requesting resource rilhpbserv115-hcart2-robot-tld-0
6/20/2013 9:03:40 PM - requesting resource rilhpbserv115.randstad.in.NBU_CLIENT.MAXJOBS.XXXXXXXXX111
6/20/2013 9:03:40 PM - requesting resource rilhpbserv115.randstad.in.NBU_POLICY.MAXJOBS.XXXXXXXXXXX111_FULL_DB
6/20/2013 9:03:40 PM - Error nbjm(pid=7072) NBU status: 96, EMM status: No media is available    
unable to allocate new media for backup, storage unit has none available(96)

=================================================================

tHANKS 

AVC

 

 

Thanks

AVC

Arun VC's picture

ATTACHED MSSQL BACKUP FAILURE LOG

AttachmentSize
SQL BACKUP FAILURE.txt 465 bytes

 

 

Thanks

AVC

inn_kam's picture

showing error

 

EMM status: No media is available    
unable to allocate new media for backup, storage unit has none available(96)
 
So its Media problem 
kindly check

1) Is your scratch pool actually defined as a scratch pool (not just by name)? (vmpool -list_scratch)
2) Are the tapes in the scratch pool of the correct density for the backup in question? (eg HCART/HCART3 or whatever)
3) Are the tapes in the scratch pool available (not frozen, suspended or physically expired)? (nbemmcmd -listmedia  -mediaid <media_id> )

Arun VC's picture

For the sql policy i have created a test_pool and it has a media in it.

when i fire other file system backups to this tes_pool it works well..

No i have not defined a scratch pool

 

 

Thanks

AVC

Arun VC's picture

one more doubt...

does 2 jobs run in activity monitor when i run a sql backup policy.

 

 

Thanks

AVC

Mark_Solutions's picture

For SQL backup you get a parent job which calls the script on the SQL client

When that runs it does "user" backups, one for each database - so you will get a lot of jobs depending on the number of databases involved

The "user" backup uses the Default-Application schedule so make sure that you dont have that set to override the storage unit or tape pool

Please show us the .bch file from the client and also the output of

bppllist sqlpolicyname -U

Thanks

Authorised Symantec Consultant

Don't forget to "Mark as Solution" if someones advice has solved your issue - and please bring back the Thumbs Up!!.

Arun VC's picture
bppllist <policy name> -U
 
------------------------------------------------------------
 
Policy Name:       rilhpbserv111_full_db
 
  Policy Type:         MS-SQL-Server
  Active:              yes
  Effective date:      06/20/2013 12:17:01
  Mult. Data Streams:  no
  Client Encrypt:      no
  Checkpoint:          no
  Policy Priority:     0
  Max Jobs/Policy:     Unlimited
  Disaster Recovery:   0
  Collect BMR info:    no
  Residence:           rilhpbserv115-hcart2-robot-tld-0
  Volume Pool:         test_pool
  Server Group:        *ANY*
  Keyword:             (none specified)
  Data Classification:       -
  Residence is Storage Lifecycle Policy:    no
  Application Discovery:      no
  Discovery Lifetime:      28800 seconds
ASC Application and attributes: (none defined)
 
  Granular Restore Info:  no
  Ignore Client Direct:  no
Enable Metadata Indexing:  no
Index server name:  NULL
  Use Accelerator:  no
  HW/OS/Client:  Windows-x64   Windows2008   RILHPBSERV111
 
  Include:  C:\Program Files\Veritas\NetBackup\DbExt\MsSql\IndiaBOMTeamHR_After_upgrade.bch
 
  Schedule:              RILHPBSERV111
    Type:                Automatic Backup
    Frequency:           every 7 days
    Synthetic:           0
    Checksum Change Detection: 0
    PFI Recovery:        0
    Retention Level:     3 (1 month)
    Residence is Storage Lifecycle Policy:         0
    Schedule indexing:     0
    Daily Windows:
 
  Schedule:              Default-Application-Backup
    Type:                Application Backup
    Maximum MPX:         1
    Synthetic:           0
    Checksum Change Detection: 0
    PFI Recovery:        0
    Retention Level:     3 (1 month)
    Number Copies:       1
    Fail on Error:       0
    Residence:           (specific storage unit not required)
    Volume Pool:         (same as policy volume pool)
    Server Group:        (same as specified for policy)
    Residence is Storage Lifecycle Policy:         0
    Schedule indexing:     0
    Daily Windows:
          Sunday     00:00:00  -->  Sunday     24:00:00
          Monday     00:00:00  -->  Monday     24:00:00
          Tuesday    00:00:00  -->  Tuesday    24:00:00
          Wednesday  00:00:00  -->  Wednesday  24:00:00
          Thursday   00:00:00  -->  Thursday   24:00:00
          Friday     00:00:00  -->  Friday     24:00:00
          Saturday   00:00:00  -->  Saturday   24:00:00
 
=======================================================================
 
 
BCH FILE
 
===============================
 
OPERATION BACKUP
DATABASE "IndiaBOMTeamHR"
SQLHOST "RILHPBSERV111"
NBSERVER "RILHPBSERV115.DOMAIN.IN"
MAXTRANSFERSIZE 6
BLOCKSIZE 7
NUMBUFS 2
ENDOPER TRUE
 

 

 

 

Thanks

AVC

Mark_Solutions's picture

That all looks fine - so you do need to look at the test_pool and ensure that it has tapes that are of the correct density, no frozen or suspended and that are actually in the library defined by rilhpbserv115-hcart2-robot-tld-0

Authorised Symantec Consultant

Don't forget to "Mark as Solution" if someones advice has solved your issue - and please bring back the Thumbs Up!!.

Arun VC's picture

tapes are there in the test_pool.

When i fire a file system backup from another client to the test_pool backup work fine.

 

i have aslo tried fring file system backup from the sql client to the test_pool. Its work fine 

 

 

Thanks

AVC

Mark_Solutions's picture

Are the tapes in the test pool already assigned? Your policy uses retention level 3 (1 month) so you need tapes available that can use that retention period

It is possible you have a corrupt policy so you could try creating a new one from scratch to see if it then works

#edit# or you have changed the tape pool since you created the policy but it has not been picked up by emm / jm

Try running nbpemreq -updatepolicies

Authorised Symantec Consultant

Don't forget to "Mark as Solution" if someones advice has solved your issue - and please bring back the Thumbs Up!!.

SOLUTION
Arun VC's picture

The test_pool is having only one tape and its assigned to 4 policies. But none are scheduled. All policies are run manually to take the backup.

I have deleted and recreated the policies also. this did not solve the issue..

===============================================================

Then i deleted all the images on the media (media in test_pool) using the bpexpdate command. 

After that i once again recreated the bch file for the SQL DB and made changes in the SQL policy to point to the new bch file and re run the policy....

 

To my suprise its completed successfully....

I have checked running other SQL DB backups also from the same server.. it works fine...

=====================================================

Initially it was like, file system backups to the test_pool was fine, issue was only with SQL backups failing with 96 error.

 

Now after deleting all media images using..bpexpdate, both SQL and file sytem backup to test_pool are fine....

 

CAN ANYONE PUT SOME LIGHT ON THIS... WHY THIS HAPPENED.....

ANY WAY ISSUE IS RESOLVED.........

 

 

Thanks

AVC

Arun VC's picture

Thank you all for ur valuable inputs.....

 

AVC

 

 

Thanks

AVC

Marianne's picture

Please select the post that helped you most and Mark as Solution.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links