Video Screencast Help
Netting Out NetBackup

Slow mapping with flashbackup? Look at your exclude file list !

Created: 17 Apr 2009 • Updated: 22 Jan 2013 • 19 comments
Pravs's picture
+11 11 Votes
Login to vote

Do you seldom encounter slow mapping with flashbackup?

Look at your exclude file list. Do you really want to exclude 50% of the drive? When performing Flashbackup, setting up an exclude list will decrease the performance of the VxMS mapping. The exclude list processing requires a lot of resource and time, so excluding too much data will slow down performance.for an example if you are backing up a 1TB drive using FBU, mapping should take around 35-40 minutes in usual scenario but if you have a exclude list of say about half of TB, It may take a whooping 7-8 hours in just mapping.

Finding the fish in a large pond with millions of fish and mark it not to be fished. Not a great Idea and it need too much work to do. My advice on this, not to have a large exclude list while using FBU. your Back-ups may not work as fast as it use to.

Praveen Gupta

Comments 19 CommentsJump to latest comment

Pravs's picture

Watch out for next blog to improve further on your Flashbackup performance.

Thanks.
Praveen Gupta

Just one person saying to me, “You’ve made my day!” makes my day.

+6
Login to vote
Peter Jakobs's picture

Hi Praveen,

Very interesting point about the exclude list, but I do have a question.

I'm using exclude lists with my Flashbackup-Windows policies.

Files in the exclude list are not available for restores of course. But the size of the backup is always the size of the raw device.
Does an exclude list save space on my tapes? If not it would be better to not use any exclude list at all, or am I missing something?

Peter

+4
Login to vote
Pravs's picture

You are right Peter. FlashBackup is just a raw device backup and you won't save any space on tape with exclude list.

in some cases you still want to exclude some files, so that it won't appear in BAR GUI to restore and no one can restore them.

Praveen

Just one person saying to me, “You’ve made my day!” makes my day.

+5
Login to vote
Peter Jakobs's picture

Hi Praveen

Not using an exclude list for the flashbackup policy, I get an error in the jobs status like:

6/28/2009 8:56:02 PM - Error bpbrm(pid=3324) from client gefile01: ERR - Unable to add to excluded file list error = 4183
6/28/2009 8:56:03 PM - Error bpbrm(pid=3324) from client gefile01: ERR - Unable to add to excluded file list error = 4098
6/28/2009 8:56:04 PM - Error bpbrm(pid=3324) from client gefile01: ERR - Unable to add to excluded file list error = 4098
6/28/2009 8:56:05 PM - Error bpbrm(pid=3324) from client gefile01: ERR - Unable to add to excluded file list error = 4098

After that, the backup runs fine.
Any idea's what these errors are? and how to get ridth of them?
running 6.5.4 on Solaris but the windows clients give me these errors.

Peter

+4
Login to vote
Pravs's picture

Hi Peter,

If you are aware then there is a default exclude list. for example files like pagefile.sys etc. need not to be backed up.
starting with 6.5.4 there is a slight code change in lower level component of the code and the actual errors are being passed to job status. there are specific to windows only because this errors are in actual windows last error. (File doesn't exists, in Use, can't be opened etc.)

Symantec has fixed this issue in a form of engineering emergency binary for this in 6.5.4. You can open a support case to get rid of these errors and to get the fix for this in 6.5.4.

feel free to PM me if you need to talk to me.

Thanks,
Praveen

Just one person saying to me, “You’ve made my day!” makes my day.

+5
Login to vote
Peter Jakobs's picture

Hi Praveen

Thanks for the respons, I opened a call, but it's not so simple... because I already received a new bpbkar32 for another issue:
STATUS: The problem described in ET1680520 is not fixed with newer EEB1705939 so we need to find out if EEB1705939 were cumulative

Peter

+1
Login to vote
Pravs's picture

Peter,

sorry for coming late. I stoped my all notifications. ok. Let me know the Titan case No. for your call. EEB 1705939 is not cumulative. You will need a new EEB that will combine both fixes in one.

Praveen

Just one person saying to me, “You’ve made my day!” makes my day.

+5
Login to vote
Nikky's picture

Thanks for explaining this to us. Neat idea.

+3
Login to vote
leejw's picture

Hi All.

Just wanted to know what I can do to fix the issue as well..

Getting the following logged repeatedly in VCB jobs:

ERR - Unable to add to excluded file list error = 4098

Have just upgraded to 6.5.4 on Master and VCB Proxy server.  Do I need to apply a further hotfix to address this issue.  Concerned that my file incrementals may not be complete

thanks

Lee

+1
Login to vote
Pravs's picture

Hi Lee,

you can ask support to get fix for ET 1680520. you need to apply a hot fix for this. don't worry, this error won't cause your incremental to fail.

Thanks,
Praveen

Just one person saying to me, “You’ve made my day!” makes my day.

+4
Login to vote
leejw's picture

Thanks fot the quick response. :-)

+1
Login to vote
PrafulPatel's picture

I am also seeing this error with my flashbackup ? do I need different binary?

+1
Login to vote
Pravs's picture

No, the same binary will be used for FBU or VMware backups.

Just one person saying to me, “You’ve made my day!” makes my day.

+2
Login to vote
Ron Cohn's picture

I am getting the same error as Peter, however my question is this - with this error, I am losing data on my Flashbackups?  Or is the EEB just to remove the generated message.  My issue with EEB's is that they may induce other errors. 

Ron Cohn
"I maybe lost, but I am making good time..."

Environment: NBU 7.6.0.2 for Windows
Write to EMC DD4200 -> Vault to ADIC i500

0
Login to vote
Pravs's picture

Ron,
EEB is just to remove these messages. You are not loosing out any functionality with out the EEB.

Just one person saying to me, “You’ve made my day!” makes my day.

0
Login to vote
Ron Cohn's picture

Pravs,

Since we have a "<2>" message level, this would be more informational than anything else?  The other reason for asking is that I do not define Exclude List on my Flashbackups - so I just want to make sure if I have to do a restore because of a DR, everything should be properly laid back down.  Sorry for the paranoia - it has been a long 2 weeks of software upgrades (not just NBU)

4:26:30.605 PM: [968.4344] <2> tar_base::V_vTarMsgW: ERR - Unable to add to excluded file list error = 4183
4:26:30.605 PM: [968.4344] <2> tar_base::V_vTarMsgW: ERR - Unable to add to excluded file list error = 4098
4:26:30.605 PM: [968.4344] <2> tar_base::V_vTarMsgW: ERR - Unable to add to excluded file list error = 4098

Ron Cohn
"I maybe lost, but I am making good time..."

Environment: NBU 7.6.0.2 for Windows
Write to EMC DD4200 -> Vault to ADIC i500

0
Login to vote
Pravs's picture

Ron, My comments inline.

Since we have a "<2>" message level, this would be more informational than anything else?
<Pravs> : you are right. It's more of informational message. you  can safely ignore this message.

The other reason for asking is that I do not define Exclude List on my Flashbackups - so I just want to make sure if I have to do a restore because of a DR, everything should be properly laid back down.  Sorry for the paranoia - it has been a long 2 weeks of software upgrades (not just NBU)

<Pravs> :  FlashBackup doesn't backup system state files. You are pretty good if you wanted to restore all data excluding system states. If you wanted to a full DR (full m/c restore) you do have better option available with NBU.

Just one person saying to me, “You’ve made my day!” makes my day.

0
Login to vote
Ron Cohn's picture

You made the following statement:

<Pravs> :  FlashBackup doesn't backup system state files. You are pretty good if you wanted to restore all data excluding system states. If you wanted to a full DR (full m/c restore) you do have better option available with NBU.


The Flashbackup's I do are only on data drives, not O/S or boot.  But out of curiousity, what is the better option available with NBU?

Ron Cohn
"I maybe lost, but I am making good time..."

Environment: NBU 7.6.0.2 for Windows
Write to EMC DD4200 -> Vault to ADIC i500

0
Login to vote