Video Screencast Help
Search Video Help Close Back
to help
Not able to make it to Vision this year? Get a sampling in the Best of Vision on Demand group.

What is image clean up job in Netbackup?

Updated: 14 Feb 2012 | 23 comments
NIKHIL2346565959's picture
0 0 Votes
Login to vote
This issue has been solved. See solution.

Hi,

 

What is image clean up job in Netbackup?

Can u explain in detail?

Comments

Marianne van den Berg's picture
11
Feb
2012
0 Votes 0
Login to vote

It merely cleans up expired

It merely cleans up expired backup images.

Each backup job has an entry in the images database on the master. Expiration date and time is determined by the retention period in the schedule.

These images are not automatically cleaned out at the very second that they expire. The master server runs regular 'cleanup' jobs to remove expired images from the image catalog. The default is every 12 hours.

This process will also deassign tapes once all images on them have expired.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links

mph999's picture
11
Feb
2012
0 Votes 0
Login to vote

Adding further details to

Adding further details to Marianne excellent answer:

The image cleanup job runs by default, every 12 hours.

It runs these commands:

 

1)  bpimage -cleanup -allclients - image cleanup : Deletes expired images
2)  bpexpdate -deassignempty -force : Expires empty tapes
 
The following cleanup also runs, every 10 minutes, this is NOT seen in Activity Monitor
 
bptm -delete_all_expired : this expires any tapes with EMM image expiration times that have passed.
(when a tape 'expires' it is set to 'expired', this bptm job actualy expires it).
 
Martin
NIKHIL2346565959's picture
12
Feb
2012
0 Votes 0
Login to vote

what if we dont run these?

what if we dont run these?

mph999's picture
12
Feb
2012
0 Votes 0
Login to vote

Hi Puneet, Why is this

Hi Puneet,

Why is this concerning you, providing the cleanup jobs are running correctly, forget about them,  they HAVE to run as they are part of how NetBackup works.

But, to answer your question.

1. When images expire from the catalog they will not be deleted.

2, Tapes will not become expred and abvailable for re-use.

3. In th case of disk storage being used, the fragments will not be deleted from the disks.

The effect, the catalog will not clear down, you will run out of disk (if used) and run out of tapes.

Martin

NIKHIL2346565959's picture
12
Feb
2012
0 Votes 0
Login to vote

WE HAVE slp,so whats image

WE HAVE slp,so whats image cleanup in that?

mph999's picture
12
Feb
2012
0 Votes 0
Login to vote

 nbstserv process is

 

nbstserv process is involved to move images to various states with the EMM database (eg.completed, eligible for deletion etc ..) but, the image cleaup is the same.

You did not answer my question, as to why this is an issue for you ?

Martin

NIKHIL2346565959's picture
12
Feb
2012
0 Votes 0
Login to vote

ok thanks. This is also true

ok thanks.

This is also true that when high water mark is reached,NBU runs image cleanup to delete expired images till low water mark defined?

mph999's picture
13
Feb
2012
0 Votes 0
Login to vote

Yes - that is correct - HWM

Yes - that is correct - HWM will trigger the cleanup of duplicated images (one copy) and will attempt to clear down to the LWM.

If you question has been answered, please mark the post that helped you the most as the solution.

 

Martin

NIKHIL2346565959's picture
13
Feb
2012
0 Votes 0
Login to vote

this haapens with DATA DOMAIN

this haapens with DATA DOMAIN ALSO?

mph999's picture
13
Feb
2012
0 Votes 0
Login to vote

Yes, but it is the

Yes, but it is the communication to the DD device will be via the OST plugin - we are not really involved with that (it is provided by DD) and should 'just work' - so, although a little more complex, from the NBU side, it is the same.

Martin

NIKHIL2346565959's picture
13
Feb
2012
0 Votes 0
Login to vote

what is DD is full?

what is DD is full?

Marianne van den Berg's picture
13
Feb
2012
0 Votes 0
Login to vote

I suppose you meant 'What IF

I suppose you meant 'What IF DD is full'?

NBU will issue cleanup instruction. What actually happens on the DD is out of NBU control.

I believe your initial question has been answered, right?

DD cleanup is REALLY not related to the Image Cleanup Job in Activity Monitor.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links

mph999's picture
13
Feb
2012
0 Votes 0
Login to vote

Why should it be full  - the

Why should it be full  - the image cleanup will take care of it ..

If it is full, either something has gone wrong, or, the DD is not large enough to hold your backups with the retention period you have set.

M

NIKHIL2346565959's picture
13
Feb
2012
0 Votes 0
Login to vote

can u provide me with some DD

can u provide me with some DD commands?

Marianne van den Berg's picture
13
Feb
2012
0 Votes 0
Login to vote

DD commands are contained in

DD commands are contained in DataDomain admin guides and does not form part of any NetBackup documentation.

If you are a registered DD customer, you can download the documentation from their web site. Else, ask your DD reseller.

I believe your question regarding NetBackup Image Cleanup has been answered.

Kindly close this thread by selecting a post that answered your Image Cleanup question and Mark As Solution.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links

mph999's picture
13
Feb
2012
0 Votes 0
Login to vote

You need to start a new

You need to start a new thread for DD issues/ commands.

How image cleanup works has been explained, and was the question for this thread.

Please start a new thread for a new questions, and, mark the post in this thread that helped you the most as the solution.

Also, you need to explain the issue better  (BUT IN A NEW THREAD - thanks)

"can u provide me with some DD commands?"

1)  This is a NetBackup forum, not a DataDomain forum  ...

2)  Do you want DD commands, or, NetBackup commands

3)  What are you trying to achive - there are many many commands ...

 

Martin

NIKHIL2346565959's picture
13
Feb
2012
0 Votes 0
Login to vote

so at end image clean up has

so at end image clean up has nothing to do with DD.

its only for storage unit.?

Marianne van den Berg's picture
13
Feb
2012
0 Votes 0
Login to vote

NBU will simply pass cleanup

NBU will simply pass cleanup instruction to DD via the OST plugin.

What happens on DD side needs to be checked with DD tools.
DD commands/tools do not form part of NBU commands/tools/documentation.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links

NIKHIL2346565959's picture
13
Feb
2012
0 Votes 0
Login to vote

ok.And image clean up in

ok.And image clean up in activity monitoring clear expired images in image catalog(EMM) IE ON DISK AND TAPES?

mph999's picture
13
Feb
2012
0 Votes 0
Login to vote

Yes, Image Cleanup in

Yes, Image Cleanup in Activity Monitor clears up Basic Disk/ Advanced Disk and tape.

Martin

NIKHIL2346565959's picture
13
Feb
2012
0 Votes 0
Login to vote

it cleans from EMM?

it cleans from EMM?

Marianne van den Berg's picture
13
Feb
2012
0 Votes 0
Login to vote

Your question has been

Your question has been answered ten times over!

If you need to understand the different components of NetBackup Catalogs and databases, PLEASE read up about Catalogs in NBU Admin Guide 1.

Look for this topic:

Parts of the NetBackup catalog

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows.
Handy NBU links

mph999's picture
13
Feb
2012
0 Votes 0
Login to vote

Yes, it cleans from EMM

Yes, it cleans from EMM ...

Please explain why you are so concerned about this - NetBackup should be left alone for cleanup - if it goes wrong, we will fix it, it is it working, forget about it.

If you run cleanup commands without understanding exactly what you are doing, you risk data loss.

Apologies for being direct, and I am sure Marianne (one of the most experienced people on this forum) will agree with me - but you need a lot of experience with NBU before playing about with cleaning up the catalog.

If NBU is running correctly, is installed correctly and the backup environment has been designed correctly,it should work fine with no 'cleanup' commands needing to be run manually.

 

Martin