Video Screencast Help

Moving/copying images from LTO3 tapes to LTO5 tapes

Created: 29 Apr 2014 • Updated: 16 May 2014 | 26 comments
This issue has been solved. See solution.

I have ~650 LTO3 tapes at each site (2 sites). I have to move the LTO3 images at each site to LTO5 tapes in the same site.

Each site currently has an IBM TS3500 tape library, with 2 x LTO3 drives and 4 x LTO5 drives.

What would be the most efficient way to accomplish this ?

Operating Systems:

Comments 26 CommentsJump to latest comment

mph999's picture

Just duplicate them ...

If you use a different volume pool unique to the LTO5 tapes, then you will definately copy to the correct drives.

Regards,  Martin
 
Setting Logs in NetBackup:
http://www.symantec.com/docs/TECH75805
 
revarooo's picture

Set-up a separate storage unit for the LTO5 and then duplicate the images using

bpduplicate -id <media_id> -dstunit <new LTO5 storage unit>

bpduplicate options are here:

http://www.symantec.com/docs/HOWTO43654

 
 
perez_cmz's picture

A couple of questions

- Do I have to specify a "copy" for the -dstunit ? I want all the image copies moved/copied to the new media.

- Is there any way to have this command reference a list of media ids, instead of doing one at a time ?

mph999's picture

Duh ...  thanks Revaroo, for gently pointing out that the STU dictates the drives used, not the vol pool  - brain fade in my old age ...

Regards,  Martin
 
Setting Logs in NetBackup:
http://www.symantec.com/docs/TECH75805
 
Marianne's picture

- Do I have to specify a "copy" for the -dstunit ? I want all the image copies moved/copied to the new media.

No need to specify as copy number 1 is the default.

cn copy_number|-primary

Determines the copy number to duplicate. Valid values are 1 through 10. The default is 1.

-primary means to search or duplicate the primary copy.

- Is there any way to have this command reference a list of media ids, instead of doing one at a time ?

The bpduplicate command can only take a list of image numbers in a 'BID'-file:

-Bidfile file_name

file_name specifies a file that contains a list of backup IDs to be duplicated. List one backup ID per line in the file. If this parameter is specified, other selection criteria are ignored.

 You can add all media-id's in a text file and use a 'for' loop in a script.

PS: Why not keep backups on the LTO3 tapes?

When you need to restore, simply change the density of one LTO5 drive to match density of LTO3 media and restore.
Change drive density back once restore is done.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

perez_cmz's picture

- Does this command look right ?

bpduplicate -id <media_id> -dstunit <destination_storage_unit_label> -cn 1 | -primary

- Do I need to specify a new retention level for the duplicated image, or will it retain that of the original image ?

perez_cmz's picture

We're moving away from LTO3 tapes, moving everything to LTO5.

Marianne's picture

-cn 1 | -primary

You either specify -cn <number> or -primary, not both.

If the LTO3 tapes contain the only backup copy, there is no need for either of these parameters.

If you do not specify a new retention level, it will keep original image retention.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

perez_cmz's picture

So I ran : bpduplicate -id 15741 -dstunit US_NYK_MS1_PTL17_LTO5 -primary using several different LTO3 media id's, but received the following message in all the failed jobs.

04/30/2014 11:08:48 - begin Duplicate
04/30/2014 11:09:12 - end Duplicate; elapsed time 0:00:24
found no images or media matching the selection criteria  (190)

Will Restore's picture

be sure to provide date range ...

-e date, -s date

Specifies the end (-e) or start (-s) of the range of dates and times that include all backups to duplicate. The default end date is the current date and time. The default start time is 24 hours before the current date and time.

Will Restore -- where there is a Will there is a way

RonCaplinger's picture

That five digit number is not a Backup ID.  A backup ID uses a format of <servername>_1234567890.  It's the Image name, the same as what you see in the Catalog.

If you have more than one image to duplicate, you have to use a "bidfile", a list of the backup images you want to duplicate.

Will Restore's picture

-id <mediaid>  

is valid option, presuming there are valid images on the tape

try this command to check:

bpimmedia -mediaid <media_id>

hmm, 15741 does seems to be a char short; barcodes are normally six chars

Will Restore -- where there is a Will there is a way

RonCaplinger's picture

True!  I think this is the second time I've mistaken -id for -backupid.  Ignore me.  I need a vacation.  :)

Will Restore's picture

I just got back from one & need another soon smiley

Will Restore -- where there is a Will there is a way

perez_cmz's picture

The media id was actually 015741. When I ran bpimmedia -mediaid 015741 it returned several backup id's of images on the tape.

When I tried running bpduplicate again to both of the storage units at this site, I received the following.

[root@sv144889 ~]# bpduplicate -id 015741 -dstunit US_NYK_MS2_PTL17_LTO5
Duplicate started Thu 01 May 2014 08:38:49 PM CEST
Activity monitor job id = 239954565
INF - found no images or media matching the selection criteria

[root@sv144889 ~]# bpduplicate -id 015741 -dstunit US_NYK_MS1_PTL17_LTO5
Duplicate started Thu 01 May 2014 08:40:03 PM CEST
Activity monitor job id = 239954566
INF - found no images or media matching the selection criteria

RonCaplinger's picture

You need to follow the post from "wr" above: add the start and end parameters to the command so that images that were written within that timeframe will be included in the search for images to duplicate.  Otherwise it seems to only look for images written in the past 24 hours.

perez_cmz's picture

Same result after adding start and end dates.

[root@sv144889 ~]# bpduplicate -id 015741 -dstunit US_NYK_MS1_PTL17_LTO5 -s 04/01/13 -e 05/02/14
Duplicate started Fri 02 May 2014 01:31:32 PM CEST
Activity monitor job id = 239958737
INF - found no images or media matching the selection criteria

Marianne's picture

What were the dates seen in bpimmedia output?

It will also help if you show us output of 'bpmedialist -m 015741'.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

perez_cmz's picture

[root@sv144889 ~]# bpimmedia -mediaid 015741
IMAGE netbpny2p03.zit.commerzbank.com 8 netbpny2p03.zit.commerzbank.com_1365415088 US_STI_ORACLE_DEV_PEST 0 EOM_25Y 0 10 605 2147483646 0 0 0 0
FRAG 4 4 244590304 0 2 14 1 015741 mediany1p01.zit.commerzbank.com 65536 2 1365607398 3 0 *NULL* 2147483646 0 12 1 *NULL* 0
IMAGE netbpny2p03.zit.commerzbank.com 8 netbpny2p03.zit.commerzbank.com_1365409080 US_STI_ORACLE_DEV_ONYD 0 EOM_25Y 0 10 5019 2147483646 0 0 0 0
FRAG 4 1 1048575040 0 2 14 5 015741 mediany1p01.zit.commerzbank.com 65536 3821737 1365607398 1 0 *NULL* 2147483646 0 12 1 *NULL* 0
FRAG 4 2 138644544 0 2 14 6 015741 mediany1p01.zit.commerzbank.com 65536 20205724 1365607398 1 0 *NULL* 2147483646 0 12 1 *NULL* 0
IMAGE netbpny2p04.zit.commerzbank.com 8 netbpny2p04.zit.commerzbank.com_1365772348 US_STI_ORACLE_DEV_INYD 0 EOM_25Y 0 10 1 2147483646 0 0 0 0
FRAG 4 1 32 0 2 14 4 015741 mediany1p01.zit.commerzbank.com 65536 3821734 1365607398 3 0 *NULL* 2147483646 0 12 1 *NULL* 0
IMAGE netbpny2p04.zit.commerzbank.com 8 netbpny2p04.zit.commerzbank.com_1365767357 US_STI_ORACLE_DEV_BNYD 0 EOM_25Y 0 10 3 2147483646 0 0 0 0
FRAG 4 1 32 0 2 14 3 015741 mediany1p01.zit.commerzbank.com 65536 3821731 1365607398 1 0 *NULL* 2147483646 0 12 1 *NULL* 0
IMAGE netbpny2p04.zit.commerzbank.com 8 netbpny2p04.zit.commerzbank.com_1365767335 US_STI_ORACLE_DEV_NYSHRD02 0 EOM_25Y 0 10 3 2147483646 0 0 0 0
FRAG 4 1 32 0 2 14 2 015741 mediany1p01.zit.commerzbank.com 65536 3821728 1365607398 1 0 *NULL* 2147483646 0 12 1 *NULL* 0

[root@sv144889 ~]# bpmedialist -m 015741
Server Host = mediany1p01.zit.commerzbank.com

 id     rl  images   allocated        last updated      density  kbytes restores
           vimages   expiration       last read         <------- STATUS ------->
           On Hold
--------------------------------------------------------------------------------
015741  12      6   04/10/2013 17:23  04/13/2013 05:10  hcart2  1431809984     0
                6   01/19/2038 04:14        N/A         FULL

perez_cmz's picture

Btw, bpimmedia output showed the dates for all 6 images on 015741 as being 04/10/2013.

Marianne's picture

Strange that 'Date Allocated' shows 04/10/2013 but we see images with timestamp of 04/08/2013:

netbpny2p03.zit.commerzbank.com_1365415088 
UNIX time 1365415088 is 04/08/2013 9:58am GMT.

So, your start-date of 04/01/13 should have worked...

I am now wondering if there is maybe a difference in locale on your master server?

See the explanation of -s and -e in the Commands Manual:

-e date, -s date
Specifies the end (-e) or start (-s) of the range of dates and times that include
all backups to duplicate. The default end date is the current date and time.
The default start time is 24 hours before the current date and time.
The required date and time values format in NetBackup commands varies
according to your locale. The /user/openv/msg/.conf file (UNIX and Linux)
and the install_path\VERITAS\msg\LC.CONF file (Windows) contain
information such as the date-time formats for each supported locale. The
files contain specific instructions on how to add or modify the list of supported
locales and formats.
More information is available about the locale of your system.
See the "About specifying the locale of the NetBackup installation" topic in
the NetBackup Administrator's Guide, Volume II.

Maybe try to specify the year as 2013?
-s 04/01/2013 -e 05/02/2014

Other than this, maybe try one media-id using Duplicate in the Catalog section of the GUI and see what the result is. The info shown in the GUI results may give us a clue about the date format that can then be used from cmd or in a script.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

perez_cmz's picture

Apologies, my master server is in Frankfurt, Germany.

The media servers for my office are in New York.

Marianne's picture

Please try what I have suggested in my previous post:

.... maybe try one media-id using Duplicate in the Catalog section of the GUI and see what the result is. The info shown in the GUI results may give us a clue about the date format that can then be used from cmd or in a script.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

perez_cmz's picture

I was able to duplicate images on tape by copy numbers through the gui.

I had to specify the storage unit and volume pool to where I wanted to duplicate to.

SOLUTION
Marianne's picture

Glad to see you solved your own problem!

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links