Video Screencast Help
Symantec to Separate Into Two Focused, Industry-Leading Technology Companies. Learn more.

Why SAN speed is too much slow

Created: 29 Mar 2010 • Updated: 30 Sep 2010 | 12 comments

My Netbackup server is connected to the File server via LAN. My same Netbackup server is connected to the SAN Switch via Fiber. The File server is also connected to the SAN Switch via Fiber. SAN Switch is connected to one Robot Library having shared tape drive. I have done the necessary zonning required on the SAN Switch to take the traffice on the SAN. I am able to take the backup of the File Server through SAN using Media Server. I have done all the necessary tunning & buffering in order to increase the speed, it has increased the speed but not adequate.

The speed for my backups is 10 MB/S. I have checked even the performance graph on the SAN Switch. At  port number 3 SAN Switch is receiving nearly 55 MB/S but suddenly it's speed lowers down at nearly 10 MB/S and start transmitting at the same speed to tape library. At other end the end from the port 5 of the SAN Switch to the Tape Libraray the speed again becomes fast. 

Is it possibe that the SAN Switch is not properly configured. Because I have done everything in order to increase the speed from the Netbackup end. I even have checked the console of the tape library but to no avail. Can any body guide me what are the necessary actions i can take in order to get the desired result for the SAN.
 
Waiting for Quick responses.

Comments 12 CommentsJump to latest comment

qiblatain's picture

Dear Friends;
is it possible to add unix client on the Windows Netbackup Server 6.5?
Can we make the unix client, the media server for the Windows Netbackup Server 6.5?
Infact I need to take the backup of the unix client from the Windows Netbackup Server. Is it possibe, please guide me.

Waiting for your quick response.

Thanks.

qiblatain's picture

I am using Windows Netbackup server 6.5.3. This Netbackup server is installed on the 2003 R2. I have made the File Server (FS02), as the second (additional) media server for SAN having version 6.5.2. The File Server (FS02) has Windows 2008. This File Server (FS02) is clustered with another File Server having name FS03.

The problem for the low speed is possible due to some cluster issue?

Waiting for your quick response. Because I am totally stuck at this point.

Thanks.

Marianne's picture

Slow backup speed on a file server is normally due to the file structure - lots of directories, directory depth, lots of small files, heavy fragmentation.
Test read speed from disk. The NBU Performance Tuning Guide explains on p.105 how to use bpbkar to test this.

Answer to your 2nd question is YES. Simply create a policy of type Standard and select the Windows Storage Unit. You need to ensure that forward and reverse hostname lookup works 100%.
The easiest is normanlly to add hosts entries on the Windows and Unix systems. (Best if you create separate threads for each question.)

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

qiblatain's picture

Thanks for your response Marianne,

Actually I have done bpbkar test already, but I didn't able to find elapsed time entry in the log. what could be the reason?

Dont you think it could be the SAN ports internal communication problem (data rate sending/receiving) ?

I did port monitoring of SAN switch, port at which file server is attached it received more that 40 mb data and transmit at rate of 10k. And at the other end of Tape library port, it receives at 10 k and transmit to TL at approx. 40 mb. (This 10 k receiving rate is same transmit by windows server port).

I am confused here and looking for the solution to move ahead.
 

qiblatain's picture

For reference 2 files are attached from SAN switch monitoring.

Port 1 is attached to windows serevr (SAN Media server as well)
Port 2 is attached to Tape Library.

I hope this attachments will help you to suggest the solutions.

port 1.JPG port2.JPG
Marianne's picture

Did you increase the logging level to minimum of 1?
If so, please post bpbkar log.
There are other tools as well that can be downloaded to test disk read speed:
Look at 'Disk and file system performance' on this site:
http://h20000.www2.hp.com/bizsupport/TechSupport/D...

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

qiblatain's picture

I have already set the logging level to 1 in Master, Media and Client properties of logging. but it didn't impact in the Logs. 
 Logs are below....

10:59:46.970 AM: [3856.2588] <4> ov_log::OVInit: INF - Starting log file: C:\Program Files\Veritas\NetBackup\logs\BPBKAR\033010.LOG
 
10:59:46.970 AM: [3856.2588] <4> ov_log::OVInit: GENERAL Log Level: 0
10:59:46.970 AM: [3856.2588] <4> ov_log::OVInit: TCP Log Level: 0
10:59:46.970 AM: [3856.2588] <4> ov_log::OVInit: INF - the log mutex: 236
BPBKAR  NetBackup Backup/Archive  6.5GA  [May 23 2008]
Copyright 1993 - 2007 VERITAS Software Corporation
All Rights Reserved.
 
10:59:46.970 AM: [3856.2588] <2> WinMain: DAT - _pgmptr = 'C:\Program Files\Veritas\NetBackup\bin\bpbkar32.exe'
10:59:46.970 AM: [3856.2588] <2> WinMain: DAT - lpCmdLine = '-nocont F:\General\Infotech_gen\Applicatins and Downloads'
10:59:46.970 AM: [3856.2588] <2> date_debug: DAT - timezone: Arab Standard Time, offset=-10800, dst: NONE
10:59:46.970 AM: [3856.2588] <2> date_debug: DAT - current time: 1269935986, 3/30/2010 10:59:46 AM
10:59:46.970 AM: [3856.2588] <2> date_debug: DAT - 01/01/94 UCT:  757382400, 1/1/1994 3:00:00 AM
10:59:46.970 AM: [3856.2588] <2> date_debug: DAT - 07/01/94 UCT:  773020800, 7/1/1994 3:00:00 AM
10:59:46.970 AM: [3856.2588] <2> WinMain: DAT - standard input handle = -2
10:59:46.970 AM: [3856.2588] <4> WinMain: INF - not using socket for standard input handle
10:59:46.970 AM: [3856.2588] <2> WinMain: DAT - standard output handle = -2
10:59:46.970 AM: [3856.2588] <4> WinMain: INF - not using socket for standard output handle
10:59:46.970 AM: [3856.2588] <2> WinMain: DAT - standard error handle = -2
10:59:46.970 AM: [3856.2588] <4> WinMain: INF - not using socket for standard error handle
10:59:46.970 AM: [3856.2588] <4> tar_backup::V_SetupJobData: INF - dwJobData: ffffffff
10:59:46.970 AM: [3856.2588] <4> tar_backup::V_SetupJobData: INF -     dwJob: ffffffff
10:59:46.986 AM: [3856.2588] <4> dos_backup::V_PreProcessing: INF - backup privileges enabled, previous = 0
10:59:46.986 AM: [3856.2588] <4> dos_backup::V_PreProcessing: INF - restore privileges enabled, previous = 0
10:59:46.986 AM: [3856.2588] <4> dos_backup::V_PreProcessing: INF - security privileges enabled, previous = 0
10:59:46.986 AM: [3856.2588] <4> dos_backup::V_PreProcessing: INF - tcb privileges enabled, previous = 0
10:59:46.986 AM: [3856.2588] <4> dos_backup::V_PreProcessing: INF - create token privileges enabled, previous = 0
10:59:46.986 AM: [3856.2588] <4> dos_backup::V_PreProcessing: INF - user name: 
10:59:46.986 AM: [3856.2588] <4> dos_backup::V_PreProcessing: INF - no access token: scheduled backup
10:59:47.033 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - BEDS_Init() Enter InitFlags:0x0
10:59:47.360 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - DumpDleInfo() DLE Device Name: C:
10:59:47.360 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - DumpDleInfo() DLE Device Name: F:
10:59:47.360 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - DumpDleInfo() DLE Device Name: G:
10:59:47.360 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - DumpDleInfo() DLE Device Name: Q:
10:59:47.360 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - DumpDleInfo() DLE Device Name: Microsoft Terminal Services
10:59:47.360 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - DumpDleInfo() DLE Device Name: Microsoft Windows Network
10:59:47.360 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - DumpDleInfo() DLE Device Name: Shadow?Copy?Components
10:59:47.579 AM: [3856.2588] <2> tar_backup_tfi::setupFileDirectives: TAR - backup filename = F:\General\Infotech_gen\Applicatins and Downloads
10:59:47.579 AM: [3856.2284] <4> tar_base::keepaliveThread: INF - keepalive thread is active with an interval of 30 seconds
10:59:47.579 AM: [3856.2284] <16> tar_base::keepaliveThread: INF - keepalive thread abnormal exit :14
10:59:47.610 AM: [3856.2588] <2> tar_base::V_vTarMsgW: INF - Open File Backup license is not installed on the server.  Open File Backup usage will be disabled.
10:59:47.610 AM: [3856.2588] <4> dos_backup::V_VerifyFileList: INF - UBS Local Type for 'F:\General\Infotech_gen\Applicatins and Downloads' --> 10020002
10:59:49.419 AM: [3856.2588] <2> tar_base::V_vTarMsgW: INF - EXIT STATUS 40: network connection broken
10:59:49.419 AM: [3856.2588] <4> backup_create: INF - NetBackup Temp Directory: 'C:\Program Files\Veritas\\NetBackup\Temp'
10:59:49.419 AM: [3856.2588] <4> OVStopCmd: INF - EXIT - status = 0
10:59:49.419 AM: [3856.2588] <2> tar_base::V_Close: 
10:59:49.419 AM: [3856.2588] <4> dos_backup::tfs_reset: INF - Snapshot deletion start
10:59:49.419 AM: [3856.2588] <2> ov_log::V_GlobalLog: INF - BEDS_Term() Enter InitFlags:0x101
10:59:49.435 AM: [3856.2588] <4> OVShutdown: INF - Finished process
10:59:49.435 AM: [3856.2588] <4> WinMain: INF - Exiting C:\Program Files\Veritas\NetBackup\bin\bpbkar32.exe
10:59:51.463 AM: [3856.2588] <4> ov_log::OVClose: INF - Closing log file: C:\Program Files\Veritas\NetBackup\logs\BPBKAR\033010.LOG
 
11:04:37.671 AM: [4028.5452] <4> ov_log::OVInit: INF - Starting log file: C:\Program Files\Veritas\NetBackup\logs\BPBKAR\033010.LOG
 
11:04:37.671 AM: [4028.5452] <4> ov_log::OVInit: GENERAL Log Level: 0
11:04:37.671 AM: [4028.5452] <4> ov_log::OVInit: TCP Log Level: 0
11:04:37.671 AM: [4028.5452] <4> ov_log::OVInit: INF - the log mutex: 236
BPBKAR  NetBackup Backup/Archive  6.5GA  [May 23 2008]
Copyright 1993 - 2007 VERITAS Software Corporation
All Rights Reserved.
 
11:04:37.671 AM: [4028.5452] <2> WinMain: DAT - _pgmptr = 'C:\Program Files\Veritas\NetBackup\bin\bpbkar32.exe'
qiblatain's picture

I just did disk monitoring test using resource monitor of Win srv 2008, that was fine, even files are read at 60 Mb/s or more than it, avg was more than 40 Mb/s, but still backup writing to Tape took alot time and transport rate was 9mb/s in details of job.

Marianne's picture

Seems bpbkar test was broken with some 6.5 version. I had the same experience - the test fails with status 40.

Your disk monitoring test proofed that data can be read fast enough. Your SAN switch monitoring also proofs that data is received fast enough. Your tests seem pretty comprehensive and points to a possible switch problem. Unfortunately my skills are limited to the Symantec product range.
Hopefully there are SAN specialists on this forum who can provide better advice.

Do you perhaps have a maintenance agreement with the switch provider? I suggest you log a call with them.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

qiblatain's picture

Thank you so much, 

So its proved that problem is not related to Netbackup configuration and buffers configurations. Problem seems to be at switch end.

Thank you so much for your proactive support, if you think I have to try some alternatives still, please let me know.

that will be really appreciated.

qiblatain's picture

WHAT HAPPENS WHEN " DISABLE THE REMOVABLE STORAGE SERVICE" ?

CAN WE INCREASE THE SAN BACKUP SPEED BY DISABLING THE REMOVABLE STORAGE SERVICE ?

qiblatain's picture

BY EDITING THE REGISTRY RELATED TO TAPE DRIVES SERVICES, CAN WE INCREASE THE SAN BACKUP SPEED.

IF POSSIBLE, PLEASE GIVE THE SUGGESTIONS.

THANKS.