Video Screencast Help
Protect Your POS Environment Against Retail Data Breaches. Learn More.

(25) Cannot connect to Socket

Created: 06 Aug 2009 • Updated: 21 May 2010 | 27 comments

Hi All,

I just added a server on my Netbackup Master  Server and did the usual stuff like the pushing agent, host name etc etc...

every thing is working fine...but when i add the server in the policy and try to add the folders it show cannot connect to client.

when i go to client properties and double client the same server it shows (25) cannot connect to socket.

All i did is the normal procedures that i do to all my other servers but this one is not able to connect.

What could be the problem Antivirus ?(i use the same AV for the other servers but it is working fine). What might be blocking the socket connection? i dont know how to check the logs for bpbrm and other logs.i also dont know how to configure those logs so that i can see the error for this particular server.

Any ideas or suggesstions? Coz this is really strange problem i never faced before.

Abby

Comments 27 CommentsJump to latest comment

MOIMOI's picture

Hi Andy,

name resolution checks, bpclntcmd, ping etc etc. ......................have checked the resolution and ping it is fine.i hv pushed the agent over the network

Is the NB client running on the new client?...................the NB service is running on the client perfectly.

Not sure of your NB version but the following probably cover the same things:............I have a 6.5.3 Master Server Console.

Abby


rj_nbu's picture

Hi Abby,

1. Can you ping the server? try with hostname and ipaddress
2. from the master server, run telnet Client_Name 13782

-Rajeev
"Unix IS user friendly... It's just selective about who its friends are"

MOIMOI's picture

hi Rajeev,

1. Can you ping the server? try with hostname and ipaddress.....Everything is working from name resolution to hostname and ip address

2. from the master server, run telnet Client_Name 13782 ...... I am able to telnet the port 13782

Can you guys tell me how to enable logs in windows for bpbrm,bptm,bprd,bpdbm,bpcompatd and bpjobd. I dont see these logs folder under the installation folder.

Abby

gilbert08's picture

Kindly run this comand on the client  "bpcd -standalone"

MOIMOI's picture

hi there,

i did the too from default directory bin folder.

After pressing enter it goes show nothing n comes back to comman prompt again...

C:\Program Files\Veritas\NetBackup\bin>bpcd -standalone

C:\Program Files\Veritas\NetBackup\bin> (COMES BACK TO THE SAME PROMPT)

Am i right or is the result right that shows nothing on the command prompt?

Abby

Venkatesh K's picture

Enabeling logs,

on your master\client

go to C:\Program Files\Veritas\NetBackup\logs  create the folder with make of the logs you require.
Example : folder bpbrm for bpbrm logs

and enable logging on master host properties and for client you can do it from BAR window from client side. set loging level to 5 to get complete details

since your saying ping telnet and host resolution is fine, if this is the new client  that is having problem try restarting NB services on client or even a reboot of client if required.

try configuring user backup to this client and try staarting backup from client side and check what is the errror msg you get NB console.

Thanks & Regards, Venki Dont forget to Vote for + if you think suggestion is good, and mark as solution if it has resolved your problem.

MOIMOI's picture

Hi Ventakesh,

I enabled the bpbrm n other logs too thanks for that. i ran the job on the Master server and here is the BPBRM logs:

14:08:40.849 [2500.4768] <2> bpbrm main: INITIATING (VERBOSE = 5): version NetBackup 6.5 0
14:08:40.849 [2500.4768] <2> logparams: -backup -backup_copy 0 -b PRIMASERVER_1249898919 -bt 1249898919 -c PRIMASERVER -cl SERVER_LIST_3 -ct 13 -dt 0 -fso -jobid 254986 -jobgrpid 254986 -masterversion 650000 -mediasvr cslto2 -mpx 0 -nbu -p NONE -ru root -rg other -sched FULL -st 0 -S cslto2 -stream_count 2 -stream_number 1 -snaponly -secure 1 -use_ofb -use_otm -WOFB_enabled 1 -nbu
14:08:40.849 [2500.4768] <2> verify_client: bpbrm.c.32393: *connect_opts: 16974338 16974338 0x01030202
14:08:40.849 [2500.4768] <2> read_client: ?
14:08:40.849 [2500.4768] <2> read_client: opendir() failed: PRIMASERVER: No such file or directory (2)
14:08:40.849 [2500.4768] <2> bpbrm start_bpcd_stat: bpbrm.c.19448: bpcd_client: PRIMASERVER
14:08:40.849 [2500.4768] <2> bpbrm start_bpcd_stat: bpbrm.c.19451: bpcd_client_hostname: PRIMASERVER
14:08:40.849 [2500.4768] <2> hosts_equal: Comparing hosts <PRIMASERVER> and <PRIMASERVER>
14:08:40.849 [2500.4768] <2> hosts_equal: names are the same
14:08:40.849 [2500.4768] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200 0x000000c8
14:08:40.849 [2500.4768] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00000e10
14:08:40.849 [2500.4768] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_size: 40 0x00000028
14:08:40.849 [2500.4768] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x00000e10
14:08:40.849 [2500.4768] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200 0x000000c8
14:08:40.849 [2500.4768] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00000e10
14:08:40.849 [2500.4768] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_size: 40 0x00000028
14:08:40.849 [2500.4768] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x00000e10
14:10:40.849 [2500.4768] <2> vnet_sock_ready: vnet.c.506: Function failed: 11 0x0000000b
14:10:40.849 [2500.4768] <2> vnet_pop_byte: vnet.c.171: Function failed: 11 0x0000000b
14:10:40.849 [2500.4768] <2> vnet_pop_string: vnet.c.266: Function failed: 11 0x0000000b
14:10:40.849 [2500.4768] <2> vnet_pop_signed: vnet.c.310: Function failed: 11 0x0000000b
14:10:40.849 [2500.4768] <2> version_connect: vnet_vnetd.c.1812: Function failed: 11 0x0000000b
14:10:40.849 [2500.4768] <2> do_vnetd_service: vnet_vnetd.c.4393: version_connect failed: 11 0x0000000b
14:10:40.849 [2500.4768] <2> vnet_async_connect: vnet_vnetd.c.4193: do_vnetd_service failed: 11 0x0000000b
14:10:40.864 [2500.4768] <2> logconnections: BPCD CONNECT FROM 192.168.77.111.674 TO 192.168.77.2.13782
14:12:10.864 [2500.4768] <2> vnet_sock_ready: vnet.c.506: Function failed: 11 0x0000000b
14:12:10.864 [2500.4768] <2> vnet_pop_byte: vnet.c.171: Function failed: 11 0x0000000b
14:12:10.864 [2500.4768] <2> vnet_pop_string: vnet.c.266: Function failed: 11 0x0000000b
14:12:10.864 [2500.4768] <2> vnet_pop_signed: vnet.c.310: Function failed: 11 0x0000000b
14:12:10.864 [2500.4768] <2> vnet_pop_status: vnet.c.388: Function failed: 11 0x0000000b
14:12:10.864 [2500.4768] <2> vnet_begin_connect_back: vnet_vnetd.c.720: status: 11 0x0000000b
14:12:10.864 [2500.4768] <2> ConnectToBPCD: bpcd_connect_and_verify(PRIMASERVER, PRIMASERVER) failed: 0
14:12:10.864 [2500.4768] <16> bpbrm start_bpcd_stat: cannot connect to PRIMASERVER, The operation completed successfully.  (0)
14:12:10.895 [2500.4768] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2043: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
14:12:10.895 [2500.4768] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2057: service: bpjobd
14:12:10.895 [2500.4768] <2> job_connect: SO_KEEPALIVE set on socket 1788 for client cslto2
14:12:10.895 [2500.4768] <2> logconnections: BPJOBD CONNECT FROM 192.168.1.1.3800 TO 192.168.1.1.13724
14:12:10.895 [2500.4768] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
14:12:10.895 [2500.4768] <2> job_connect: Connected to the host cslto2 contype 10 jobid <254986> socket <1788>
14:12:10.895 [2500.4768] <2> job_connect: Connected on port 3800
14:12:10.927 [2500.4768] <2> job_monitoring_exex: ACK disconnect
14:12:10.927 [2500.4768] <2> job_disconnect: Disconnected
14:12:10.927 [2500.4768] <2> db_error_add_to_file: dberrorq.c:midnite = 1249848000
14:12:10.942 [2500.4768] <2> verify_client: bpbrm.c.32576: start_bpcd_stat failed: 58 58 0x0000003a
14:12:10.942 [2500.4768] <2> verify_client: bpbrm.c.32580: *client_hostname: PRIMASERVER
14:12:10.942 [2500.4768] <2> verify_client: bpbrm.c.32582: *connect_opts: 16777472 16777472 0x01000100
14:12:10.942 [2500.4768] <2> bpbrm main: bpbrm.c.2606: verify_client failed: 58 58 0x0000003a
14:12:10.942 [2500.4768] <2> bpbrm kill_child_process_Ex: start
14:12:15.974 [2500.4768] <2> bpbrm Exit: client backup EXIT STATUS 58: can't connect to client
14:22:17.864 [2020.4640] <2> bpbrm main: INITIATING (VERBOSE = 5): version NetBackup 6.5 0
14:22:17.864 [2020.4640] <2> logparams: -backup -backup_copy 0 -b PRIMASERVER_1249899737 -bt 1249899737 -c PRIMASERVER -cl SERVER_LIST_3 -ct 13 -dt 0 -fso -jobid 254986 -jobgrpid 254986 -masterversion 650000 -mediasvr cslto2 -mpx 0 -nbu -p NONE -ru root -rg other -sched FULL -st 0 -S cslto2 -stream_count 2 -stream_number 1 -snaponly -secure 1 -use_ofb -use_otm -WOFB_enabled 1 -nbu
14:22:17.864 [2020.4640] <2> verify_client: bpbrm.c.32393: *connect_opts: 16974338 16974338 0x01030202
14:22:17.864 [2020.4640] <2> read_client: ?
14:22:17.864 [2020.4640] <2> read_client: opendir() failed: PRIMASERVER: No such file or directory (2)
14:22:17.864 [2020.4640] <2> bpbrm start_bpcd_stat: bpbrm.c.19448: bpcd_client: PRIMASERVER
14:22:17.864 [2020.4640] <2> bpbrm start_bpcd_stat: bpbrm.c.19451: bpcd_client_hostname: PRIMASERVER
14:22:17.864 [2020.4640] <2> hosts_equal: Comparing hosts <PRIMASERVER> and <PRIMASERVER>
14:22:17.864 [2020.4640] <2> hosts_equal: names are the same
14:22:17.864 [2020.4640] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200 0x000000c8
14:22:17.864 [2020.4640] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00000e10
14:22:17.864 [2020.4640] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_size: 40 0x00000028
14:22:17.864 [2020.4640] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x00000e10
14:22:17.864 [2020.4640] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200 0x000000c8
14:22:17.864 [2020.4640] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00000e10
14:22:17.864 [2020.4640] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_size: 40 0x00000028
14:22:17.864 [2020.4640] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x00000e10
14:24:17.864 [2020.4640] <2> vnet_sock_ready: vnet.c.506: Function failed: 11 0x0000000b
14:24:17.864 [2020.4640] <2> vnet_pop_byte: vnet.c.171: Function failed: 11 0x0000000b
14:24:17.864 [2020.4640] <2> vnet_pop_string: vnet.c.266: Function failed: 11 0x0000000b
14:24:17.864 [2020.4640] <2> vnet_pop_signed: vnet.c.310: Function failed: 11 0x0000000b
14:24:17.864 [2020.4640] <2> version_connect: vnet_vnetd.c.1812: Function failed: 11 0x0000000b
14:24:17.864 [2020.4640] <2> do_vnetd_service: vnet_vnetd.c.4393: version_connect failed: 11 0x0000000b
14:24:17.864 [2020.4640] <2> vnet_async_connect: vnet_vnetd.c.4193: do_vnetd_service failed: 11 0x0000000b
14:24:17.880 [2020.4640] <2> logconnections: BPCD CONNECT FROM 192.168.77.111.533 TO 192.168.77.2.13782
14:25:47.880 [2020.4640] <2> vnet_sock_ready: vnet.c.506: Function failed: 11 0x0000000b
14:25:47.880 [2020.4640] <2> vnet_pop_byte: vnet.c.171: Function failed: 11 0x0000000b
14:25:47.880 [2020.4640] <2> vnet_pop_string: vnet.c.266: Function failed: 11 0x0000000b
14:25:47.880 [2020.4640] <2> vnet_pop_signed: vnet.c.310: Function failed: 11 0x0000000b
14:25:47.880 [2020.4640] <2> vnet_pop_status: vnet.c.388: Function failed: 11 0x0000000b
14:25:47.880 [2020.4640] <2> vnet_begin_connect_back: vnet_vnetd.c.720: status: 11 0x0000000b
14:25:47.880 [2020.4640] <2> ConnectToBPCD: bpcd_connect_and_verify(PRIMASERVER, PRIMASERVER) failed: 0
14:25:47.880 [2020.4640] <16> bpbrm start_bpcd_stat: cannot connect to PRIMASERVER, The operation completed successfully.  (0)
14:25:47.895 [2020.4640] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2043: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
14:25:47.895 [2020.4640] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2057: service: bpjobd
14:25:47.895 [2020.4640] <2> job_connect: SO_KEEPALIVE set on socket 1788 for client cslto2
14:25:47.895 [2020.4640] <2> logconnections: BPJOBD CONNECT FROM 192.168.1.1.1049 TO 192.168.1.1.13724
14:25:47.895 [2020.4640] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
14:25:47.895 [2020.4640] <2> job_connect: Connected to the host cslto2 contype 10 jobid <254986> socket <1788>
14:25:47.895 [2020.4640] <2> job_connect: Connected on port 1049
14:25:47.927 [2020.4640] <2> job_monitoring_exex: ACK disconnect
14:25:47.927 [2020.4640] <2> job_disconnect: Disconnected
14:25:47.927 [2020.4640] <2> db_error_add_to_file: dberrorq.c:midnite = 1249848000
14:25:47.942 [2020.4640] <2> verify_client: bpbrm.c.32576: start_bpcd_stat failed: 58 58 0x0000003a
14:25:47.942 [2020.4640] <2> verify_client: bpbrm.c.32580: *client_hostname: PRIMASERVER
14:25:47.942 [2020.4640] <2> verify_client: bpbrm.c.32582: *connect_opts: 16777472 16777472 0x01000100
14:25:47.942 [2020.4640] <2> bpbrm main: bpbrm.c.2606: verify_client failed: 58 58 0x0000003a
14:25:47.942 [2020.4640] <2> bpbrm kill_child_process_Ex: start
14:25:52.942 [2020.4640] <2> bpbrm Exit: client backup EXIT STATUS 58: can't connect to client

The telnet ,ping ,name resolution is working fine and i even restarted the server too. (uninstalled n reinstalled the cleint agent too).

May be this logs might give some idea?

Abby

gilbert08's picture

Is there any firewall that might block the connection?13782 = bpcd is this enabled?thanks

gilbert08's picture

Hi, you check this port that nbu services are using for your reference.

13701 = vmd
13721 = bpdbm
13723 = bpjobd
13724 = vnetd (assuming vnetd is configured)**
512-1023 = Reserved Port Range (assuming vnetd is not configured)**
13782 = bpcd
13711 = tldcd (for TLD library types)
13705 = tl8cd (for TL8 library types)
Last message received on 8/10 at 5:09 PM

gilbert08's picture

Hi, you check this port that nbu services are using for your reference.

13701 = vmd
13721 = bpdbm
13723 = bpjobd
13724 = vnetd (assuming vnetd is configured)**
512-1023 = Reserved Port Range (assuming vnetd is not configured)**
13782 = bpcd
13711 = tldcd (for TLD library types)
13705 = tl8cd (for TL8 library types)

gilbert08's picture

Hi, you check this port that nbu services are using for your reference.

13701 = vmd
13721 = bpdbm
13723 = bpjobd
13724 = vnetd (assuming vnetd is configured)**
512-1023 = Reserved Port Range (assuming vnetd is not configured)**
13782 = bpcd
13711 = tldcd (for TLD library types)
13705 = tl8cd (for TL8 library types)

MOIMOI's picture

hi Gilbert,

thanks for the reply.
there is no firewall in between a simple connection from swtich, basically everything is opened.
about the ports how do u want me to check the ports? telnet from the master server? (telnet target_server_name port number?)

Abby

J.H Is gone's picture

open the BAR on the client and go to properties and verify the Master server name was put in correctly.

I don't have to know how to spell....I work on Unix.
NetBackup 7.0.1 - AIX & Windows

Alex Vasquez's picture

Just a thought here, but did you check to see that both the short name and the Fully Qualified Domain Name resolve the same when you ping and telnet?  IT seems like you've hit the other important spots here.  On that note, on the client, does the master/media server entry show up as either the short or fqdn?  Try switching it up if you note any irregularities with my suggestion.

"I’m an early bird and a night owl. So I’m wise and I have worms."
- Michael Scott

MOIMOI's picture

Just to check

open the BAR on the client and go to properties and verify the Master server name was put in correctly.
---- I checked the master server is correct (i am only using one master server and have pushed the agent the from the same MServer by default it will only show the Mserver under "SERVER TO USE FOR BACKUP AND RESTORE" option).

Alex-------

I usually use the FQDN instead of a shorter name, i have also rechecked on both the Master Server and the Client server host files and it is shows FQDN.

Today mornings BPBRM logs:

bpbrm main: INITIATING (VERBOSE = 5): version NetBackup 6.5 0
01:49:13.360 [5084.2412] <2> logparams: -backup -backup_copy 0 -b PRIMASERVER_1249940952 -bt 1249940952 -c PRIMASERVER -cl SERVER_LIST_3 -ct 13 -dt 0 -fso -jobid 255153 -jobgrpid 255153 -masterversion 650000 -mediasvr cslto2 -mpx 0 -nbu -p NONE -ru root -rg other -sched DIFF -st 1 -S cslto2 -stream_count 2 -stream_number 1 -snaponly -secure 1 -use_ofb -use_otm -WOFB_enabled 1 -nbu
01:49:13.360 [5084.2412] <2> verify_client: bpbrm.c.32393: *connect_opts: 16974338 16974338 0x01030202
01:49:13.360 [5084.2412] <2> read_client: ?
01:49:13.360 [5084.2412] <2> read_client: opendir() failed: PRIMASERVER: No such file or directory (2)
01:49:13.360 [5084.2412] <2> bpbrm start_bpcd_stat: bpbrm.c.19448: bpcd_client: PRIMASERVER
01:49:13.360 [5084.2412] <2> bpbrm start_bpcd_stat: bpbrm.c.19451: bpcd_client_hostname: PRIMASERVER
01:49:13.360 [5084.2412] <2> hosts_equal: Comparing hosts <PRIMASERVER> and <PRIMASERVER>
01:49:13.360 [5084.2412] <2> hosts_equal: names are the same
01:49:13.360 [5084.2412] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200 0x000000c8
01:49:13.360 [5084.2412] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00000e10
01:49:13.360 [5084.2412] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_size: 40 0x00000028
01:49:13.360 [5084.2412] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x00000e10
01:49:13.360 [5084.2412] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200 0x000000c8
01:49:13.360 [5084.2412] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00000e10
01:49:13.360 [5084.2412] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_size: 40 0x00000028
01:49:13.360 [5084.2412] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x00000e10
01:49:15.813 [504.1968] <2> bpbrm Exit: client backup EXIT STATUS 0: the requested operation was successfully completed
01:51:13.360 [5084.2412] <2> vnet_sock_ready: vnet.c.506: Function failed: 11 0x0000000b
01:51:13.360 [5084.2412] <2> vnet_pop_byte: vnet.c.171: Function failed: 11 0x0000000b
01:51:13.360 [5084.2412] <2> vnet_pop_string: vnet.c.266: Function failed: 11 0x0000000b
01:51:13.360 [5084.2412] <2> vnet_pop_signed: vnet.c.310: Function failed: 11 0x0000000b
01:51:13.360 [5084.2412] <2> version_connect: vnet_vnetd.c.1812: Function failed: 11 0x0000000b
01:51:13.360 [5084.2412] <2> do_vnetd_service: vnet_vnetd.c.4393: version_connect failed: 11 0x0000000b
01:51:13.360 [5084.2412] <2> vnet_async_connect: vnet_vnetd.c.4193: do_vnetd_service failed: 11 0x0000000b
01:51:13.375 [5084.2412] <2> logconnections: BPCD CONNECT FROM 192.168.77.111.583 TO 192.168.77.2.13782
01:52:43.375 [5084.2412] <2> vnet_sock_ready: vnet.c.506: Function failed: 11 0x0000000b
01:52:43.375 [5084.2412] <2> vnet_pop_byte: vnet.c.171: Function failed: 11 0x0000000b
01:52:43.375 [5084.2412] <2> vnet_pop_string: vnet.c.266: Function failed: 11 0x0000000b
01:52:43.375 [5084.2412] <2> vnet_pop_signed: vnet.c.310: Function failed: 11 0x0000000b
01:52:43.375 [5084.2412] <2> vnet_pop_status: vnet.c.388: Function failed: 11 0x0000000b
01:52:43.375 [5084.2412] <2> vnet_begin_connect_back: vnet_vnetd.c.720: status: 11 0x0000000b
01:52:43.375 [5084.2412] <2> ConnectToBPCD: bpcd_connect_and_verify(PRIMASERVER, PRIMASERVER) failed: 0
01:52:43.375 [5084.2412] <16> bpbrm start_bpcd_stat: cannot connect to PRIMASERVER, The operation completed successfully.  (0)
01:52:43.391 [5084.2412] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2043: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
01:52:43.391 [5084.2412] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2057: service: bpjobd
01:52:43.391 [5084.2412] <2> job_connect: SO_KEEPALIVE set on socket 1784 for client cslto2
01:52:43.391 [5084.2412] <2> logconnections: BPJOBD CONNECT FROM 192.168.1.1.3373 TO 192.168.1.1.13724
01:52:43.391 [5084.2412] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
01:52:43.391 [5084.2412] <2> job_connect: Connected to the host cslto2 contype 10 jobid <255153> socket <1784>
01:52:43.391 [5084.2412] <2> job_connect: Connected on port 3373
01:52:43.407 [5084.2412] <2> job_monitoring_exex: ACK disconnect
01:52:43.407 [5084.2412] <2> job_disconnect: Disconnected
01:52:43.407 [5084.2412] <2> db_error_add_to_file: dberrorq.c:midnite = 1249934400
01:52:43.422 [5084.2412] <2> verify_client: bpbrm.c.32576: start_bpcd_stat failed: 58 58 0x0000003a
01:52:43.422 [5084.2412] <2> verify_client: bpbrm.c.32580: *client_hostname: PRIMASERVER
01:52:43.422 [5084.2412] <2> verify_client: bpbrm.c.32582: *connect_opts: 16777472 16777472 0x01000100
01:52:43.422 [5084.2412] <2> bpbrm main: bpbrm.c.2606: verify_client failed: 58 58 0x0000003a
01:52:43.422 [5084.2412] <2> bpbrm kill_child_process_Ex: start
01:52:48.422 [5084.2412] <2> bpbrm Exit: client backup EXIT STATUS 58: can't connect to client

Abby

 

Venkatesh K's picture

I see that ur backup is failing with 58.

try this,

use the command- bptestbpcd to verify you can connect to both the vnetd and bpcd ports on the client server.
example

bptestbpcd -verbose -debug -client <client hostname>

tech note on bptestbpcd  http://entsupport.symantec.com/docs/277901

post output here that should help also paost outtput of

From Master/media
<install path>/netbackup/bin/./bpclntcmd -hn <client hostname>
<install path>/netbackup/bin/./bpclntcmd -ip <client ip>

from client
<install path>/netbackup/bin/./bpclntcmd -pn
 above command should give u exact name of your master

<install path>/netbackup/bin/./bpclntcmd -hn <Master hostname>
<install path>/netbackup/bin/./bpclntcmd -ip <Master ip>

regards,
Venkatesh

Thanks & Regards, Venki Dont forget to Vote for + if you think suggestion is good, and mark as solution if it has resolved your problem.

MOIMOI's picture

Hi Venkatesh,
thanks for the reply. Results are as follows:

1. bptestbpcd -verbose -debug -client <client hostname>:
     RESULT:

C:\Program Files\Veritas\NetBackup\bin\admincmd>bptestbpcd -client primaserver -
debug
09:06:02.141 [4388.3348] <2> bptestbpcd: VERBOSE = 0
09:06:02.141 [4388.3348] <2> read_client: ?
09:06:02.141 [4388.3348] <2> read_client: opendir() failed: primaserver: No such
 file or directory (2)
09:06:02.141 [4388.3348] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200
0x000000c8
09:06:02.141 [4388.3348] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00
000e10
09:06:02.141 [4388.3348] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_si
ze: 40 0x00000028
09:06:02.141 [4388.3348] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x0
0000e10
09:06:02.141 [4388.3348] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200
0x000000c8
09:06:02.141 [4388.3348] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00
000e10
09:06:02.141 [4388.3348] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_si
ze: 40 0x00000028
09:06:02.141 [4388.3348] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x0
0000e10
09:08:02.141 [4388.3348] <2> vnet_sock_ready: vnet.c.506: Function failed: 11 0x
0000000b
09:08:02.141 [4388.3348] <2> vnet_pop_byte: vnet.c.171: Function failed: 11 0x00
00000b
09:08:02.141 [4388.3348] <2> vnet_pop_string: vnet.c.266: Function failed: 11 0x
0000000b
09:08:02.141 [4388.3348] <2> vnet_pop_signed: vnet.c.310: Function failed: 11 0x
0000000b
09:08:02.141 [4388.3348] <2> version_connect: vnet_vnetd.c.1812: Function failed
: 11 0x0000000b
09:08:02.141 [4388.3348] <2> do_vnetd_service: vnet_vnetd.c.4393: version_connec
t failed: 11 0x0000000b
09:08:02.141 [4388.3348] <2> vnet_async_connect: vnet_vnetd.c.4193: do_vnetd_ser
vice failed: 11 0x0000000b
09:08:02.156 [4388.3348] <2> logconnections: BPCD CONNECT FROM 192.168.77.111.68
4 TO 192.168.77.2.13782
09:09:32.156 [4388.3348] <2> vnet_sock_ready: vnet.c.506: Function failed: 11 0x
0000000b
09:09:32.156 [4388.3348] <2> vnet_pop_byte: vnet.c.171: Function failed: 11 0x00
00000b
09:09:32.156 [4388.3348] <2> vnet_pop_string: vnet.c.266: Function failed: 11 0x
0000000b
09:09:32.156 [4388.3348] <2> vnet_pop_signed: vnet.c.310: Function failed: 11 0x
0000000b
09:09:32.156 [4388.3348] <2> vnet_pop_status: vnet.c.388: Function failed: 11 0x
0000000b
09:09:32.156 [4388.3348] <2> vnet_begin_connect_back: vnet_vnetd.c.720: status:
11 0x0000000b
09:09:32.156 [4388.3348] <2> ConnectToBPCD: bpcd_connect_and_verify(primaserver,
 primaserver) failed: 0
<16>bptestbpcd main: Function ConnectToBPCD(primaserver) failed: 25
09:09:32.156 [4388.3348] <16> bptestbpcd main: Function ConnectToBPCD(primaserve
r) failed: 25
<2>bptestbpcd: cannot connect on socket
09:09:32.156 [4388.3348] <2> bptestbpcd: cannot connect on socket
<2>bptestbpcd: EXIT status = 25
09:09:32.156 [4388.3348] <2> bptestbpcd: EXIT status = 25
cannot connect on socket

2.<install path>/netbackup/bin/./bpclntcmd -hn <client hostname>

    C:\Program Files\Veritas\NetBackup\bin>bpclntcmd -hn primaserver
host primaserver: primaserver at 192.168.77.2 (0x24da8c0)
aliase
s:..... IT IS WORKING

<install path>/netbackup/bin/./bpclntcmd -ip <client ip>

C:\Program Files\Veritas\NetBackup\bin>bpclntcmd -ip 192.168.77.2
checkhaddr: host   : primaserver: primaserver at 192.168.77.2 (0x24da8c0
checkhaddr: aliases:
...IT IS WORKING

3. <install path>/netbackup/bin/./bpclntcmd -hn <Master hostname>
    
C:\Program Files\Veritas\NetBackup\bin>bpclntcmd -hn cslto2
host cslto2: cslto2 at 192.168.77.111 (0x6f4da8c0)
aliases:
......IT IS WORKING

<install path>/netbackup/bin/./bpclntcmd -ip <Master ip>

WHEN I ENTER THIS COMMAND I GET A WINDOW WHICH SAYS THIS:

VISUAL STUDIO JUST IN TIME DEBUGGER
AN UNHANDLED WIN32 EXCEPTION OCCURED IN BPCLNTCMD.EXE[3720]
DO YOU WANT TO DUBUG USING SELECTED DEBUGGER [YES/NO]
WHEN I SAY YES IT OPEN A WINDOW WITH ERROR


A part from this i have run few more commands and the outputs are:

1. C:\Program Files\Veritas\NetBackup\bin\admincmd>bptestbpcd -client primaserver
<16>bptestbpcd main: Function ConnectToBPCD(primaserver) failed: 25
cannot connect on socket

2.C:\Program Files\Veritas\NetBackup\bin\admincmd>bptestbpcd -client primaserver -
verbose
<16>bptestbpcd main: Function ConnectToBPCD(primaserver) failed: 25
cannot connect on socket

I feel the problem is from client side may be? Right now i m going to uninstall and reintall the NEtbackup agent and try these commands again.

one more command i m pasting from a client which is working that might help u to see the difference

C:\Program Files\Veritas\NetBackup\bin\admincmd>bptestbpcd -client cpdb -debug
09:48:54.125 [5320.5292] <2> bptestbpcd: VERBOSE = 0
09:48:54.125 [5320.5292] <2> read_client: ?
09:48:54.125 [5320.5292] <2> read_client: opendir() failed: cpdb: No such file o
r directory (2)
09:48:54.125 [5320.5292] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200
0x000000c8
09:48:54.125 [5320.5292] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00
000e10
09:48:54.125 [5320.5292] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_si
ze: 40 0x00000028
09:48:54.141 [5320.5292] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x0
0000e10
09:48:54.141 [5320.5292] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200
0x000000c8
09:48:54.141 [5320.5292] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00
000e10
09:48:54.141 [5320.5292] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_si
ze: 40 0x00000028
09:48:54.141 [5320.5292] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x0
0000e10
09:48:54.156 [5320.5292] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2043: VN_RE
QUEST_SERVICE_SOCKET: 6 0x00000006
09:48:54.156 [5320.5292] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2057: servi
ce: bpcd
09:48:54.312 [5320.5292] <2> logconnections: BPCD CONNECT FROM 192.168.15.111.13
54 TO 192.168.15.5.13724

09:48:54.328 [5320.5292] <2> vnet_connect_to_vnetd_extra: vnet_vnetd.c.179: msg:
 VNETD CONNECT FROM 192.168.15.111.1355 TO 192.168.15.5.13724 fd = 1780
09:48:54.328 [5320.5292] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd
.c.532: VN_REQUEST_CONNECT_FORWARD_SOCKET: 10 0x0000000a
09:48:54.547 [5320.5292] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd
.c.549: ipc_string: 1110
1 1 1
192.168.15.111:1354 -> 192.168.15.5:13724
192.168.15.111:1355 -> 192.168.15.5:13724
09:48:54.937 [5320.5292] <2> vnet_connect_to_vnetd_extra: vnet_vnetd.c.179: msg:
 VNETD CONNECT FROM 192.168.15.111.1356 TO 192.168.15.5.13724 fd = 1768
09:48:54.937 [5320.5292] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd
.c.532: VN_REQUEST_CONNECT_FORWARD_SOCKET: 10 0x0000000a
09:48:55.094 [5320.5292] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd
.c.549: ipc_string: 1112
192.168.15.111:1356 -> 192.168.15.5:13724
<2>bptestbpcd: EXIT status = 0
09:48:55.297 [5320.5292] <2> bptestbpcd: EXIT status = 0

The only difference i saw in the server with error connecting and the above is the port used  in 1st one which is working server is 13724 and the one which is giving error connecting is 13782. Is it coz of that  it is trying to listen to a incorrect port? i have tired the debug command on my other working server which also shows the port it is connecting is 13724 and not 13782. may be 13782 is used by some other program or application on the client side but that is also no possible coz on the client side i stopped the netbackup service and tired to telnet local host 13782 it is doenst work.

1. THIS ONE IS WORKING : 09:48:54.312 [5320.5292] <2> logconnections: BPCD CONNECT FROM 192.168.15.111.13
54 TO 192.168.15.5.13724 (PORT NUMBER HERE IS 13724)

2. THIS IS THE ONE WITH ERROR: 09:08:02.156 [4388.3348] <2> logconnections: BPCD CONNECT FROM 192.168.77.111.68
4 TO 192.168.77.2.13782
....(PORT NUMBER USED IS 13782)

Abby

Venkatesh K's picture

Hi Abby,

thanks for the logs, so from your logs and from ur conclusion i think you should be able to figure out the problem,

for the one where backup is success we see thaport 13724 ie vnetd is used, and for the one with problem port 13782 ie bpcd is used.

NBU clients running 6.x release, uses the vnetd daemon for incoming connections by default, and it also requires bpcd to perform the hostname compare to authenticate the NBU server. which means you need to have both ports open from your client.

try these and check if vnetd and bpcd  ports are open on client

netstat -a | grep bpcd
netstat -a | grep vnetd

The output from these commands should show the following outputs, respectively:

# netstat -a | grep bpcd
tcp        0      0 *:bpcd                      *:*                         LISTEN
# netstat -a | grep vnetd
tcp        0      0 *:vnetd                     *:*                         LISTEN

if either of them are not listening make sure u enable those ports. i think u have only problem with vnetd port but check both again.

if above output is correct  then try this,

From the NB administration Console:

1. Launch the NetBackup Administration Console, connecting to the master server
 
2. Expand Host Properties in the left pane
 
3. Select Master Server in the left pane
 
4. Click the name of the master server in the right pane
 
5. Select the Client Attributes section
 
6. Add the name of the client in that is having problem if it isn't listed
7. In the Connect Options tab for the client, make the following changes:
 
BPCD connect back -> "Random port"  or VNETD port (give test backup try with both options)
Ports ->  "Reserved port"
Daemon connection port -> "Daemon port only"

OR 

Try camparing with your client whose backups are successfull and try same values for this client also

let us know if this was usefull

Regards,
Venkat

 

Thanks & Regards, Venki Dont forget to Vote for + if you think suggestion is good, and mark as solution if it has resolved your problem.

MOIMOI's picture

Hi Venkatesh and Kartik,

I really appreciate your time, efforts and replies here.
Since it is a week end here in ME i wil be testing this over the week end and wil definitely post you guys the out comes.

by the way nestat -a | grep bdcp is for UNIX clients i suppose not for windows.

I will try the other option in adding the server in the client attribute but this will be possible only by tomorrow coz my FULL backup starts today evening and i have other issues too to solve hehehehe....

thank you all in advance.

Abby

Venkatesh K's picture

So Abby,

did u get this resolved ?

let us know if ur still having problem dont forget to mark suggetions as solution if  you get it right, also vote if you think suggestion were good and got you going on right track

regards,
Venkat

Thanks & Regards, Venki Dont forget to Vote for + if you think suggestion is good, and mark as solution if it has resolved your problem.

Venkatesh K's picture

see my above post

Thanks & Regards, Venki Dont forget to Vote for + if you think suggestion is good, and mark as solution if it has resolved your problem.

Karthikeyan Sundaram's picture

Is your Pinging IP Address and Original Client IP Address are same ??

Check your host file entry and remove the entry for this client if you have DNS !

Do u have Backup NIC's?? if so is your master and client pointed to use Backup NIC's ??

Enable bpcd logs on client and check for Prefiz <16> Lines and share us that logs !

I am praying for you to get it resolved soon !

Thanks, Karthikeyan Sundaram.

sumanreddy's picture

Hi,

please make sure the master server and media server entries in bp.conf file
for windows

on client :
open  Backup archive restore window -> go to  file ->specicy netbackup machine and policy type
->edit server list. check the master server and media server entries if not add and try backup.

Regards,
Suman

Zak Meekins 2's picture

Hey, I was having the same problem with one particular host. Everything checked out, all of my tests were fine then I noticed that the client version was 6.5 and my master was 6.5.3.1. I installed the latest version of the client software on the host that was getting status code 25 and it started working. I know 6.5.3.1 is supposed to be backwards compatible but in my case installing the same version of the client that was on my master fixed the problem.  

Azeem's picture

i had the same issue.. I tried everything  like  and amazingly all results came back positive..
bpclntcmd -hn (hostname)
telnet hostname 13782
ping
nslookup

The only diffrence was Master server was 6.5.4 & the client was 6.5.3. and once i updated the client to same version as Master server I was able to connect to the client properties from the Master server.. and successfully backup

protocol_girl's picture

Whenever you see a grep command and you want to run it on windows, use findstr.  Ex.  netstat -a |grep bpcd ...becomes netstat -a | findstr bpcd.