Video Screencast Help

Backup failing with error code - 23

Created: 26 Apr 2014 • Updated: 24 Jun 2014 | 9 comments
This issue has been solved. See solution.

hidh209-ebr.hydc.sbc.com
Exit status 23: socket read failed

 

Discussion Filed Under:

Comments 9 CommentsJump to latest comment

Marianne's picture

You gave us nothing to work with.
Where do you see this error?
If Activity Monitor, show us all text in Details tab.

New client that has never worked before?
OS and NBU version on client?
OS and NBU version on master and/or media server?
Any OS firewall on client?
Or client or server behind firewall?
Foward and reverse name lookup tested between client and server (s)?

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

rajesh1700@gmail.com's picture

bptestbpcd -client hidh209-ebr.hydc.sbc.com
[16]bptestbpcd main: Function ConnectToBPCD(hidh209-ebr.hydc.sbc.com) failed: 23
socket read failed

 

rajesh1700@gmail.com's picture

ping -a hidh209-ebr.hydc.sbc.com
hidh209-ebr.hydc.sbc.com (135.165.206.199) is alive

 

rajesh1700@gmail.com's picture

telnet hidh209-ebr.hydc.sbc.com bpcd
Trying 135.165.206.199...
Connected to hidh209-ebr.
Escape character is '^]'.
Connection to hidh209-ebr closed by foreign host.

Ping and telnet is ok but backups are failing

rajesh1700@gmail.com's picture

Master server hosts file

root@hsprod22: cat /etc/hosts|grep -i hidh209
135.165.206.199 hidh209-ebr hidh209-ebr.hydc.sbc.com
 

Client server hosts file

hidh209 /home/users/rd221v-->cat /etc/hosts|grep -i hidh209-ebr
135.165.206.199 hidh209-ebr.hydc.sbc.com        hidh209-ebr
 

Will Restore's picture

Can the Client resolve the Master Server, forward and reverse lookup? 

Will Restore -- where there is a Will there is a way

Marianne's picture

You have showed us Client's hosts entry for itself. What about hosts entry for the master?

You still have not told us anything about OS and NBU versions.
If Linux client, have you checked that iptables is disabled?

NBU version is important because it will tell us which ports need to be opened.

If NBU 7.0.1 or later, port 1556 (PBX) will be used to connect to bpcd and for client connect-back.

If NBU 6.0 up to 7.0, port 13724 (vnetd) will be used.

If both pbx and vnetd attempts fail, bpcd will be attempted.

You have showed us telnet to client. That test connectivity one-way.
You need to test connectivity from client to master and/or media server as well using vnetd or pbx.

bptestbpcd is best to test connectivity both ways, but you need to test as follows:

Create bpcd log folder on the client under netbackup/logs.

Run bptestbpcd from master and media server as follows:

bptestbpcd -client hidh209-ebr.hydc.sbc.com -verbose -debug

Show us output of command as well as client's bpcd log file.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

rajesh1700@gmail.com's picture

From master
 

root@hsprod22: /usr/openv/netbackup/bin/admincmd/bptestbpcd -client hidh209-ebr.hydc.sbc.com -verbose -debug
16:37:25.643 [16786] <2> bptestbpcd: VERBOSE = 0
16:37:25.644 [16786] <2> read_client: dname=., offline=0, online_at=0
16:37:25.644 [16786] <2> read_client: dname=.., offline=0, online_at=0
16:37:25.644 [16786] <2> read_client: dname=host_info, offline=0, online_at=0
16:37:25.645 [16786] <2> db_freeEXDB_INFO: ?
16:37:25.649 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6702: 0: fopen() failed: 2 0x00000002
16:37:25.649 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6703: 0: fopen() failed: /usr/openv/var/host_cache/015/59eb9615+veritas_pbx,1,4,2,2,0+hidh209-ebr.hydc.sbc.com.txt
16:37:25.654 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6702: 0: fopen() failed: 2 0x00000002
16:37:25.654 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6703: 0: fopen() failed: /usr/openv/var/host_cache/0c0/9867e8c0+0,1,50,0,2,0+135.165.206.199.txt
16:37:25.662 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6702: 0: fopen() failed: 2 0x00000002
16:37:25.662 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6703: 0: fopen() failed: /usr/openv/var/host_cache/015/59eb9615+vnetd,1,4,2,2,0+hidh209-ebr.hydc.sbc.com.txt
16:37:25.667 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6702: 0: fopen() failed: 2 0x00000002
16:37:25.667 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6703: 0: fopen() failed: /usr/openv/var/host_cache/015/59eb9615+bpcd,1,4,2,2,0+hidh209-ebr.hydc.sbc.com.txt
16:37:25.674 [16786] <2> vnet_pbxConnect: ../../libvlibs/vnet_pbx.c.666: pbxSetAddrEx/pbxConnectEx return error 131:Connection reset by peer
16:37:25.674 [16786] <2> do_pbx_service: ../../libvlibs/vnet_connect.c.1718: 0: vnet_pbxConnect() failed: 18 0x00000012
16:37:25.674 [16786] <2> do_pbx_service: ../../libvlibs/vnet_connect.c.1719: 0: save_errno: 131 0x00000083
16:37:25.674 [16786] <2> do_pbx_service: ../../libvlibs/vnet_connect.c.1720: 0: use_vnetd: 0 0x00000000
16:37:25.674 [16786] <2> do_pbx_service: ../../libvlibs/vnet_connect.c.1721: 0: cr->vcr_service: bpcd
16:37:25.674 [16786] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1353: 0: do_service failed: 18 0x00000012
16:37:25.994 [16786] <2> vnet_vnetd_service_socket: ../../libvlibs/vnet_vnetd.c.1957: 0: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
16:37:25.994 [16786] <2> vnet_vnetd_service_socket: ../../libvlibs/vnet_vnetd.c.1971: 0: service: bpcd
16:37:26.132 [16786] <2> logconnections: BPCD CONNECT FROM 150.233.120.93.61198 TO 135.165.206.199.13724 fd = 4
16:37:26.133 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6702: 0: fopen() failed: 2 0x00000002
16:37:26.133 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6703: 0: fopen() failed: /usr/openv/var/host_cache/0c0/9867e8c0+veritas_pbx,1,4,2,2,0+135.165.206.199.txt
16:37:26.139 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6702: 0: fopen() failed: 2 0x00000002
16:37:26.139 [16786] <2> file_to_addrinfo: ../../libvlibs/vnet_addrinfo.c.6703: 0: fopen() failed: /usr/openv/var/host_cache/0c0/9867e8c0+vnetd,1,4,2,2,0+135.165.206.199.txt
16:37:26.145 [16786] <2> vnet_pbxConnect: ../../libvlibs/vnet_pbx.c.666: pbxSetAddrEx/pbxConnectEx return error 131:Connection reset by peer
16:37:26.145 [16786] <2> do_pbx_service: ../../libvlibs/vnet_connect.c.1718: 0: vnet_pbxConnect() failed: 18 0x00000012
16:37:26.145 [16786] <2> do_pbx_service: ../../libvlibs/vnet_connect.c.1719: 0: save_errno: 131 0x00000083
16:37:26.145 [16786] <2> do_pbx_service: ../../libvlibs/vnet_connect.c.1720: 0: use_vnetd: 1 0x00000001
16:37:26.145 [16786] <2> do_pbx_service: ../../libvlibs/vnet_connect.c.1721: 0: cr->vcr_service: vnetd
16:37:26.145 [16786] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1353: 0: do_service failed: 18 0x00000012
16:37:26.204 [16786] <2> do_vnetd_service: ../../libvlibs/vnet_connect.c.1675: 0: connect: VNETD CONNECT FROM 150.233.120.93.61203 TO 135.165.206.199.13724 fd = 5
16:37:26.208 [16786] <2> vnet_vnetd_connect_forward_socket_begin: ../../libvlibs/vnet_vnetd.c.445: 0: VN_REQUEST_CONNECT_FORWARD_SOCKET: 10 0x0000000a
16:37:26.314 [16786] <2> vnet_vnetd_connect_forward_socket_begin: ../../libvlibs/vnet_vnetd.c.462: 0: ipc_string: 8
16:39:26.314 [16786] <2> vnet_pop_byte: ../../libvlibs/vnet.c.1159: 0: errno: 2 0x00000002
16:39:26.315 [16786] <2> vnet_pop_byte: ../../libvlibs/vnet.c.1161: 0: Function failed: 9 0x00000009
16:39:26.315 [16786] <2> vnet_pop_string: ../../libvlibs/vnet.c.1241: 0: Function failed: 9 0x00000009
16:39:26.315 [16786] <2> vnet_vnetd_connect_forward_socket_begin: ../../libvlibs/vnet_vnetd.c.470: 0: status: 9 0x00000009
16:39:26.315 [16786] <2> bpcr_vnetd_connect_forward_socket_begin: vnet_vnetd_connect_forward_socket_begin() failed: 9
16:39:26.315 [16786] <2> local_bpcr_connect: bpcr_vnetd_connect_forward_socket_begin failed: 23
16:39:26.315 [16786] <2> ConnectToBPCD: bpcd_connect_and_verify(hidh209-ebr.hydc.sbc.com, hidh209-ebr.hydc.sbc.com) failed: 23
<16>bptestbpcd main: Function ConnectToBPCD(hidh209-ebr.hydc.sbc.com) failed: 23
16:39:26.316 [16786] <16> bptestbpcd main: Function ConnectToBPCD(hidh209-ebr.hydc.sbc.com) failed: 23
<2>bptestbpcd: socket read failed
16:39:26.316 [16786] <2> bptestbpcd: socket read failed
<2>bptestbpcd: EXIT status = 23
16:39:26.316 [16786] <2> bptestbpcd: EXIT status = 23
socket read failed
 

Dip's picture

Looks like a firewall issue here. We do need to know the OS on the Client. If it is Linux please paste /etc/xinet.conf and if it is Solaris 10 paste /etc/hosts.allow.

SOLUTION