Video Screencast Help

netbackup event manager service not coming up after server reboot

Created: 29 Jan 2013 | 14 comments

Hello All,

I need help on this issue, where the netbackup event manager service is not starting after the server reboot. Then manually start up works, but till bpdown and bpup is done, the activiti monitor doesn't show up anything.

Environment: master server - win 2008 64bit, nbu version - 7.1.0.3

I checked the browser, client name, emm server and server entry in registry which is fine. System logs also showing "netbackup event starting" and then  "netbackup event stopping".  I checked pbx and eventmgr service logs. 

PBX logs showing:

 

1/2/2013 11:27:50.121 [Application] VxICS 50936 103 PID:1720 TID:1796 File ID:103 [No context] [Info] PBX_Client_Proxy::handle_close
1/2/2013 11:27:59.704 [Application] VxICS 50936 103 PID:1720 TID:1796 File ID:103 [No context] [Info] PBX_Manager:: handle_input with fd = 0x25c
1/2/2013 11:27:59.704 [Application] VxICS 50936 103 PID:1720 TID:1796 File ID:103 [No context] [Info] PBX_Client_Proxy::parse_line, line = ack=1  From 199.213.126.73
1/2/2013 11:27:59.704 [Application] VxICS 50936 103 PID:1720 TID:1796 File ID:103 [No context] [Info] PBX_Client_Proxy::parse_line, line = extension=nbevtmgr  From 199.213.126.73
1/2/2013 11:27:59.704 [Application] VxICS 50936 103 PID:1720 TID:1796 File ID:103 [No context] [Info] hand_off looking for proxy for = nbevtmgr
1/2/2013 11:27:59.704 [Application] VxICS 50936 103 PID:1720 TID:1796 File ID:103 [No context] [Warning] No proxy found.
 
EVENTMGR logs showing:
 
1/21/2013 11:14:05.537 [Debug] NB 51216 libraries 137 PID:948 TID:2104 File ID:231 [No context] 1 [vnet_get_machine_credential_path_for_name] ../../libvlibs/vnet_vxss.c.1173: 0: could not find any credential for host: spwnbak01
1/21/2013 11:14:05.537 [Debug] NB 51216 libraries 137 PID:948 TID:2104 File ID:231 [No context] 1 [vnet_get_machine_credential_path_for_name] ../../libvlibs/vnet_vxss.c.1174: 0: Function failed: 35 0x00000023
1/21/2013 11:14:05.537 [Diagnostic] NB 51216 libraries 137 PID:948 TID:2104 File ID:231 [No context] 2 V-137-76 [ClientNbacEvaluator::getOurCredential] Machine credential not available
1/21/2013 11:14:05.537 [Debug] NB 51216 libraries 137 PID:948 TID:2104 File ID:231 [No context] 1 [Orb::init] endpointvalue is : pbxiop://1556:nbevtmgr(../Orb.cpp:712)
1/21/2013 11:14:05.537 [Debug] NB 51216 libraries 137 PID:948 TID:2104 File ID:231 [No context] 1 [Orb::init] initializing ORB nbevtmgr with: nbevtmgr -ORBSvcConfDirective "-ORBDottedDecimalAddresses 0" -ORBSvcConfDirective "static PBXIOP_Factory '-enable_keepalive'" -ORBSvcConfDirective "static InsecureEndpointSelectorFactory ''" -ORBSvcConfDirective "static Resource_Factory '-ORBProtocolFactory PBXIOP_Factory'" -ORBSvcConfDirective "static Resource_Factory '-ORBProtocolFactory IIOP_Factory'" -ORBDefaultInitRef '' -ORBSvcConfDirective "static PBXIOP_Evaluator_Factory '-orb nbevtmgr'" -ORBSvcConfDirective "static Resource_Factory '-ORBConnectionCacheMax 1024 '" -ORBEndpoint pbxiop://1556:nbevtmgr -ORBSvcConf nul -ORBSvcConfDirective "static Server_Strategy_Factory '-ORBMaxRecvGIOPPayloadSize 268435456'"(../Orb.cpp:823)
 
 
Thanks in advance.
 

 

Comments 14 CommentsJump to latest comment

Nagalla's picture

hi,

what is the netbackup event manager service startup Type in services.msc, does it Automatic?

are you saying Manual startup works when you do the bpdown and bpup only?

 

Pinku's picture

They are at automatic. Manual means, in services.msc when I right click and start the service, it starts. But after this there are no jobs in activity monitor, so I need to perform bpdown and bpup. Only then the event manager comes up and evrything seems fine.

Nagalla's picture

I have a question, just to make sure..

when you reboot the server, did you check alll other netbckup servers are starting? expect netbackup event manager service?

did you verify that from bpps?

because i doubt, when you are able to start the server fine with bpup, it seems there is no issues with event manager.

but something went wrong in server start up.

did you check if this got excluded form startup? from msconfig 

Pinku's picture

thanks for the response, I was not sure if this service can be excluded from msconfig. I'll check it today and update. And yes, other services are coming up without any issues after reboot.  

Mark_Solutions's picture

If it is set to auto but doesn't start up straight away it sounds like it is not connecting to something causing it to fail

Until you can isolate what is causing the delay (may be anti-virus locking files or similar - do exclude all of NetBackup and PBX locations) then you could set the event manager service to auto retry its startup.

Open up the service, go to the "recovery" tab and set it to restart the service for all three  failure sections - you can even tell it upon failure to run bpup if you wanted to

This at least would keeep thinsg running while you pin down the problem - but do look at AV exclusions

Hope this helps

Authorised Symantec Consultant

Don't forget to "Mark as Solution" if someones advice has solved your issue - and please bring back the Thumbs Up!!.

watsons's picture

Are you using NBAC? Check in your master server host properties, set it back to PROHIBITED if it's set otherwise. I saw "credential error" in your logs, not sure if it's relevant but may want to check.

Pinku's picture

msconfig - service was checked

no anti virus on the server and no NBAC configured.....pbx service has different logon account as from nbu services. Modified that to use same, still no positive results.

from pbx logs, its saying failed to hand-off. That's all I could understand. 

Mark_Solutions's picture

Why are you using service accounts for anything?

The only services that need accounts are the NetBackup client service and NetBackup Legacy Network Client Service - and then only on certain servers (SQL / Exchange etc.)

Set all services to use local system account unless you have a good reason to do otherwise - that could well be the root of your problems

Authorised Symantec Consultant

Don't forget to "Mark as Solution" if someones advice has solved your issue - and please bring back the Thumbs Up!!.

Dyneshia's picture

Is this clustered ? The nbsvcmon (NetBackup Monitor Service) does not run in a clustered environment.  The reason nbsvcmon is not needed is because the cluster monitor scripts perform process monitoring.

If it is not, "Machine credential not available"

Run a nslookup on the master server name and IP adrress, make sure it resolves properly.

Check your host and service file and make sure everything is correct.

When did you notice this ?  Was there a recent upgrade ?

Robert540's picture

 

 

I too have what looks like the same problem;

NetBackup 7.5.0.4, after a conversion from Linux to a Windows master server. New master server name and IP.

Can not see anything in the activity monitor after a system reboot.

The Event manager is not running.

bpdown, then kill 5 processes that do not die, bpup fixes it.

 

Logs are showing nothing of interest.

nbsu does. In the OS_event_application.txt file , read from the bottom up.

The Event Manager starts then is stopped.

 

 

Thu Jan 24 2013 15:13:22 NetBackup Event Manager I0 Service has been stopped

Thu Jan 24 2013 15:13:22 NetBackup Event Manager I0 Service is stopping

Thu Jan 24 2013 15:13:21 NetBackup Event Manager I0 Service has been started

Thu Jan 24 2013 15:13:19 Microsoft-Windows-WMI I5617 Windows Management Instrumentation Service subsystems initialized successfully

Thu Jan 24 2013 15:13:20 NetBackup Event Manager I0 Service is starting

Thu Jan 24 2013 15:13:17 Microsoft-Windows-WMI I5615 Windows Management Instrumentation Service started sucessfully

Thu Jan 24 2013 15:13:17 SQLANY64 11.0 I1 
Thu Jan 24 2013 15:13:17 VxPBX Service I0 Symantec Private Branch Exchange service started.

Thu Jan 24 2013 15:13:15 SQLANY64 11.0 I1 
Thu Jan 24 2013 15:13:13 NetBackup I14 Service started.

Thu Jan 24 2013 15:13:10 LANDesk Remote Control Service I2 The service was started.

Thu Jan 24 2013 15:13:10 cpqvcagent I60 Started the Version Control Agent (normal startup).

Thu Jan 24 2013 15:13:08 NetBackup I16 Service stopped.

Thu Jan 24 2013 15:13:08 NetBackup I14 Service started.

Thu Jan 24 2013 15:13:08 NetBackup E0 OID:128:V-1-1 Unspecified error.

Thu Jan 24 2013 15:13:08 NetBackup E0 OID:119:V-1-1 Unspecified error.

Thu Jan 24 2013 15:13:02 Microsoft-Windows-User Profiles Service I1531 The User Profile Service has started successfully. 

 

 

Julien DARDAINE's picture

Hello,

I meet the same problem : Event Manager does not start after reboot. Could you update me on how did you fix your pb?

Thank in advance,

Regards,

Julien

Julien DARDAINE's picture

No, it is not. But we may have found a problem.

In the vnetd log, we have this message during the startup :

05:07:54.018 [3848.3852] <2> NBIORInterceptor::establish_components: DNSQuery Lookup failed for host ylavvr01.inetpsa.com error:9852(../NBIORInterceptor.cpp:97)

We think DNS is not ready when Netbackup start, so we add an entry in the local hosts file.

Hope this will fix.