Check the patch levels in the cluster; the most likely cause is a patch mismatch, that is a mix of 3.5, 3.5 Maintenance Pack 1 (MP1) and 3.5MP2 installs.

# showrev -p | grep VRTS | sort
Patch: 112392-01 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSvxvm <- 3.5MP1
Patch: 112392-06 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSvmman, VRTSvxvm <- 3.5MP2
Patch: 113203-02 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSob <- 3.5MP1
Patch: 113206-03 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSvxfs <- 3.5MP1
Patch: 113206-05 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSvxfs <- 3.5MP1RP2
Patch: 113206-10 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSvxfs <- 3.5MP2
Patch: 113210-02 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSfspro <- 3.5MP1
Patch: 113213-01 Obsoletes:  Requires: 113206-03 Incompatibles:  Packages: VRTSglm <- 3.5MP1
Patch: 113216-01 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSdbed <- 3.5MP1
Patch: 113594-01 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSorgui <- 3.5MP1
Patch: 113595-02 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSobgui <- 3.5MP1
Patch: 113596-02 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSvmpro <- 3.5MP1
Patch: 113599-01 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSodm <- 3.5MP1
Patch: 113602-01 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSgms <- 3.5MP1
Patch: 113698-01 Obsoletes:  Requires: 112392-04 Incompatibles:  Packages: VRTSvxvm <- 3.5MP1 Point Patch 3.1
Patch: 113702-01 Obsoletes:  Requires:  Incompatibles:  Packages: VRTSvcs, VRTSvcsag, VRTSvcsw <- 3.5MP1

Alternatively, you can check the patching with either of the following commands:

# pkgparam -v VRTSvxfs | grep -i patch_info
PATCH_INFO_113206-03='Installed: Thu May 22 13:43:11 EST 2003 From: regis         Obsoletes:  Requires: Incompatibles:'
PATCH_INFO_113206-05='Installed: Thu Oct 23 12:12:21 EST 2003 From: mouth         Obsoletes:  Requires: Incompatibles:'
PATCH_INFO_113206-10='Installed: Fri Oct 31 17:30:56 EST 2003 From: mouth         Obsoletes:  Requires: Incompatibles:'

# modinfo | grep vx
22 101fe061 1188e8 256   1  vxio (VxVM 3.5s_p2.8 I/O driver)
24 10301b5c  1a734 252   1  vxdmp (VxVM 3.5s_p1.7_PointPatch1.1 DM)
25 10319d38    80f 257   1  vxspec (VxVM 3.5s_p2.8 control/status)
238 7830d6b0    a3b 253   1  vxportal (VxFS 3.5_REV-MP2d portal driver)
239 7830e000 10b99d  16   1  vxfs (VxFS 3.5_REV-MP2d,PID=113206-10)
248 78552000  10845 263   1  vxglm (VxGLM 3.5 (SunOS 5.8))
249 78562000   5a73 264   1  vxgms (VxGMS 3.5 (SunOS))


If you truss on the online of the vxfsckd process, you will notice an error, "Err#89 ENOSYS," which indicates "Operation not applicable" on the /dev/vxportal device.  See below for an example:

NOTE: The online entry point for the CFSfsckd is a script which just executes the binary /opt/VRTSvxfs/sbin/vxfsckd.

# truss -faeld /opt/VRTSvxfs/sbin/vxfsckd
Base time stamp:  1067648409.7012  [ Sat Nov  1 12:00:09 EST 2003 ]
18737/1:         0.0000 execve("/opt/VRTSvxfs/sbin/vxfsckd", 0xFFBEFA34, 0xFFBEFA3C)  argc = 1
18737/1:         argv: /opt/VRTSvxfs/sbin/vxfsckd
18737/1:         envp: _=/usr/bin/truss
...
18737/1:         0.0652 fork()                                          = 18739
18739/1:         0.0544 fork()          (returning as child ...)        = 18737
18739/1:         0.0922 setsid()                                        = 18739
18739/1:         0.0930 sigaction(SIGHUP, 0xFFBEF630, 0xFFBEF6B0)       = 0
18739/1:         0.1078 fork()                                          = 18742
18742/1:         0.0938 fork()          (returning as child ...)        = 18739
...
18742/1:         0.1209 open64("/dev/vxportal", O_RDWR)                 = 3
18742/1:         0.1265 ioctl(3, 0x56584684, 0xFFBEF9C8)                Err#89 ENOSYS
...
18742/1:         0.1334 llseek(0, 0, SEEK_CUR)                          = 413566
18742/1:         0.1336 _exit(-1)
18737/1:         0.1442 llseek(0, 0, SEEK_CUR)                          = 414049
18737/1:         0.1446 _exit(0)
18739/1:         0.1467 llseek(0, 0, SEEK_CUR)                          = 414049
18739/1:         0.1471 _exit(0)

On a good system, the truss will not finish as the daemon vxfsckd will remain running.

Remove the superfluous patches and install the extra patches to bring the system to a clean state.  That is, either completely running 3.5, or 3.5MP1 or 3.5MP2.

Not only is a mix of the patches not supported, but in most configurations, e.g. VERITAS Database Edition (tm) /Advanced Cluster, VERITAS SANPoint Foundation Suite (tm), etc, it does not work.