Diskgroups with Powerpath controlled disks configured as 'foreign devices' fail to import after an upgrade to 5.0MP3

Article:TECH145748  |  Created: 2010-12-07  |  Updated: 2010-12-07  |  Article URL http://www.symantec.com/docs/TECH145748
NOTE: If you are experiencing this particular known issue, we recommend that you Subscribe to receive email notification each time this article is updated. Subscribers will be the first to learn about any releases, status changes, workarounds or decisions made.
Article Type
Technical Solution


Issue



Diskgroup will fail to import after an upgrade to 5.0MP3 if containing Powerpath managed devices configured as "foreign" .


Error



Disks are listed in error state; diskgroup fails to import and messages logged to syslog

root@hostname:/# vxdisk list

DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            error
emcpower1c   simple          -            -            error
emcpower2c   simple          -            -            error
emcpower3c   simple          -            -            error
emcpower4c   simple          -            -            error
emcpower5c   simple          -            -            error
emcpower6c   simple          -            -            error
emcpower7c   simple          -            -            error
 
 
vxdg import testdg
VxVM vxdg ERROR V-5-1-10978 Disk group testdg: import failed:
No valid disk found containing disk group
 
tail -f /var/adm/messages
Nov 19 13:55:35 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower7c: kernel error 6
Nov 19 13:55:35 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower6c: kernel error 6

Environment



Powerpath + devices configured as "foreign" + SFHA 5.0MP3

An upgrade from either 4.x or 5.0 , 5.0MP1 to  5.0MP3  and above will trigger this problem


Cause



An unexpected interaction caused by the Powerpath library "libvxpp.so" renders the disk to go to "error" state leading to the failure


Solution



4.1 introduced full-fledged support for  Third Party Driver (TPD).  Subsequently , there was no longer a need for TPD controlled devices to be configured as “foreign” devices and support was dropped in 5.0.x versions.

 
The workaround for the above issue is to exclude the library “libvxpp.so” . A documentation bug will be filed to explicitly  indicate the lack of support for TPD controlled devices configured as “foreign” .
 
The 5.0MP3  Installation Guide references the requirement to convert "foreign" devices to 'simple' prior to upgrading to 5.0MP3  on Page 216 of the following document :
 
However this does not explicitly state the lack of support - the documentation bug will be addressed in a future release
 
ILLUSTRATION OF THE WORKAROUND:
 
modinfo | grep vx
 59 7872e000  3e06e 286   1  vxdmp (VxVM 5.0MP3: DMP Driver)
 61 7876e000 218520 287   1  vxio (VxVM 5.0MP3 I/O driver)
 63 786c306e    d10 288   1  vxspec (VxVM 5.0MP3 control/status driv)
298 782eb08d    c6b 289   1  vxportal (VxFS 5.0_REV-5.0A55_sol portal )
299 78de0000 1b9d4f   8   1  vxfs (VxFS 5.0_REV-5.0A55_sol SunOS 5)
 
root@hostname:/# vxdg list
NAME         STATE           ID
testdg       enabled              1289330809.22.sprsv245b4-13
 
root@hostname:/# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            error
emcpower1c   simple          -            -            error
emcpower2c   simple          -            -            error
emcpower3c   simple          -            -            error
emcpower4c   simple          disk1        testdg       online
emcpower5c   simple          disk2        testdg       online
emcpower6c   simple          -            -            error
emcpower7c   simple          -            -            error
 
root@hostname:/# vxdisk list emcpower4c
Device:    emcpower4c
devicetag: emcpower4c
type:      simple
hostid:    sprsv245b4-13
disk:      name=disk1 id=1289330752.18.sprsv245b4-13
group:     name=testdg id=1289330809.22.sprsv245b4-13
flags:     online ready private foreign autoimport imported
pubpaths:  block=/dev/dsk/emcpower4c char=/dev/rdsk/emcpower4c
guid:      -
udid:      DGC%5FRAID%205%5FAPM00064800091%5F60060160C6821800721EF93504EBDC11
site:      -
version:   2.1
iosize:    min=512 (bytes) max=2048 (blocks)
public:    slice=0 offset=65537 len=7102143 disk_offset=0
private:   slice=0 offset=1 len=65536 disk_offset=0
update:    time=1290023837 seqno=0.14
ssb:       actual_seqno=0.0
headers:   0 248
configs:   count=1 len=48346
logs:      count=1 len=7325
Defined regions:
 config   priv 000017-000247[000231]: copy=01 offset=000000 enabled
 config   priv 000249-048363[048115]: copy=01 offset=000231 enabled
 log      priv 048364-055688[007325]: copy=01 offset=000000 enabled
Multipathing information:
numpaths:   1
emcpower4c      state=enabled
 
 !! DEPORT DISKGROUP 
root@hostname:/# vxdg deport testdg
 
!! IMPORT DISKGROUP 
root@hostname:/# vxdg import testdg
VxVM vxdg ERROR V-5-1-10978 Disk group testdg: import failed:
No valid disk found containing disk group
 
!! messages file log the errors for the disks
root@hostname:/# tail -f /var/adm/messages
Nov 19 13:55:35 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower7c: kernel error 6
Nov 19 13:55:35 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower6c: kernel error 6
Nov 19 13:55:55 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower1c: kernel error 6
 
 
!! Disks are listed in "error" state
 
root@hostname:/# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            error
emcpower1c   simple          -            -            error
emcpower2c   simple          -            -            error
emcpower3c   simple          -            -            error
emcpower4c   simple          -            -            error
emcpower5c   simple          -            -            error
emcpower6c   simple          -            -            error
emcpower7c   simple          -            -            error
 
 !! Exclude the Powerpath library
root@hostname:/# vxddladm excludearray libname=libvxpp.so
 
root@hostname:/# vxddladm listexclude
 
The Diskarrays excluded
-----------------------
 
Based on Library names:
-----------------------
                libvxpp.so
 
Based on VID, PID Combination:
------------------------------
 
!! Execute vxdctl enable to scan devices
 
root@hostname:/# vxdctl enable
root@hostname :/# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            online invalid
emcpower1c   simple          -            -            online invalid
emcpower2c   simple          -            -            online
emcpower3c   simple          -            -            online
emcpower4c   simple          -            -            online
emcpower5c   simple          -            -            online
emcpower6c   simple          -            -            online
emcpower7c   simple          -            -            online invalid
 
!! Retry import of diskgroup
 
root@hostname:/# vxdg import testdg
 
!! Diskgroup is successfully imported
DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            online invalid
emcpower1c   simple          -            -            online invalid
emcpower2c   simple          -            -            online
emcpower3c   simple          -            -            online
emcpower4c   simple          disk1        testdg       online
emcpower5c   simple          disk2        testdg       online
emcpower6c   simple          -            -            online
emcpower7c   simple          -            -            online invalid

Supplemental Materials

SourceETrack
Value2206432
Description

Solaris:50MP3 Admin Guide: Need explicit statement regarding non-support of "foreign devices" for TPD controlled devices ( Pg 92)



Article URL http://www.symantec.com/docs/TECH145748


Terms of use for this information are found in Legal Notices