SFCFS 6.0 rolling upgrade fails if some of disks in shared disk group has clone flag set

Article:TECH189944  |  Created: 2012-05-29  |  Updated: 2012-10-21  |  Article URL http://www.symantec.com/docs/TECH189944
Article Type
Technical Solution


Environment

Issue



Unable to import CVM group during Rolling upgrade from 5.0 RP1 to 6.0 . CVM fails to online on the Upgraded node after phase 1.

 


Error



May 25 00:04:24 node2 Had[21342]: VCS ERROR V-16-1-1005 (node2) CVMCluster:cvm_clus:monitor:node - state: out of cluster reason: Disk for disk group not found: retry to add a node failed    

Environment



SFCFSHA 6.0

SF 5.1

SF 5.1SP1

 

 


Solution



Workaround

Scenario I:  If installation program upgrades CVM slave node first then CVM group join will fail on slave node.

-           Run vxdisk –o alldgs list |grep shared on both nodes and compare outputs

-           Check if hardware disk mirroring solution from Storage array vendor is configured on server and ensure that disk group does not contain mix of clone and non-clone disks.

-           If system does not use hardware disk mirroring solution, run following command to clear clone flag.

#vxdisk set <da_name> clone=off

OR

-           Contact Symantec technical Support if hardware disk mirroring solution installed system for further system verification

-           Run vxdisk scandisks on upgraded node

-           Clear CVM group fault on slave node

-           Online CVM group on slave node

-           Complete rest of rolling upgrade as per 6.0 installation guide

 

Alternativley, install the installer hot-fix prior to upgrade (detailed below) to avoid this scenario.

 

 

Scenario II:  If installation program upgrades CVM master node first then CVM group will fault on all slave nodes.

      -           Offline CFS/application group on master node

-           Offline CVM group on master node

-           Check if hardware disk mirroring solution from Storage array vendor is configured on server and ensure that disk group does not contain mix of clone and non-clone disks.

-           If system does not use hardware disk mirroring solution, run following command to clear clone flag.

#vxdisk set <da_name> clone=off

OR

-           Contact Symantec technical Support if hardware disk mirroring solution installed system for further system verification

-           Clear CVM group fault on slave node(s)

-           Run vxdisk scandisks on slave node(s)

-           Online CVM group on all nodes

-           Clear CFS mount resources and mount them back on all nodes

-           Complete rest of rolling upgrade as 6.0 installation guide

 

Alternativley, install the installer hot-fix  prior to upgrade (detailed below) to avoid this scenario.

 

  

SOLUTION: 

 

Please install the installer hot-fix to avoid above 2 scenarios. With the hotfix installed the installer script will print the below message and will proceed only after the issue is fixed. There by preventing post upgrade problems.

 

The following errors were discovered on the systems:

CPI ERROR V-9-40-4887 Kernel Release 2.6.18-128.el5 found on host1 is not supported. Only Kernel Release 2.6.18-194.el5(RHEL5 U5) or

higher is supported on RHEL5. Upgrade the OS to RHEL5 Update5 or higher in order to install this product

 

CPI ERROR V-9-40-5441 The following disk group(s) have mix of regular and clone disk on host1:

            datadg

please verify disk information and unset clone flag before upgrade.

 

CPI ERROR V-9-40-5441 The following disk group(s) have mix of regular and clone disk on host1:

            datadg

please verify disk information and unset clone flag before upgrade

 

-           Check if hardware disk mirroring solution from Storage array vendor is configured on server and ensure that disk group does not contain mix of clone and non-clone disks.

-           If system does not use hardware disk mirroring solution, run following command to clear clone flag.

#vxdisk set <da_name> clone=off

-           Re-run installer program and complete product upgrade

OR

-           Contact Symantec technical Support if hardware disk mirroring solution installed system for further system verification

 

Symantec engineering opened e2815517 to prevent mixing of clone & non-clone disks in a DiskGroup.

 

Hotfix location

CPI Installer Hotfix Patch for 6.0:          https://sort.symantec.com/patch/detail/6403

CPI Installer Hotfix Patch for 6.0RP1:  https://sort.symantec.com/patch/detail/6402


Supplemental Materials

SourceETrack
Value2819520


Article URL http://www.symantec.com/docs/TECH189944


Terms of use for this information are found in Legal Notices