Video Screencast Help

Campus cluster: disks bad tagged

Created: 13 Mar 2013 • Updated: 14 Mar 2013 | 8 comments
This issue has been solved. See solution.

Hello,

¿is it possible to change a disk tag without stopping the vxvm? Lets say we have a 2 node cluster in 2 sites: Y and T. The dg has 8 disks and the tag of 2 of them are wrong:

- disk 00 is tagged as T when should be Y
- disk 01 is tagged as Y when should be T

Both disks are 50 GB big and the DG has 130GB of free space.

 

Questions:

Can we just remove the disk and reattach them? how (there are volumes on them)? 

Any easy way of exchanging the tags?

Regards,

joaquín

 

Operating Systems:
Discussion Filed Under:

Comments 8 CommentsJump to latest comment

TonyGriffiths's picture

Hi

Could you post a vxprint or vxdisk list, showing the examples of the tags ? I just wanted to check if these are disk tags or something else (disk media name, Disk access Name)

thanks

tony

mikebounds's picture

You don't need to reattach disks to change tags -  you just use rmtag and settag whilst the volumes are in use (mounted) - example:

vxdisk -g diskgroup rmtag site=T disk00
vxdisk -g diskgroup settag site=Y disk00

 

Mike

 

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

mikebounds's picture

If you meant can you change the diskmedia record - you can do this too - I think the only thing you can't change online is the volume name as this changes the access path, but even this does not require you to reattach disk (you would just umount, rename volume and mount using new path).  To change the diskmedia record name, you use vxedit - example:

vxedit -g testdg rename disk00 disk00atY

Mike

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

joagmv's picture

More info:

NODE2:~ # vxdisk listtag
DEVICE          NAME                            VALUE
ibm_ds8x000_1f00        site                            Y
ibm_ds8x000_1f01        site                            T // should be Y
ibm_ds8x001_8a02        site                            T
ibm_ds8x001_8a03        site                            T
ibm_ds8x001_8b00        site                            T
ibm_ds8x001_8b01        site                            Y // should be T
ibm_ds8x002_ec00        site                            Y
ibm_ds8x002_ed00        site                            Y

NODE2:~ # vxdg list
NAME         STATE           ID
shareddg     enabled,cds,siteconsistent 1339422132.11.NODE1

NODE2:~ # vxlist | grep ^dg -B1
TY   DISKGROUP   IMPORT    STATUS         SIZE      FREE ID
dg   shareddg    private   enabled     339.27g   139.75g 1339422132.11.NODE1

OK, I understand that I can retag the disks online. If I execute:

vxdisk -g shareddg rmtag site=T ibm_ds8x000_1f01
vxdisk -g shareddg settag site=Y ibm_ds8x000_1f01

Would the data of this disk copy to the rest of disks of site T to keep the mirror??? and if the answer is yes... is it possible because of the free space of the dg (I mean in that site)???

mikebounds's picture

Retagging disks will not move any data, but I see where you are coming from now, as the retag will probably fail if the retag would mean you have 2 plexes of the same volume with the same tag, and this depends on your volume layout, so please post "vxprint -thg shareddg".

If you need to move data the process will probably be something like:

  1. Disable sites/tags
  2. Move data (online) using subdisk move (or add third mirror and remove incorrect one)
  3. Enable sites/tags

Can you also provide output of "vxdg free"

Mike

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

joagmv's picture

 

Exactly it is what I meant (Im worry about the consistency of the mirror)!
 
Every volume has one plex in one site (T and Y):
 
NODE2:~ # vxprint -thg shareddg
DG NAME         NCONFIG      NLOG     MINORS   GROUP-ID
ST NAME         STATE        DM_CNT   SPARE_CNT         APPVOL_CNT
DM NAME         DEVICE       TYPE     PRIVLEN  PUBLEN   STATE
RV NAME         RLINK_CNT    KSTATE   STATE    PRIMARY  DATAVOLS  SRL
RL NAME         RVG          KSTATE   STATE    REM_HOST REM_DG    REM_RLNK
CO NAME         CACHEVOL     KSTATE   STATE
VT NAME         RVG          KSTATE   STATE    NVOLUME
V  NAME         RVG/VSET/CO  KSTATE   STATE    LENGTH   READPOL   PREFPLEX UTYPE
PL NAME         VOLUME       KSTATE   STATE    LENGTH   LAYOUT    NCOL/WID MODE
SD NAME         PLEX         DISK     DISKOFFS LENGTH   [COL/]OFF DEVICE   MODE
SV NAME         PLEX         VOLNAME  NVOLLAYR LENGTH   [COL/]OFF AM/NM    MODE
SC NAME         PLEX         CACHE    DISKOFFS LENGTH   [COL/]OFF DEVICE   MODE
DC NAME         PARENTVOL    LOGVOL
SP NAME         SNAPVOL      DCO
EX NAME         ASSOC        VC                       PERMS    MODE     STATE
SR NAME         KSTATE
 
dg shareddg     default      default  7000     1339422132.11.NODE1
 
sr T     ACTIVE
sr Y       ACTIVE
 
dm ibm_ds8x000_1f00 ibm_ds8x000_1f00 auto 65536 104661936 -
dm ibm_ds8x000_1f01 ibm_ds8x000_1f01 auto 65536 41767456 -
dm ibm_ds8x001_8a02 ibm_ds8x001_8a02 auto 65536 104661936 -
dm ibm_ds8x001_8a03 ibm_ds8x001_8a03 auto 65536 104661936 -
dm ibm_ds8x001_8b00 ibm_ds8x001_8b00 auto 65536 104661936 -
dm ibm_ds8x001_8b01 ibm_ds8x001_8b01 auto 65536 41767456 -
dm ibm_ds8x002_ec00 ibm_ds8x002_ec00 auto 65536 104661936 -
dm ibm_ds8x002_ed00 ibm_ds8x002_ed00 auto 65536 104661936 -
 
v  ASCS01_lv    -            ENABLED  ACTIVE   4194304  SITEREAD  -        fsgen
pl ASCS01_lv-01 ASCS01_lv    ENABLED  ACTIVE   4194304  CONCAT    -        RW
sd ibm_ds8x001_8b00-09 ASCS01_lv-01 ibm_ds8x001_8b00 31728640 4194304 0 ibm_ds8x001_8b00 ENA
pl ASCS01_lv-02 ASCS01_lv    ENABLED  ACTIVE   4194304  CONCAT    -        RW
sd ibm_ds8x000_1f00-09 ASCS01_lv-02 ibm_ds8x000_1f00 31728640 4194304 0 ibm_ds8x000_1f00 ENA
dc ASCS01_lv_dco ASCS01_lv   ASCS01_lv_dcl
v  ASCS01_lv_dcl -           ENABLED  ACTIVE   67840    SITEREAD  -        gen
pl ASCS01_lv_dcl-01 ASCS01_lv_dcl ENABLED ACTIVE 67840  CONCAT    -        RW
sd ibm_ds8x001_8b00-10 ASCS01_lv_dcl-01 ibm_ds8x001_8b00 35922944 67840 0 ibm_ds8x001_8b00 ENA
pl ASCS01_lv_dcl-02 ASCS01_lv_dcl ENABLED ACTIVE 67840  CONCAT    -        RW
sd ibm_ds8x000_1f00-10 ASCS01_lv_dcl-02 ibm_ds8x000_1f00 35922944 67840 0 ibm_ds8x000_1f00 ENA
 
v  CARGAS_lv    -            ENABLED  ACTIVE   41943040 SITEREAD  -        fsgen
pl CARGAS_lv-03 CARGAS_lv    ENABLED  ACTIVE   41943040 CONCAT    -        RW
sv CARGAS_lv-S01 CARGAS_lv-03 CARGAS_lv-L01 1  175584   0         2/2      ENA
sv CARGAS_lv-S02 CARGAS_lv-03 CARGAS_lv-L02 1  41591872 175584    2/2      ENA
sv CARGAS_lv-S03 CARGAS_lv-03 CARGAS_lv-L03 1  175584   41767456  2/2      ENA
dc CARGAS_lv_dco CARGAS_lv   CARGAS_lv_dcl
v  CARGAS_lv_dcl -           ENABLED  ACTIVE   67968    SITEREAD  -        gen
pl CARGAS_lv_dcl-01 CARGAS_lv_dcl ENABLED ACTIVE 67968  CONCAT    -        RW
sd ibm_ds8x001_8b00-13 CARGAS_lv_dcl-01 ibm_ds8x001_8b00 101110368 67968 0 ibm_ds8x001_8b00 ENA
pl CARGAS_lv_dcl-02 CARGAS_lv_dcl ENABLED ACTIVE 67968  CONCAT    -        RW
sd ibm_ds8x000_1f00-13 CARGAS_lv_dcl-02 ibm_ds8x000_1f00 101110368 67968 0 ibm_ds8x000_1f00 ENA
 
v  CARGAS_lv-L01 -           ENABLED  ACTIVE   175584   SITEREAD  -        fsgen
pl CARGAS_lv-P01 CARGAS_lv-L01 ENABLED ACTIVE  175584   CONCAT    -        RW
sd ibm_ds8x000_1f01-02 CARGAS_lv-P01 ibm_ds8x000_1f01 0 175584 0  ibm_ds8x000_1f01 ENA
pl CARGAS_lv-P02 CARGAS_lv-L01 ENABLED ACTIVE  175584   CONCAT    -        RW
sd ibm_ds8x000_1f00-12 CARGAS_lv-P02 ibm_ds8x000_1f00 100934784 175584 0 ibm_ds8x000_1f00 ENA
 
v  CARGAS_lv-L02 -           ENABLED  ACTIVE   41591872 SITEREAD  -        fsgen
pl CARGAS_lv-P03 CARGAS_lv-L02 ENABLED ACTIVE  41591872 CONCAT    -        RW
sd ibm_ds8x000_1f01-03 CARGAS_lv-P03 ibm_ds8x000_1f01 175584 41591872 0 ibm_ds8x000_1f01 ENA
pl CARGAS_lv-P04 CARGAS_lv-L02 ENABLED ACTIVE  41591872 CONCAT    -        RW
sd ibm_ds8x001_8b01-02 CARGAS_lv-P04 ibm_ds8x001_8b01 0 41591872 0 ibm_ds8x001_8b01 ENA
 
v  CARGAS_lv-L03 -           ENABLED  ACTIVE   175584   SITEREAD  -        fsgen
pl CARGAS_lv-P05 CARGAS_lv-L03 ENABLED ACTIVE  175584   CONCAT    -        RW
sd ibm_ds8x001_8b00-12 CARGAS_lv-P05 ibm_ds8x001_8b00 100934784 175584 0 ibm_ds8x001_8b00 ENA
pl CARGAS_lv-P06 CARGAS_lv-L03 ENABLED ACTIVE  175584   CONCAT    -        RW
sd ibm_ds8x001_8b01-03 CARGAS_lv-P06 ibm_ds8x001_8b01 41591872 175584 0 ibm_ds8x001_8b01 ENA
 
v  DVEBMGS00_lv -            ENABLED  ACTIVE   23068672 SITEREAD  -        fsgen
pl DVEBMGS00_lv-01 DVEBMGS00_lv ENABLED ACTIVE 23068672 CONCAT    -        RW
sd ibm_ds8x001_8b00-05 DVEBMGS00_lv-01 ibm_ds8x001_8b00 8524288 12582912 0 ibm_ds8x001_8b00 ENA
sd ibm_ds8x001_8b00-03 DVEBMGS00_lv-01 ibm_ds8x001_8b00 0 8524288 12582912 ibm_ds8x001_8b00 ENA
sd ibm_ds8x001_8b00-04 DVEBMGS00_lv-01 ibm_ds8x001_8b00 98973312 1961472 21107200 ibm_ds8x001_8b00 ENA
pl DVEBMGS00_lv-02 DVEBMGS00_lv ENABLED ACTIVE 23068672 CONCAT    -        RW
sd ibm_ds8x000_1f00-05 DVEBMGS00_lv-02 ibm_ds8x000_1f00 8524288 12582912 0 ibm_ds8x000_1f00 ENA
sd ibm_ds8x000_1f00-03 DVEBMGS00_lv-02 ibm_ds8x000_1f00 0 8524288 12582912 ibm_ds8x000_1f00 ENA
sd ibm_ds8x000_1f00-04 DVEBMGS00_lv-02 ibm_ds8x000_1f00 98973312 1961472 21107200 ibm_ds8x000_1f00 ENA
dc DVEBMGS00_lv_dco DVEBMGS00_lv DVEBMGS00_lv_dcl
v  DVEBMGS00_lv_dcl -        ENABLED  ACTIVE   67840    SITEREAD  -        gen
pl DVEBMGS00_lv_dcl-01 DVEBMGS00_lv_dcl ENABLED ACTIVE 67840 CONCAT -      RW
sd ibm_ds8x001_8b00-06 DVEBMGS00_lv_dcl-01 ibm_ds8x001_8b00 21107200 67840 0 ibm_ds8x001_8b00 ENA
pl DVEBMGS00_lv_dcl-02 DVEBMGS00_lv_dcl ENABLED ACTIVE 67840 CONCAT -      RW
sd ibm_ds8x000_1f00-06 DVEBMGS00_lv_dcl-02 ibm_ds8x000_1f00 21107200 67840 0 ibm_ds8x000_1f00 ENA
 
v  SAPMNT_UEP_lv -           ENABLED  ACTIVE   10485760 SITEREAD  -        fsgen
pl SAPMNT_UEP_lv-01 SAPMNT_UEP_lv ENABLED ACTIVE 10485760 CONCAT  -        RW
sd ibm_ds8x001_8b00-07 SAPMNT_UEP_lv-01 ibm_ds8x001_8b00 21175040 10485760 0 ibm_ds8x001_8b00 ENA
pl SAPMNT_UEP_lv-02 SAPMNT_UEP_lv ENABLED ACTIVE 10485760 CONCAT  -        RW
sd ibm_ds8x000_1f00-07 SAPMNT_UEP_lv-02 ibm_ds8x000_1f00 21175040 10485760 0 ibm_ds8x000_1f00 ENA
dc SAPMNT_UEP_lv_dco SAPMNT_UEP_lv SAPMNT_UEP_lv_dcl
v  SAPMNT_UEP_lv_dcl -       ENABLED  ACTIVE   67840    SITEREAD  -        gen
pl SAPMNT_UEP_lv_dcl-01 SAPMNT_UEP_lv_dcl ENABLED ACTIVE 67840 CONCAT -    RW
sd ibm_ds8x001_8b00-08 SAPMNT_UEP_lv_dcl-01 ibm_ds8x001_8b00 31660800 67840 0 ibm_ds8x001_8b00 ENA
pl SAPMNT_UEP_lv_dcl-02 SAPMNT_UEP_lv_dcl ENABLED ACTIVE 67840 CONCAT -    RW
sd ibm_ds8x000_1f00-08 SAPMNT_UEP_lv_dcl-02 ibm_ds8x000_1f00 31660800 67840 0 ibm_ds8x000_1f00 ENA
 
v  export_usr_sap_trans_lv - ENABLED  ACTIVE   128901120 SITEREAD -        fsgen
pl export_usr_sap_trans_lv-01 export_usr_sap_trans_lv ENABLED ACTIVE 128901120 CONCAT - RW
sd ibm_ds8x001_8b00-01 export_usr_sap_trans_lv-01 ibm_ds8x001_8b00 35990784 62914560 0 ibm_ds8x001_8b00 ENA
sd ibm_ds8x001_8b00-11 export_usr_sap_trans_lv-01 ibm_ds8x001_8b00 101178336 3483600 62914560 ibm_ds8x001_8b00 ENA
sd ibm_ds8x001_8a02-01 export_usr_sap_trans_lv-01 ibm_ds8x001_8a02 0 62502960 66398160 ibm_ds8x001_8a02 ENA
pl export_usr_sap_trans_lv-02 export_usr_sap_trans_lv ENABLED ACTIVE 128901120 CONCAT - RW
sd ibm_ds8x000_1f00-01 export_usr_sap_trans_lv-02 ibm_ds8x000_1f00 35990784 62914560 0 ibm_ds8x000_1f00 ENA
sd ibm_ds8x000_1f00-11 export_usr_sap_trans_lv-02 ibm_ds8x000_1f00 101178336 3483600 62914560 ibm_ds8x000_1f00 ENA
sd ibm_ds8x002_ec00-01 export_usr_sap_trans_lv-02 ibm_ds8x002_ec00 0 62502960 66398160 ibm_ds8x002_ec00 ENA
dc export_usr_sap_trans_lv_dco export_usr_sap_trans_lv export_usr_sap_trans_lv_dcl
v  export_usr_sap_trans_lv_dcl - ENABLED ACTIVE 67968   SITEREAD  -        gen
pl export_usr_sap_trans_lv_dcl-01 export_usr_sap_trans_lv_dcl ENABLED ACTIVE 67968 CONCAT - RW
sd ibm_ds8x001_8b00-02 export_usr_sap_trans_lv_dcl-01 ibm_ds8x001_8b00 98905344 67968 0 ibm_ds8x001_8b00 ENA
pl export_usr_sap_trans_lv_dcl-02 export_usr_sap_trans_lv_dcl ENABLED ACTIVE 67968 CONCAT - RW
sd ibm_ds8x000_1f00-02 export_usr_sap_trans_lv_dcl-02 ibm_ds8x000_1f00 98905344 67968 0 ibm_ds8x000_1f00 ENA
 
v  nfs          -            ENABLED  ACTIVE   204800   SITEREAD  -        fsgen
pl nfs-01       nfs          ENABLED  ACTIVE   204800   CONCAT    -        RW
sd ibm_ds8x001_8a03-01 nfs-01 ibm_ds8x001_8a03 0 204800 0         ibm_ds8x001_8a03 ENA
pl nfs-02       nfs          ENABLED  ACTIVE   204800   CONCAT    -        RW
sd ibm_ds8x002_ed00-01 nfs-02 ibm_ds8x002_ed00 0 204800 0         ibm_ds8x002_ed00 ENA
dc nfs_dco      nfs          nfs_dcl
v  nfs_dcl      -            ENABLED  ACTIVE   67840    SITEREAD  -        gen
pl nfs_dcl-01   nfs_dcl      ENABLED  ACTIVE   67840    CONCAT    -        RW
sd ibm_ds8x001_8a03-02 nfs_dcl-01 ibm_ds8x001_8a03 204800 67840 0 ibm_ds8x001_8a03 ENA
pl nfs_dcl-02   nfs_dcl      ENABLED  ACTIVE   67840    CONCAT    -        RW
sd ibm_ds8x002_ed00-02 nfs_dcl-02 ibm_ds8x002_ed00 204800 67840 0 ibm_ds8x002_ed00 ENA
 
 
NODE2:~ # vxdg free
GROUP        DISK         DEVICE       TAG          OFFSET    LENGTH    FLAGS
shareddg     ibm_ds8x001_8a02 ibm_ds8x001_8a02 ibm_ds8x001_8a02 62502960  42158976  -
shareddg     ibm_ds8x001_8a03 ibm_ds8x001_8a03 ibm_ds8x001_8a03 272640    104389296 -
shareddg     ibm_ds8x002_ec00 ibm_ds8x002_ec00 ibm_ds8x002_ec00 62502960  42158976  -
shareddg     ibm_ds8x002_ed00 ibm_ds8x002_ed00 ibm_ds8x002_ed00 272640    104389296 -
mikebounds's picture

So to summarise:

  • As disks are tagged wrong, then the CARGAS_lv layered volume has both plexes that are actually on the same array.
  • You have 2 disks, one on each array - ibm_ds8x001_8a03 and  ibm_ds8x002_ed00 which only contain one small volume (called "nfs") so they have lots of free space.

So this is what I would do:

  1. Evacuate incorrectly tagged disks onto new disks:
    vxexac -g sharedg ibm_ds8x000_1f01 ibm_ds8x002_ed00
    vxexac -g sharedg ibm_ds8x001_8b01 ibm_ds8x001_8a03
     
  2. Remove tags from incorrectly tagged disks:
    vxdisk -g shareddg rmtag site=T ibm_ds8x000_1f01

    vxdisk -g shareddg rmtag site=Y ibm_ds8x001_8b01
     

  3. Add correct tags:
    vxdisk -g shareddg settag site=Y ibm_ds8x000_1f01
    vxdisk -g shareddg settag site=T ibm_ds8x001_8b01
     

If you try to remove tags on a disks that contains volumes it will fail and you could get round this by turning off allsites and siteconsistent flag on CARGAS_lv volume:

vxvol -g sharedg set allsites=off CARGAS_lv
vxvol -g sharedg set siteconsistent=off CARGAS_lv
 

but this does not get round your issue of the volume having 2 plexes on the same array, so you need to move the data

Mike

 

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

SOLUTION
joagmv's picture

That looks like the solution I was looking for. I dont know when I will get "permission" to execute but I will post the results.

Thanks very much mike!