Video Screencast Help
Symantec to Separate Into Two Focused, Industry-Leading Technology Companies. Learn more.

Help to create a share DG

Created: 25 Oct 2012 • Updated: 26 Oct 2012 | 12 comments
This issue has been solved. See solution.

Hello

I am new in VCS using the CVMVolDg concepts.

Please take a look at my steps to create my share disk group and then present it to VCS.

Before I update my production VCS, could anyone point any possible mistakes ?

1) In my VCS Master Node (vxdctl -c mode), I create a dg and turn it to a share using (vxdg deport arch1dg / vxdg -s import arch1dg)

2) Listing the dgs:

svmediador2:/# vxdg list
NAME         STATE           ID
bgw1dg       enabled,shared       1338943751.50.svmediador1
arch1dg      enabled,shared       1351182830.67.svmediador2
ora1dg        enabled,shared       1338925017.17.svmediador1
 

3) After this, was created the Volume -  vxassist -g arch1dg make vol01 100g

4) Then, make the FS - mkfs -F vxfs /dev/vx/rdsk/arch1dg/vol01

5) Testing, I can mount the filesystem in both VCS cluster nodes, but not at the same time. One mount at a time.

6) Configuring this arch1dg at VCS, enabling to mount at the both nodes, some parts of my main.cf is:

6.1) INSERTING THE ARCH1DG IN THE CVM GROUP:

group cvm (
    SystemList = { svmediador1 = 0, svmediador2 = 1 }
    AutoFailOver = 0
    Parallel = 1
    AutoStartList = { svmediador1, svmediador2 }
    )

    CFSfsckd vxfsckd (
        ActivationMode @svmediador1 = { bgw1dg = sw, arch1dg = sw, ora1dg = sw}
        ActivationMode @svmediador2 = { bgw1dg = sw, arch1dg = sw, ora1dg = sw}
        )

    CVMCluster cvm_clus (
        CVMClustName = MediatorCluster
        CVMNodeId = { svmediador1 = 0, svmediador2 = 1 }
        CVMTransport = gab
        CVMTimeout = 200
        )

    CVMVxconfigd cvm_vxconfigd (
        Critical = 0
        CVMVxconfigdArgs = { syslog }
        )

    cvm_clus requires cvm_vxconfigd
    vxfsckd requires cvm_clus

6.2) INSERTING MY NEW ARCH1DG IN THE ora_DG GROUP:

group ora_DG (
    SystemList = { svmediador1 = 0, svmediador2 = 1 }
    AutoFailOver = 0
    Parallel = 1
    AutoStartList = { svmediador1, svmediador2 }
    )

    CFSMount cfsmount4 (
        Critical = 0
        MountPoint = "/var/opt/mediation/ora"
        BlockDevice = "/dev/vx/dsk/ora1dg/vol01"
        NodeList = { svmediador1, svmediador2 }
        )
    CFSMount cfsmount13 (
        Critical = 0
        MountPoint = "/oraarch"
        BlockDevice = "/dev/vx/dsk/arch1dg/vol01"
        NodeList = { svmediador1, svmediador2 }
        )

    CVMVolDg cvmvoldg4 (
        Critical = 0
        CVMDiskGroup = ora1dg
        CVMActivation @svmediador1 = sw
        CVMActivation @svmediador2 = sw
        )

    CVMVolDg cvmvoldg13 (
        Critical = 0
        CVMDiskGroup = arch1dg
        CVMActivation @svmediador1 = sw
        CVMActivation @svmediador2 = sw
        )

    requires group cvm online local firm
    cfsmount4 requires cvmvoldg4
    cfsmount13 requires cvmvoldg13

6.3) Oracle1 Group REQUIRES THE ora_DG

group Oracle1 (
    SystemList = { svmediador1 = 1, svmediador2 = 2 }
    AutoStartList = { svmediador1 }
    )

    IPMultiNIC Oracle1_IP (
        Address = "192.168.4.98"
        NetMask = "255.255.255.0"
        MultiNICResName = MultiNICA
        IfconfigTwice = 1
        )

    ORACLE bgw (
        )

    Proxy Oracle1_NIC_PROXY (
        TargetResName = MultiNICA
        )

    requires group ora_DG online local firm
    Oracle1_IP requires Oracle1_NIC_PROXY
    bgw requires Oracle1_IP

7) Did I forget anything ? This mess is going to work?

Thanks a lot

Alexandre Andrich

 

 

 

 

 

 

Comments 12 CommentsJump to latest comment

mikebounds's picture

Looks ok - a couple of points:

For the CVMVolDg agent, the CVMVolume attribute is required so you should list at least one volume in this attribute.

You can create a shared diskgroup using "vxdg -s init .... " if you want, rather than created as non-shared and then converting.

Mike

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

andrich's picture

Mr. Mikebounds

I am not seeing any CVMVolume attribute specified in the main.cf.

I am just inserting a new dg in a working configuration.

Take a look in the other existing group:

group lic_DG (
    SystemList = { svmediador1 = 0, svmediador2 = 1 }
    AutoFailOver = 0
    Parallel = 1
    AutoStartList = { svmediador1, svmediador2 }
    )

    CFSMount cfsmount5 (
        Critical = 0
        MountPoint = "/var/opt/sentinel"
        BlockDevice = "/dev/vx/dsk/lic1dg/vol01"
        NodeList = { svmediador1, svmediador2 }
        )

    CFSMount cfsmount6 (
        Critical = 0
        MountPoint = "/var/opt/mediation/fmmdb"
        BlockDevice = "/dev/vx/dsk/fmm1dg/vol01"
        NodeList = { svmediador1, svmediador2 }
        )

    CVMVolDg cvmvoldg5 (
        Critical = 0
        CVMDiskGroup = lic1dg
        CVMActivation @svmediador1 = sw
        CVMActivation @svmediador2 = sw
        )

    CVMVolDg cvmvoldg6 (
        Critical = 0
        CVMDiskGroup = fmm1dg
        CVMActivation @svmediador1 = sw
        CVMActivation @svmediador2 = sw
        )

    requires group cvm online local firm
    cfsmount5 requires cvmvoldg5
    cfsmount6 requires cvmvoldg6

Is this attibute a prerequisite or my new mount will be work any way?

Thanks

Alexandre Andrich

 

Paresh Bafna's picture

Do you have MultiNICA resource as part of separate group? Could you share that config as well?

Thanks and Regards,
Paresh Bafna

andrich's picture

Yes, Mr. Bafna

Thats my Network Group.

 

group Network (
    SystemList = { svmediador1 = 1, svmediador2 = 2 }
    Parallel = 1
    AutoStartList = { svmediador1, svmediador2 }
    )

    MultiNICA MultiNICA (
        Device @svmediador1 = { e1000g0 = "192.168.4.93",
             e1000g2 = "192.168.4.93" }
        Device @svmediador2 = { e1000g0 = "192.168.4.94",
             e1000g2 = "192.168.4.94" }
        NetMask = "255.255.255.0"
        ArpDelay = 5
        RouteOptions = "192.168.4.1"
        IfconfigTwice = 1
        NetworkHosts = { "192.168.4.1" }
        )

    Phantom Phantom (
        )

 

 

andrich's picture

Other point:

Do I have to deport my SHARED DG before start the VCS?

Thats my dgs in this moment in both nodes:

svmediador1:/# vxdisk -o alldgs list
DEVICE       TYPE            DISK         GROUP        STATUS

emcpower0s2  auto:sliced     bgw1dgemcpower0  bgw1dg       online shared
emcpower3s2  auto:cdsdisk    -            (fendg)      online
emcpower4s2  auto:cdsdisk    -            (fendg)      online
emcpower5s2  auto:cdsdisk    -            (fendg)      online
emcpower8s2  auto:sliced     ora1dgemcpower8  ora1dg       online shared
emcpower13s2 auto:sliced     arch1dgemcpower13  arch1dg      online shared

svmediador1:/# vxdg list
NAME         STATE           ID
arch1dg      enabled,shared       1351182830.67.svmediador2
bgw1dg       enabled,shared       1338925892.34.svmediador1
ora1dg       enabled,shared       1338925017.17.svmediador1

 

svmediador2:/# vxdisk -o alldgs list
DEVICE       TYPE            DISK         GROUP        STATUS
emcpower0s2  auto:sliced     bgw1dgemcpower0  bgw1dg       online shared
emcpower1s2  auto:cdsdisk    -            (fendg)      online
emcpower6s2  auto:cdsdisk    -            (fendg)      online
emcpower10s2 auto:cdsdisk    -            (fendg)      online
emcpower11s2 auto:sliced     ora1dgemcpower8  ora1dg       online shared
emcpower13s2 auto:sliced     arch1dgemcpower13  arch1dg      online shared

svmediador2:/# vxdg list
NAME         STATE           ID
arch1dg      enabled,shared       1351182830.67.svmediador2
bgw1dg       enabled,shared       1338925892.34.svmediador1
ora1dg       enabled,shared       1338925017.17.svmediador1
 

 

 

 

 

 

mikebounds's picture

According to the bundled agents guide, the CVMVolume attibribute is a required attribute and so it must be configured.  I have never tried NOT configuring this attribute, but I would have though the resource should not work without it because I believe the agent does a "dd" read of the volume to determine the health of the resource.  You can see this attribute several ways:

  1. Looks in types file (CVMTypes.cf usually)
  2. Run hatype -display CVMVolDg
  3. Run hares -display cvmvoldg5 (or cvmvoldg6)

You should NOT deport diskgroup before started VCS as the CVMVolDg resource does not import the diskgroup, it only enables it, and it must be imported as a shared diskgroup as it is shown to be now.

What O/S and version of VCS are you using?

Mike

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

andrich's picture

My SO is Solaris 10 adnd my VCS is 5.0.

Thats my CVMTypes.cf and the output from hares -display cvmvoldg5.

type CVMCluster (
    static int NumThreads = 1
    static int OnlineRetryLimit = 2
    static int OnlineTimeout = 400
    static str ArgList[] = { CVMTransport, CVMClustName, CVMNodeAddr, CVMNodeId, PortConfigd, PortKmsgd, CVMTimeout }
    str CVMClustName
    str CVMNodeAddr{}
    str CVMNodeId{}
    str CVMTransport
    int PortConfigd
    int PortKmsgd
    int CVMTimeout
)

type CVMVolDg (
    static keylist RegList = { CVMActivation, CVMVolume }
    static str ArgList[] = { CVMDiskGroup, CVMVolume, CVMActivation }
    str CVMDiskGroup
    keylist CVMVolume
    str CVMActivation
    temp int voldg_stat
)

type CVMVxconfigd (
    static int FaultOnMonitorTimeouts = 2
    static int RestartLimit = 5
    static str ArgList[] = { CVMVxconfigdArgs }
    static str Operations = OnOnly
    keylist CVMVxconfigdArgs
)

#####################################################################

svmediador2:/# hares -display cvmvoldg5
#Resource    Attribute        System      Value
cvmvoldg5    Group            global      lic_DG
cvmvoldg5    Type             global      CVMVolDg
cvmvoldg5    AutoStart        global      1
cvmvoldg5    Critical         global      0
cvmvoldg5    Enabled          global      1
cvmvoldg5    LastOnline       global      svmediador1
cvmvoldg5    MonitorOnly      global      0
cvmvoldg5    ResourceOwner    global      unknown
cvmvoldg5    TriggerEvent     global      0
cvmvoldg5    ArgListValues    svmediador1 lic1dg        0       sw
cvmvoldg5    ArgListValues    svmediador2 lic1dg        0       sw
cvmvoldg5    ConfidenceLevel  svmediador1 100
cvmvoldg5    ConfidenceLevel  svmediador2 100
cvmvoldg5    Flags            svmediador1
cvmvoldg5    Flags            svmediador2
cvmvoldg5    IState           svmediador1 not waiting
cvmvoldg5    IState           svmediador2 not waiting
cvmvoldg5    Probed           svmediador1 1
cvmvoldg5    Probed           svmediador2 1
cvmvoldg5    Start            svmediador1 1
cvmvoldg5    Start            svmediador2 1
cvmvoldg5    State            svmediador1 ONLINE
cvmvoldg5    State            svmediador2 ONLINE
cvmvoldg5    CVMDiskGroup     global      lic1dg
cvmvoldg5    CVMVolume        global
cvmvoldg5    ComputeStats     global      0
cvmvoldg5    voldg_stat       global      0
cvmvoldg5    CVMActivation    svmediador1 sw
cvmvoldg5    CVMActivation    svmediador2 sw
cvmvoldg5    MonitorTimeStats svmediador1 Avg   0       TS
cvmvoldg5    MonitorTimeStats svmediador2 Avg   0       TS
cvmvoldg5    ResourceInfo     svmediador1 State Valid   Msg             TS
cvmvoldg5    ResourceInfo     svmediador2 State Valid   Msg             TS
 

 

 

 

Paresh Bafna's picture

Hi andrich,

Your MultiNICA configuration looks fine. Only issue I see is RouteOptions attribute value.

RouteOptions attribute should be used only when configuring the local host as default gateway.

Please refer to Bundled Agent's Reference Guide for more details.

 

Thanks and Regards,

Paresh Bafna

Thanks and Regards,
Paresh Bafna

mikebounds's picture

So the 2 outputs you gave both show CVMVolume attribute which is required as per CFS Admin guide for Solaris 5.0MP3 below (on page 113):

 

Mike

 

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

SOLUTION
andrich's picture

Thanks Mike

How can I see if my Volume is a share volume?

If I have shared my DG, my Volume create under this DG is going to be share too ?

mikebounds's picture

Correct - all volumes in a shared diskgroup are shared.

Mike

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

andrich's picture

Thanks all. I am more relax now to introduce the new configuration to my Production Environment.