Video Screencast Help

creating shared folder between two solaris systems using vxfs

Created: 18 Sep 2012 | 15 comments

I have veritas storage foundation enterprise cluster file system 5.1 installed on both systems A and B. how can i created a shared folder between two systems using vxfs file system. I am familiar with file system clustering using heartbeat etc. but i want to know if there is a way to create shared folder between two solaris system using simple way.  I already know NFS option but i am looking for options which are available through veritas storage foundation cluster file system product. 

Comments 15 CommentsJump to latest comment

mikebounds's picture

Have a look at CNFS to see if this is what you want:

https://sort.symantec.com/public/documents/sfha/6.0.1/solaris/productguides/html/virtualstore_admin/ch17s02.htm

Mike

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

jagdip's picture

Thankyou.

Is it possible to create CNFS using the same servers A and B which will also be consuming the NFS shares eventually? I do not have extra hardware to setup CNFS and then present to my servers A and B.

mikebounds's picture

Sorry, link I gave was showing CNFS available in "Symantec VirtualStore", but it is available is SFCFS - see "Clustered NFS" section in SFCFS Admin guide (https://d1mj3xqaoh14j0.cloudfront.net/public/documents/sfha/5.1sp1/solaris/productguides/pdf/sfcfs_admin_51sp1_sol.pdf).  A quick extract says:

 

This Clustered NFS feature allows the same file system mounted across multiple
nodes using CFS to be shared over NFS from any combination of those nodes
So both servers A and B will be able to read and write to the same filesystem, which will also be shared out so clients can read and write to it too - is this what you are looking for?
 
Mike

 

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

jagdip's picture

Mike,

Thank you. 

I have looked through documentation for creating CNFS but I am still not sure how this works. 

Do I have to configure storage foundation and cluster file system HA with three small disk LUNs for fencing and two heartbeat ethernet links at each node before i start creating CNFS? 

My application which consists of Oracle RAC and Oracle Enterprise Manage (OEM) on same two nodes is already complex enough and i do not want more clustering for sharing a folder between two nodes. However, It is a requirement by OEM to have shared folder between both nodes. My storage person does not want to give me NFS share and I have to figure out a way to share folder between these nodes. 

 

Any more suggestions are much appreciated. 

 

mikebounds's picture

Not exactly sure what you want:

If you have SFRAC on your RAC nodes then you can just create a CFS filesystem and this will be shared between the 2 systems.

If you do NOT have SFRAC on your RAC nodes and you just want to provide an NFS share from a cluster, rather than a NAS server, then you can just create a "Share" resource in VCS and then mount this share on both your RAC nodes.  The cluster you create you Share resource on does not need to be CFS, but this will speed up failover times as you won't have to import diskgroup and mount filesystems.  But if you have NAS servers, then it seems overkill to use 2 nodes to just create a redundant share.

I don't think you need CNFS as this is really for load balancing, so if you have lots of NFS clients, some can access share via node1 and some via node2 and I don't think this is what you need.

If neither of the above describe what you are looking for, please describe all nodes involved and what needs to be shared with what.

Mike

 

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

jagdip's picture

Mike,

We do not have SFRAC. Oracle RAC is sharing its storage using ASM. Also, I only need to shared folder between these two nodes. There are no other NFS clients outside these two nodes. However, the idea of serving NFS storage to future clients using CNFS is tempting since my storage engineer does not like NFS.

However, at this moment, all i need is a shared folder between two nodes.

Here is the scenario.

Node A running Solaris 10.9 on SPARC and Node B running Solaris 10.9 on SPARC.

Node A and Node B are both Oracle RAC Nodes ( Active Active ) which use Shared Storage for Oracle using ASM.

Node A and Node B will run Oracle Enterprise Manager (OEM) Application in active passive scenario which will be using Oracle RAC for its database. So, both Oracle RAC and OEM are sharing same server A and B for its clusters. 

Now, OEM application need a shared folder of the size of 20GB which will keep software libraries. If node A goes down, node B have access to same libraries and will come up as active. Since, we already have licenses for VSFCFS 5.1, I was exploring the idea of creating shared folder in the simplest form without using fencing disks or hearbeat NICs etc. 

I hope this helps. I really apprecate your guidance 

 

mikebounds's picture

Still not sure if you are intending to put SFCFS on your RAC nodes or a separate pair of nodes.  

VCS on separate nodes to RAC nodes

You could use SFCFS + VCS or SF + VCS, and as explained in a earlier post, this involves creating a failover service group containing a "Share" and a virtual IP.  For VCS you have to have heartbeats, but fencing disks are only mandatory if you use SFCFS.

SFCFS on RAC nodes

Since SFCFS with Oracle or RAC is supported, I guess it should work if you put SFCFS on your RAC nodes, but don't actually use it for Oracle.  You would not require NFS as SFCFS would provide a filesystem than can be accessed by both nodes at the same time.  You could put the heartbeats on the same NICs as the private NICs used for RAC, but you would need 3 fencing disks.

Alternatively, it you can't get any fencing disks, you could just use SF + VCS and create a "Share" service group (which contains Share and diskgroup) and an "NFS Mount" service group with an "Offline Local dependency".  This would mean for example that node A would have "Share" service group online and node B would have "NFS Mount" service group online.  If node A went down then "Share" service group would failover to B and offline "NFS Mount" group because of "Offline Local dependency".  If node B failed, then  "Offline Local dependency" would stop "NFS Mount" group failing over.  This is a bit messy, but I think it should work, but SFCFS is simplier which doesn't even require VCS license as no failover groups need to be created (even though VCS is used under the hood to provide CFS).

 

Mike

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

Marianne's picture

If I understand correctly, you need basic steps to create the filesystem fro scratch?

If my understanding is correct, you can find the steps in the CFS Admin Guide.

If you have not initialized disk/lun that you want to use, identify the disk with 'vxdisk list' on the master CVM node.

 

To determine if the current node is the master CVM node, type the following command:
# vxdctl -c mode
 
On master node, initialize disk:
# vxdisksetup -i <access-name>
(access-name is the disk name in 1st column of 'vxdisk list' output)

 

Create a shared disk group:
# vxdg -s init <diskgroup-name> <DMname>=<access-name> 
 
Create a volume:
vxassist -g <diskgroup-name> make <volume-name> 20G
 
Create a VxFS file system in this volume, enter:
# mkfs -F vxfs /dev/vx/rdsk/<dg-name>/<volume-name>
 
Create a mount point for the shared file system on both nodes:
# mkdir /<mount_point>
 
Mount the file system on master node:
# mount -F vxfs -o cluster /dev/vx/dsk/<dg-name>/<volume-name>  /<mount_point>
 
Mount on 2nd node using the same command.
 
If I misunderstood, please ignore....
 
 

 

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

jagdip's picture

Mike,

I only have two servers and they are nodes for RAC as well as OEM application. So, SF and VCS are installed on those nodes along with RAC. However RAC has nothing to do with SF or VCS because it has its own ASM to manage shared storage (not the shared storage i am trying to create, shared storage for its data and other stuff). 

Moreover, I am not trying to solve any issues with RAC because it seems like solution is getting confused with the fact that RAC exists on those nodes where folder need to be shared. 

If I can not avoid heartbeat links for configuring even the simplest form of shared folder on two nodes using Storage Foundation software, I should explore the option of SFCFS and share hearbeatt links with RAC. I can get fencing disks. It is actually more difficult for me to have private VLAN setup for hearbeat links than to get fencing disks. So, that is the simplest I can do which is create SFCFS ( which is not simple at all ).  

Thank you for your suggestions.

-------------------------------------------------------------------------------------------------------------------------------------------------------

Marianne,

Thank you. 

As you can see my reply to mike above, I am looking into SFCFS option to create shared folder. Are your steps leading me to the same i.e. creating CFCFS based shared folder? 

I am guessing your implementation steps assume that cluster is already created and running. 

 

 

Marianne's picture

Steps are for Cluster Volume Manager and Cluster File System (SFCFS) - no VCS...

Steps will create shared diskgroup and allow you to mount File System concurrently on both nodes.

Supporting Storage Foundation and VCS on Unix and Windows as well as NetBackup on Unix and Windows
Handy NBU Links

mikebounds's picture

Normally for SFRAC, LLT heartbeats shares the same interfaces for RAC, so there should be no problem sharing the same NICs using CFS and ASM side by side.

If you have gone through base config wizard for SFCFS, then it should have created a parallel CVM service group.  You need another parallel service group for your shared folder which will contain a CVMVolDG and CFSMount resource which you can create manually or you can create this service group by using cfsmntadm command (this adds diskgroup and mount comfig to cluster - you need to create diskgroup and volume first as in Marianne's email).

So this is fairly straight forward - just run VCS wizards to configure heartbeats and CVM and then run cfsmntadm.

Mike

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

Mangesh's picture

Hi Jagdip,

If you want to use Oracle RAC with CFS, you will need to install SFRAC. 

If you are just looking for shared file access between two servers, you will need SFCFS.

With just SF and VCS you will not able share files between the two servers.

Thanks,

Mangesh

 

 

mikebounds's picture

VCS is a bit confusing in respect of SFCFS - let me elaborate:

The difference between SF and SF HA is clear, SF does not have VCS installed and SFHA does.  The same is not true between SFCFS and SFCFS HA as VCS is installed for both.  This is because CVM requires VCS as it uses heartbeats and creates a CVM service group.  The only difference between SFCFS and SFCFS HA is that you can only create CVM and CFS resources in SFCFS and to create failover service groups and other resources (like non-CFSMount and IP resources) you need the "HA" part and I think this MAY be enforced by not installing the bundled agents for SFCFS (but I am not sure on this).

You don't need the HA part, so it doesn't matter if you have purchased SFCFS or SFCFS HA, but either way, you still need to configure CVM service group.

Mike

 

UK Symantec Consultant in VCS, GCO, SF, VVR, VxAT on Solaris, AIX, HP-ux, Linux & Windows

If this post has answered your question then please click on "Mark as solution" link below

jagdip's picture

Thank you everyone. I think I gotten the grasp of Storage Foundation products. 

jdangelo_symc's picture

Please note that with version 6.0 SFCFS has be deprecated in favor of full CFSHA.  What this means is that any user of SFCFS 5.1 will automatically receive an upgrade to CFSHA 6.0.