White Paper

ManualsBrandsHP ManualsSoftwareHP Serviceguard Toolkit for NFS

Serviceguard NFS Toolkit Support for Cluster File System

Contents

1. ABSTRACT ....................................................................................................................................................................................... 3

2. INTENDED AUDIENCE ................................................................................................................................................................. 3

3. INTRODUCTION ............................................................................................................................................................................ 3

Non-CFS Implementation with Package Failover .......................................................................................................................... 3

Integrating Support for CFS into Serviceguard NFS Toolkit ......................................................................................................... 3

4. OVERVIEW ...................................................................................................................................................................................... 4

Current SG-NFS over VxFS Support ............................................................................................................................................... 4

CFS vs. Non-CFS Implementation ................................................................................................................................................... 4

5. PREREQUISITES ............................................................................................................................................................................. 7

5.1 PRODUCT REQUIREMENTS ........................................................................................................................................................................ 7

5.2 PATCH REQUIREMENTS ............................................................................................................................................................................. 7

6. CONFIGURING SERVICEGUARD NFS LEGACY PACKAGE OVER CFS PACKAGES ............................................... 8

6.1 SERVICEGUARD NFS LEGACY PACKAGE OVER CFS PACKAGES WITHOUT FILE LOCKING ........................................................................... 9

Configuring a Serviceguard NFS export package ....................................................................................................................... 9

Starting a Serviceguard NFS export package ............................................................................................................................. 11

Configuring a Serviceguard NFS failover package ................................................................................................................... 13

Starting a Serviceguard NFS failover package ........................................................................................................................... 14

6.2 SERVICEGUARD NFS LEGACY PACKAGE OVER CFS PACKAGES WITH FILE LOCKING ............................................................................... 15

Configuring a Serviceguard NFS failover package ................................................................................................................... 16

Starting a Serviceguard NFS failover package ........................................................................................................................... 19

7. CONFIGURING SERVICEGUARD NFS MODULAR PACKAGE OVER CFS PACKAGES ................................................. 19

7.1 SERVICEGUARD NFS MODULAR PACKAGE OVER CFS PACKAGES WITHOUT FILE LOCKING ..................................................................... 20

Configuring a Serviceguard NFS export package ..................................................................................................................... 21

Starting a Serviceguard NFS export package ............................................................................................................................. 22

Configuring a Serviceguard NFS failover package ................................................................................................................... 23

September 2011

Summary of content (28 pages)

PAGE 1
Serviceguard NFS Toolkit Support for Cluster File System September 2011 Contents 1. ABSTRACT ....................................................................................................................................................................................... 3 2. INTENDED AUDIENCE ................................................................................................................................................................. 3 3. INTRODUCTION .........................
PAGE 2
Starting a Serviceguard NFS failover package ........................................................................................................................... 24 7.2 SERVICEGUARD NFS MODULAR PACKAGE OVER CFS PACKAGES WITH FILE LOCKING............................................................................. 25 Configuring a Serviceguard NFS failover package ...................................................................................................................
PAGE 3
1. Abstract This white paper describes how the Serviceguard NFS Toolkit supports the Veritas Storage Foundation Cluster File System (VxCFS, referred to as CFS throughout this document) in a Highly Available NFS environment. In a Serviceguard NFS Toolkit implementation with VxFS file systems (i.e. a non-CFS implementation), access from NFS clients to specific files and file systems in a Serviceguard NFS environment is limited to a single NFS server node.
PAGE 4
. Overview Current SG-NFS over VxFS Support In a Serviceguard environment, a Serviceguard NFS over VxFS (failover) package is defined as a collection of resources including relocatable IP addresses and logical volume groups (data disks) associated with NFS services. If the server on which a package is running fails, then Serviceguard will automatically start the NFS package on the adoptive node. The adoptive node takes control of the IP addresses and disks and starts the NFS services. CFS vs.
PAGE 5
The files and filesystems can be shared and accessed concurrently within the cluster. However, file sharing and access from outside the cluster will still require NFS - client systems which are not members of the CFS cluster will use NFS to access the shared filesystems. Cross mounting (with the nfs_xmnt script) is not needed since you can use CFS to share files and filesystems within the cluster.
PAGE 6
NFS Client1 NFS Client2 NFS Client3 Load Load Balancer Balancer Serviceguard NFS servers NFS Server1 /cfs1,/cfs2,/cfs3 NFS Server2 /cfs1,/cfs2,/cfs3 NFS Server3 /cfs1,/cfs2,/cfs3 Cluster File System Shared Storage /cfs1 /cfs2 /cfs3 Figure 3.
PAGE 7
NFS Client1 NFS Client2 NFS Client3 Serviceguard NFS servers NFS Server1 /cfs1 Shared Storage NFS Server2 /cfs2 /cfs1 /cfs2 NFS Server3 /cfs3 /cfs3 Figure 4. SG NFS Servers over CFS – High Availability, File Locking 5. Prerequisites 5.1 Product Requirements Serviceguard NFS Toolkit support (legacy package) for CFS is available on HP-UX 11i v2 and v3. For CFS support on HP-UX 11i v2, install:  Serviceguard A.11.18 or later  CFS 5.0 or later  Serviceguard NFS Toolkit B.11.23.
PAGE 8
feature functions properly in A.11.18, install the following patch on all servers that will be configured as nodes in the cluster. PHSS_39484 1.0 Serviceguard A.11.18.00 6. Configuring Serviceguard NFS Legacy Package over CFS Packages This section describes how to configure and start Serviceguard NFS legacy packages in a Serviceguard over CFS environment.
PAGE 9
locking is required, follow the instructions in section “Serviceguard NFS Legacy Package over CFS Packages with File Locking”. 6.1 Serviceguard NFS Legacy Package over CFS Packages without File Locking Each active server in the cluster needs to run an export multi-node package and an NFS failover package. An export multi-node package is a package that runs on each server in the cluster and exports all the cluster file systems. Each standby server (i.e.
PAGE 10
# cp /opt/cmcluster/nfs/hanfs.sh hanfs.export.sh 3. Edit the nfs-export.cntl script and set the HA_NFS_SCRIPT_EXTENSION to “export.sh”. Note that when you edit the configuration scripts referred to throughout this document, you may have to uncomment the lines as you edit them. HA_NFS_SCRIPT_EXTENSION = “export.sh” This will set the NFS specific control script to be run by the package to hanfs.export.sh as we have named it in the copy command above. No other changes are needed in this script. 4.
PAGE 11
HALT_SCRIPT /etc/cmcluster/nfs/nfs-export.cntl HALT_SCRIPT_TIMEOUT NO_TIMEOUT f) Set the DEPENDENCY_NAME, DEPENDENCY CONDITION, and DEPENDENCY_LOCATION variables so that the export package will only run if the Serviceguard CFS multi-node packages are already running.
PAGE 12
MULTI_NODE_PACKAGES PACKAGE SG-CFS-pkg SG-CFS-DG-1 SG-CFS-MP-1 SG-CFS-MP-2 SG-NFS-XP-1 STATUS up up up up up STATE running running running running running AUTO_RUN enabled enabled enabled enabled enabled SYSTEM yes no no no no 12
PAGE 13
Configuring a Serviceguard NFS failover package Configuring a Serviceguard NFS failover package for a CFS environment is similar to configuring the package for a non-CFS environment. The main difference is that you must configure one failover package for every server that exports CFS. 1. Copy the following scripts and make a separate copy for each package. You must create one package for each server. # cd /etc/cmcluster/nfs # # # # cmmakepkg –p /etc/cmcluster/nfs/nfs1.
PAGE 14
b) In the nfs2.conf file, set the PACKAGE_NAME to SG-NFS2. c) The PACKAGE_TYPE should be set to the default value (FAILOVER). d) Set the NODE_NAME variables for each node that can run the package. The first NODE_NAME must specify the primary node, followed by adoptive node(s) in the order in which they will be tried: NODE_NAME thyme NODE_NAME basil e) Set the RUN_SCRIPT and HALT_SCRIPT variables to the full path of the control script, with no timeout: RUN_SCRIPT /etc/cmcluster/nfs/nfs1.
PAGE 15
# cmapplyconf –v –C /etc/cmcluster/cluster.conf –P /etc/cmcluster/nfs/nfs1.conf –P /etc/cmcluster/nfs/nfs2.conf 4.
PAGE 16
NFS Client1 NFS Client2 NFS Client3 Serviceguard NFS servers NFS Server1 - thyme Failover Package 1 /cfs1 NFS Server2 - basil Failover Package 2 /cfs2 Cluster File System Shared Storage /cfs1 /cfs2 Figure 6. SG NFS over CFS with file locking Configuring a Serviceguard NFS failover package Configuring a Serviceguard NFS failover package for a CFS environment is similar to configuring the package for a non-CFS environment.
PAGE 17
You must configure a name for this address in the DNS, NIS, or LDAP database, or in the /etc/hosts file. 3. Set the HA_NFS_SCRIPT_EXTENSION to “1.sh” in the nfs1.cntl file: HA_NFS_SCRIPT_EXTENSION = “1.sh” This will set the NFS specific control script to be run by the package to hanfs.1.sh as it has been named in the copy command above. Set this to “2.sh” in nfs2.cntl. 4. Edit the hanfs.sh scripts (hanfs.1.sh and hanfs.2.sh) as follows: a) Set the exported directory in hanfs.1.
PAGE 18
6. Edit the nfs.conf scripts (nfs1.conf and nfs2.conf) as follows: a) Specify the package name: PACKAGE_NAME SG-NFS1 b) In the nfs2.conf file, set the PACKAGE_NAME variable to SG-NFS2. c) Set the NODE_NAME variables for each node that can run the package.
PAGE 19
Starting a Serviceguard NFS failover package 1. Copy the configuration files to each server in the cluster: # rcp –p /etc/cmcluster/nfs/* {hostname}:/etc/cmcluster/nfs 2. Verify the cluster and package configuration files on each server: # cmcheckconf –k –v –C /etc/cmcluster/cluster.conf –P /etc/cmcluster/nfs/nfs1.conf –P /etc/cmcluster/nfs/nfs2.conf 3. Verify and apply the cluster package configuration files on a single server: # cmapplyconf –v –C /etc/cmcluster/cluster.conf –P /etc/cmcluster/nfs/nfs1.
PAGE 20
a Serviceguard NFS Modular Package” section of the Serviceguard NFS Toolkit A.11.11.06, A.11.23.05 and A.11.31.08 Administrator’s Guide to configure the /etc/rc.config.d/nfsconf file, start the NFS server, configure the disk hardware, and setup volume groups, logical volumes, and file systems.
PAGE 21
Configuring a Serviceguard NFS export package There should only be one NFS export multi-node package per cluster. This package will run on each server in the cluster. Note: All steps in this section must be completed on a single server. 1. Create the nfs-export.conf file with the cmmakepkg command. # cd /etc/cmcluster/nfs_modular # cmmakepkg -m sg/multi_node_all -m nfs/hanfs /etc/cmcluster/nfs_modular/nfsexport.
PAGE 22
e) Set the dependency_name, dependency_condition, and dependency_location variables so that the export package will only run if the Serviceguard CFS multi-node packages are already running.
PAGE 23
NODE STATUS thyme up STATE running NODE STATUS basil up STATE running MULTI_NODE_PACKAGES PACKAGE STATUS SG-CFS-pkg up SG-CFS-DG-1 up SG-CFS-MP-1 up SG-CFS-MP-2 up SG-NFS-XP-1 up STATE running running running running running AUTO_RUN enabled enabled enabled enabled enabled SYSTEM yes no no no no Configuring a Serviceguard NFS failover package Configuring a Serviceguard NFS failover package for a CFS environment is similar to configuring the package for a non-CFS environment.
PAGE 24
c) Specify the package name. package_name SG-NFS1 In the nfs2.conf file, set the package_name to SG-NFS2. d) The package_type should be the default value (failover). e) Set the node_name variables for each node that can run the package. The first node_name must specify the primary node, followed by adoptive node(s) in the order in which they will be tried: node_name node_name thyme basil f) In nfs1.conf and nfs2.
PAGE 25
NODE STATUS thyme up PACKAGE SG-NFS1 STATUS up NODE STATUS basil up PACKAGE SG-NFS2 STATE running STATE running AUTO_RUN enabled NODE thyme AUTO_RUN enabled NODE basil STATE running STATUS up STATE running MULTI_NODE_PACKAGES PACKAGE STATUS SG-CFS-pkg up SG-CFS-DG-1 up SG-CFS-MP-1 up SG-CFS-MP-2 up SG-NFS-XP-1 up STATE running running running running running AUTO_RUN enabled enabled enabled enabled enabled SYSTEM yes no no no no 7.
PAGE 26
This IP address is the relocatable IP address for the package. NFS clients that mount the file systems in the package use this IP address to identify the server. You must configure a name for this address in the DNS, NIS, or LDAP database, or in the /etc/hosts file. b) Set the exported directory in nfs1.conf as follows: For nfs1.conf generated on HP Serviceguard A.11.18: XFS “/cfs1” For nfs1.conf generated on HP Serviceguard A.11.19: nfs/hanfs_export/XFS “/cfs1” In nfs2.
PAGE 27
package_name SG-NFS1 In nfs2.conf, set the package_name to SG-NFS2. g) The package_type should be set to the default value (failover). h) Set the node_name variables for each node that can run the package.
PAGE 28
CLUSTER cluster1 STATUS up NODE STATUS thyme up PACKAGE SG-NFS1 NODE basil STATUS up STATUS up PACKAGE SG-NFS2 STATE running STATE running AUTO_RUN enabled NODE thyme AUTO_RUN enabled NODE basil STATE running STATUS up STATE running MULTI_NODE_PACKAGES PACKAGE STATUS SG-CFS-pkg up SG-CFS-DG-1 up SG-CFS-MP-1 up SG-CFS-MP-2 up STATE running running running running AUTO_RUN enabled enabled enabled enabled SYSTEM yes no no no © 2009, 2011 Hewlett-Packard Development Company, L.P.