HP Serviceguard for Linux Version A.11.18 Deployment Guide, August 2008

ManualsBrandsHP ManualsSoftwareHP Serviceguard for Linux ProLiant Cluster

Introduction......................................................................................................................................... 3

Purpose of this Document .................................................................................................................. 3

What Has Changed in this Version .................................................................................................... 3

Scope............................................................................................................................................. 3

Audience ........................................................................................................................................ 3

Installation and Configuration Overview ............................................................................................. 3

Terms and Definitions ....................................................................................................................... 4

Related Documents........................................................................................................................... 4

What to Order .................................................................................................................................... 5

Getting Started.................................................................................................................................... 6

Hardware Setup .............................................................................................................................. 6

Network Planning ............................................................................................................................ 6

Gather Required Software .................................................................................................................... 8

1. Linux OS Distribution ............................................................................................................... 8

2. Kernel Errata........................................................................................................................... 8

3. Serviceguard for Linux CD........................................................................................................ 8

4. Serviceguard for Linux Patches.................................................................................................. 8

5. Java JDK ................................................................................................................................ 9

6. HP Distributed Systems Administrator Utilities (DSAU)................................................................. 10

7. Serviceguard for Linux Installation and Configuration Scripts ...................................................... 10

8. Serviceguard for Linux Free Toolkit Suite .................................................................................. 10

9. Linux Driver Kit for the Fibre Channel HBAs .............................................................................. 11

10. HP Device Mapper Multipath Enablement Kit.......................................................................... 11

OS Installation................................................................................................................................... 11

Linux OS Distribution ...................................................................................................................... 12

Copy Downloaded Software to Servers ............................................................................................ 13

Kernel Errata ................................................................................................................................. 13

Linux Post-OS Installation................................................................................................................. 14

Storage Array Configuration............................................................................................................... 16

Connecting the MSA2000 to the Servers .......................................................................................... 16

Setting Management Port IP Address using the CLI ............................................................................. 17

Creating a User Login from the CLI................................................................................................... 17

Configuring the MSA2000.............................................................................................................. 18

Preparing the Servers ......................................................................................................................... 20

Install and Configure Driver for Fibre Channel HBA............................................................................ 20

Configuring Multipath Support......................................................................................................... 20

Configuring the Lock LUN and Shared Volumes................................................................................. 22

Create the Partitions.................................................................................................................... 23

HP Serviceguard for Linux Version A.11.18

Deployment Guide

Summary of content (40 pages)

PAGE 1
HP Serviceguard for Linux Version A.11.18 Deployment Guide Introduction......................................................................................................................................... 3 Purpose of this Document .................................................................................................................. 3 What Has Changed in this Version .................................................................................................... 3 Scope.................
PAGE 2
Create the Logical Volumes.......................................................................................................... 24 Backup the Volume Groups ......................................................................................................... 25 Import and Configure the Volume Groups on the Second Server ...................................................... 25 Create alternate disk monitoring script ....................................................................................
PAGE 3
Introduction Purpose of this Document The HP Serviceguard for Linux Deployment Guide provides administrators with step-by-step instructions for ordering, installing and configuring a Serviceguard cluster on two Linux hosts. Using this deployment guide, administrators can install and configure HP Serviceguard for Linux quickly and easily. This document pertains to specific hardware and software, but can easily be leveraged for use in deploying HP Serviceguard for Linux in different environments.
PAGE 4
5. Storage Array Configuration 6. Preparing the Servers a. Fibre Channel Driver and Multipath configuration b. Shared storage configuration c. Network configuration 7. Serviceguard for Linux and Related Software Installation 8. Serviceguard for Linux Configuration a. Server Configuration b. Cluster Configuration c. Consolidated Log Package Configuration d. Sample Package Configuration 9.
PAGE 5
– Installing and Configuring Apache Toolkit for Serviceguard for Linux – Securing Serviceguard  http://docs.hp.com → Network and Systems Management (under “Internet and Networking”) → System Administration → Installation and User’s Guide – Distributed Systems Administration Utilities User’s Guide  http://www.hp.com/go/sglx/info (under “Downloadables”) – HP Serviceguard for Linux Certification Matrix – Configuration Guide  http://docs.hp.
PAGE 6
coincide with support contracts on hardware if desired. This solution also includes support for Red Hat, 3-year Red Hat Enterprise Linux Advanced Platform 24x7 either 1 to 2 sockets or unlimited sockets depending upon the server chosen (visit http://www.hp.com/go/proliantrhel for more information). Please note that support is highly recommended for all high availability solutions.
PAGE 7
Figure 1. Network and Storage Topology Network Switch clients Switch bond0 eth2 bond0 eth3 eth2 Switch eth0 eth3 eth0 Node 1 Node 2 Required Networking Information: 1. Get static IP Addresses for the following: a. 2 IP addresses and hostnames with subnet mask, one for each server b. 2 relocatable IP addresses (1 for consolidated logging package, 1 for sample package), DNS names (optional) and subnet mask c.
PAGE 8
Field Example Relocatable IP Address for clog Package DNS Name for clog package (optional) Relocatable IP Address for ws Package DNS Name for ws package (optional) Subnet (Network) and Subnet Mask Gateway DNS Server Address Subnet Mask (Private heartbeat network) NTP Server Address Customer [fill-in] 16.89.84.233 16.89.84.218 16.89.84.128, 255.255.255.128 16.89.84.129 16.110.135.51, 16.110.135.52 15.36.88.4 Table 2.
PAGE 9
At the time of publication, the following patches were available: SGLX_00222 (Red Hat 5.0 IA32) Serviceguard A.11.18.03 SGLX_00204 (Red Hat 5.0 IA32) Serviceguard Manager B.01.01.03 For the specific installation recommended in this deployment guide, Serviceguard for Linux version A.11.18.02 or later must be used. This is required for support of the cluster lock LUN with HP Device Mapper Multipath on Red Hat 5.1 using the MSA2000. Patches can be downloaded from HP at the following URLs: http://itrc.hp.
PAGE 10
At the time of publication, JDK 5.0 Update 15 was the latest release available from Sun. The download file for this version is named jdk-1_5_0_15-linux-i586-rpm.bin. When the .bin file is executed, the .rpm file is extracted. 6. HP Distributed Systems Administrator Utilities (DSAU) DSAU is recommended for use with Serviceguard to facilitate troubleshooting by consolidating syslog and package log files from all nodes in the cluster to a central shared location.
PAGE 11
6. Click the “Next” button. 7. On the “Software download confirmation” page, click “Download Directly >>”. At the time of publication, the version of the toolkit available was A.03.02-0. The downloaded file for this version is named sglxtools-A.03.02-0.product.redhat.tar. 9. Linux Driver Kit for the Fibre Channel HBAs Download the latest driver from Hewlett-Packard for the Fibre Channel host bus adapters ordered with the MSA2000.
PAGE 12
Linux OS Distribution For more detailed instructions for installing Red Hat Enterprise Linux 5.1 refer to the Red Hat Enterprise Linux Installation Guide at http://www.redhat.com/docs/manuals/enterprise/. NOTE: Make sure the Fibre Channel cables from the storage server are not connected to the servers at this time. Otherwise, the Linux install process will attempt to install the boot partition on the storage server. Follow 1. 2. 3. 4. these steps to install from the Red Hat Enterprise Linux 5.
PAGE 13
16. Select the following in the check boxes: Software Development Webserver NOTE: Software Development is required for installing Serviceguard, the QLogic driver, and HP Device Mapper Multipath. The Webserver is required for the optional Serviceguard package. You can omit the Webserver if not configuring the optional Serviceguard package and a Webserver is not otherwise needed. 17. Choose “Customize Later” (default). Click “Next”. 18. Installation to Begin, click “Next”. 19.
PAGE 14
These steps should be performed on both servers. The following instructions are for updating the kernel if the rpms are downloaded from Red Hat as an rpm packages: 1. To get the version of the kernel currently installed on the system, execute the command “uname –a”: uname -a Linux eve.cup.hp.com 2.6.18-53.el5 #1 SMP Wed Oct 10 16:34:02 EDT 2007 i686 i686 i386 GNU/Linux 2. Compare the current kernel version, for example 2.6.18-53.
PAGE 15
If xinetd is not installed, there will be no output when running this command. If it is already installed, you will see output. For example: xinetd-2.3.14-10.el5 2. If not installed, locate the xinetd rpm on one of the Linux OS CDs (probably CD#2) under the Server directory, and install it. For example: rpm –ivh xinetd-2.3.14-10.el5.i386.rpm The Serviceguard for Linux SNMP subagent requires the lm_sensors and net-snmp packages. lm_sensors must be installed before net-snmp.
PAGE 16
Storage Array Configuration The following instructions are for the MSA2000. It has a built-in browser-based management interface called SMU (Storage Management Utility). The device can also be configured using the CLI. This document has instructions to use the CLI to configure the IP address, then the remainder of the configuration steps are shown using SMU. In this section there are instructions for creating external shared storage to be used for the cluster lock and for package data.
PAGE 17
Setting Management Port IP Address using the CLI The IP address can be configured using the CLI (command line interface) from a serial console or through DHCP. To configure the IP address using the CLI, perform the following steps: 1. Plug the serial cable (Mini DB9 RS232 Serial cable) into the COM1 port of a PC to access the MSA2000 via a terminal emulator such as HyperTerminal (available on most Windows PCs) and into the serial port of one of the storage device controllers. 2.
PAGE 18
Enter Password for new user jsmith:***** Re-enter Password:***** Info: User Type not specified, defaulting to Advanced.
PAGE 19
4. Create a. b. c. d. e. f. g. h. i. j. k. l. m. n. the virtual disk. Click “MANAGE“ in the left-hand pane. Click “VIRTUAL DISK CONFIG” in the left-hand pane. Click “create a vdisk”. Select “Manual Virtual Disk Creation” for the Virtual Disk Creation Method. Enter Virtual Disk Name, for example “edenshare”. Select Virtual Disk RAID level, for example “RAID 1 – Disk Mirroring”. Click “Create New Virtual Disk”. Select drives to add to virtual disk by checking at least 2 green (available) disks.
PAGE 20
e. Click “OK” to the warning. Preparing the Servers In preparation for the Serviceguard for Linux installation and configuration steps, the two servers need to be configured to meet the minimum requirements for Serviceguard in terms of redundant paths to the external storage server, shared storage configuration and network redundancy. NOTE: If you haven’t already done so, copy all downloaded software files to a directory on each server, /tmp/sglx_install, for example.
PAGE 21
4. Run the install script and answer the prompts as follows (user inputs in bold): ./INSTALL.sh HP Device Mapper MultiPath Ver4.0.0 - Installation Menu 1. Install HP Device Mapper MultiPath 2. Uninstall Multipath Utilities 3. Exit Enter choice [1/2/3] :1 Checking for Build dependencies... Building HPDMmultipath-tools-4.0.0 .... Checking for previous installation. Please wait... Do you wish to uninstall device-mapper-multipath-0.4.7-12.el5 ?(y/n) : y Checking for dependencies...
PAGE 22
b. Copy the sample multipath.conf file provided in the kit to the /etc directory (input as one line): cp /usr/share/doc/HPDMmultipath-tools4.0.0/multipath.conf.HPTemplate /etc/multipath.conf c. Open the /etc/multipath.
PAGE 23
volume for the sample Serviceguard for Linux package to be created in a later step. And the third volume is for the DSAU consolidated log (clog), which allows the user to view consolidated syslog and Serviceguard package logs for the entire cluster from a central location. The consolidated log will be configured as a Serviceguard for Linux package, also in a later step. Most of the shared volume configuration is performed on the first node. The configuration can then be imported to the second node.
PAGE 24
e p extended primary partition (1-4) p Partition number (1-4): 1 First cylinder (1-24, default 1): 1 Using Last cylinder or +size or +sizeM or +sizeK (1-1016, default 1016): 1016 Command (m for help): t Selected partition 1 Hex code (type L to list codes): 8e Changed system type of partition 1 to 8e (Linux LVM) Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. Syncing disks. 3.
PAGE 25
lvcreate -L 280M -n lvol1 vgclog mke2fs -j /dev/vgclog/lvol1 mkdir /clog vgchange -a n vgclog NOTE: The size specified in the lvcreate command, specified by the “-L” option, is related to the size of the physical partition created on the storage device. Backup the Volume Groups The steps in this section should be performed on the same server where the partitions and volumes were created. 1.
PAGE 26
Create the conversion script /usr/local/cmcluster/bin/cmresserviced_custom. The contents must be exactly as shown: #!/bin/sh . /etc/cmcluster.conf typeset -a realdm dm typeset -i i (( i = 0 )) for arg in "$@" do dm[$i]=${arg##/dev/mapper/} realdm[$i]=/dev/$(multipath -ll ${dm[$i]}| grep mpath | awk '{print $3}' ) (( i = i + 1 )) done $SGLBIN/cmresserviced "${realdm[*]}" Network Configuration Configure Network Bonding In this step, you will configure a bonded network interface.
PAGE 27
ONBOOT=yes MASTER=bond0 SLAVE=yes BOOTPROTO=none HWADDR=00:14:C2:C0:44:C5 4. Edit the ifcfg-ethN file to contain the following content. Remove existing entries, if any, except for “DEVICE” and “HWADDR”. Make sure that the HWADDR field matches the specific MAC address for the card, do not use the value listed here. Here is an example for ifcfg-eth3: DEVICE=eth3 USERCTL=no ONBOOT=yes MASTER=bond0 SLAVE=yes BOOTPROTO=none HWADDR=00:14:C2:C0:44:C4 5. Edit /etc/modprobe.
PAGE 28
The steps in this section should be performed on each server to ensure the port is free on each server. 1. Check the /etc/services file for well-known reserved ports to look for an unreserved port, for example: more /etc/services 2.
PAGE 29
NOTE: The installation script will instruct the user to set up the PATH environment variable. This will be taken care of by the Serviceguard System Configuration Automation script later. Serviceguard for Linux Installation Script The Serviceguard for Linux Installation script will guide you through installing Serviceguard and Serviceguard Manager from the CD. It will also check for dependencies and prompt you to install the required dependencies, if not already installed.
PAGE 30
Serviceguard Patches HP recommends that you install the latest patches available for Serviceguard for Linux A.11.18 and Serviceguard Manager B.01.01 on each server. The configuration recommended in this deployment guide, specifically for the use of HP Device Mapper multipath for the cluster lock LUN, requires Serviceguard for Linux version A.11.18.02 or later.
PAGE 31
To install the toolkit: 1. Change to the directory containing the toolkit, for example: cd /tmp/sglx_install 2. Untar the file, for example: tar xf sglxtools-A.03.02-0.product.redhat.tar 3. Install the Apache Toolkit, for example: rpm -ivh apache-toolkit-A.03.01-0.product.redhat.noarch.rpm Serviceguard for Linux Configuration In this section, you will perform the server configuration steps that are required prior to configuring a Serviceguard for Linux cluster.
PAGE 32
3. Append the public key from the current node to the authorized_keys file on the other node by executing the following command (as one line): ssh root@ ‘cat /root/.ssh/authorized_keys2 >> /root/.ssh/authorized_keys’ 4. Set the shell for the ssh authentication agent using the following command: ssh-agent $BASH 5. Add the rsa identity to the ssh authentication agent ssh-add NOTE: To verify that the ssh keys have been set up properly, try to ssh to the other node.
PAGE 33
Test Volume Group Activation On Each Node This should be done for each volume group, vgws and vgclog to verify volume group activation on each server. The steps shown here are for vgws. 1. On the first server (for example, adam) a. Activate volume group: vgchange -–addtag $(uname –n) vgws vgchange -a y vgws mount /dev/vgws/lvol1 /ws b. Write test file to volume group: echo “Written by” `hostname` “on” `date` > /ws/test cat /ws/test NOTE: If you try to activate vgws on the other server, it should fail.
PAGE 34
NOTE: When using Device Mapper Multipath, the path to the cluster Lock LUN, for example /dev/mapper/mpath0, must be the same on each node. 9. Select Check Configuration. Look for any errors. NOTE: You may get a warning about the default NODE_TIMEOUT value. This warning can be ignored here, but refer to the documentation when finalizing your cluster. 10. Select Apply Configuration. Select “OK” in the pop-up dialog box. 11.
PAGE 35
To test, try to run the clog package on each node in the cluster. From the “Summary” page, select the clog package, then from the “Administration” menu, select “Run Package” to run the package on the first node, then “Move Package” to run the package on the second node. Configuring a sample package In this section, you will configure a Serviceguard for Linux package, called ws, for an Apache web server using scripts from the Apache Toolkit.
PAGE 36
SERVICE_CMD[0]="/usr/local/cmcluster/conf/ws/toolkit.sh monitor" SERVICE_RESTART[0]="-r 0" SERVICE_NAME[1]="diskmon" SERVICE_CMD[1]="/usr/local/cmcluster/bin/cmresserviced_custom /dev/mapper/mpath3" SERVICE_RESTART[1]="" SERVICE_FAIL_FAST_ENABLED[1]="no" SERVICE_HALT_TIMEOUT[0]="300" NOTE: Make sure the SERVICE_NAME’s match the names of the Services added earlier under “Monitored Resources” in Step #3. k. l. Locate the string “function customer_defined_run_cmds”.
PAGE 37
DocumentRoot “/ws” Listen 16.89.84.218:80 7. Copy the Toolkit files and httpd.conf file to other node, for example adam: scp ha* root@adam:/usr/local/cmcluster/conf/ws/. scp toolkit.sh root@adam:/usr/local/cmcluster/conf/ws/. scp httpd.conf root@adam:/usr/local/cmcluster/conf/ws/. Start the Sample Package You will need to run the package to complete the configuration: 1. From your browser on the “HP Serviceguard Manager Summary” page, select the ”ws” package. 2.
PAGE 38
Problem: Storage Management Utility browser interface does not display any “Manage” menu options in the left-hand column Possible Remedy: Refresh the browser window. Problem: When installing the Serviceguard patch, the sgupdate command encounters an error. For example: An update for sgproviders exists - loading. Error executing command "rpm -U /tmp/julie/rpms/sgprovidersA.02.00.01-0.rhel5.i386.rpm". See file /tmp/rpminst.4550 for details. Possible Remedy: a. Stop and restart the cimserver.
PAGE 39
As with Red Hat 5, the “development” option should be selected during installation if available. NOTE: For SLES 10, if the cluster does not autostart please rename /etc/init.d/cmcluster.init to /etc/init.d/cmcluster. Additionally, there are several different requirements, listed below, for the installation of HP Serviceguard for Linux on the Integrity platforms. These steps should be performed prior to running the Serviceguard for Linux Installation script.
PAGE 40
NOTE: This link was valid at publication time. If the link no longer works, contact HP Support. 2. To install HP SMH and Tomcat: a. Go to the directory where you have downloaded the file. For example: cd /tmp/sglx_install b. Use the tar command to extract the files. For example: tar xf SupportPack-4.27.sles10.ia64.tar c. Change to the new directory that is created. For example: cd SupportPack-4.27/distros/sles10 d. Install HP SMH. For example: rpm –Uvh hpsmh-2.1.10-08.linux.ia64.rpm e. Install Tomcat.