HP Serviceguard for Linux Version A.11.19 Deployment Guide, September 2012

ManualsBrandsHP ManualsSoftwareHP Serviceguard for Linux RH AS ProLiant Cluster

Introduction ......................................................................................................................................... 3

Purpose of this Document .................................................................................................................. 3

What Has Changed in the Serviceguard A.11.19 Installation Procedure ................................................ 3

Scope ............................................................................................................................................. 3

Audience ........................................................................................................................................ 3

Installation and Configuration Overview ............................................................................................. 4

Terms and Definitions ....................................................................................................................... 4

Related Documents ........................................................................................................................... 4

What to Order .................................................................................................................................... 5

Getting Started .................................................................................................................................... 6

Hardware Setup .............................................................................................................................. 6

Network Planning ............................................................................................................................ 6

Gather Required Software .................................................................................................................... 8

1. Linux OS Distribution ............................................................................................................... 8

2. Kernel Errata........................................................................................................................... 8

3. Serviceguard for Linux DVD ...................................................................................................... 8

4. Serviceguard for Linux Patches .................................................................................................. 9

5. Java JDK ................................................................................................................................ 9

6. Serviceguard for Linux Installation and Configuration Scripts ........................................................ 9

7. Serviceguard for Linux Contributed Toolkit Suite .......................................................................... 9

8. Linux Driver Kit for the Fibre Channel HBAs .............................................................................. 10

OS Installation ................................................................................................................................... 10

Linux OS Distribution ...................................................................................................................... 10

Copy Downloaded Software to Servers ............................................................................................ 12

Kernel Errata ................................................................................................................................. 12

Linux Post-OS Installation ................................................................................................................. 13

Storage Array Configuration ............................................................................................................... 14

Connecting the MSA2000 to the Servers .......................................................................................... 14

Setting Management Port IP Address using the CLI ............................................................................. 15

Creating a User Login from the CLI ................................................................................................... 16

Configuring the MSA2000 .............................................................................................................. 16

Preparing the Servers ......................................................................................................................... 18

Install and Configure Driver for Fibre Channel HBA............................................................................ 18

Configuring Multipath Support ......................................................................................................... 19

Configuring the Lock LUN and Shared Volumes ................................................................................. 20

Create the Partitions.................................................................................................................... 21

Create the Logical Volumes.......................................................................................................... 22

Backup the Volume Groups ......................................................................................................... 23

Import and Configure the Volume Groups on the Second Server ...................................................... 23

HP Serviceguard for Linux Version A.11.19

Deployment Guide

Step by Step Instructions

Summary of content (35 pages)

PAGE 1
HP Serviceguard for Linux Version A.11.19 Deployment Guide Step by Step Instructions Introduction ......................................................................................................................................... 3 Purpose of this Document .................................................................................................................. 3 What Has Changed in the Serviceguard A.11.19 Installation Procedure ................................................ 3 Scope .......
PAGE 2
Network Configuration ................................................................................................................... 24 Configure Network Bonding ........................................................................................................ 24 Identify Free Port for DSAU Consolidated Logging.............................................................................. 25 Serviceguard for Linux and Related Software Installation ..................................................
PAGE 3
Introduction Purpose of this Document The HP Serviceguard for Linux Deployment Guide provides administrators with step-by-step instructions for ordering, installing and configuring a Serviceguard cluster on two Linux hosts. Using this deployment guide, administrators can install and configure HP Serviceguard for Linux quickly and easily. This document pertains to specific hardware and software, but can easily be leveraged for use in deploying HP Serviceguard for Linux in different environments.
PAGE 4
Installation and Configuration Overview This overview shows the outline of the steps covered in this deployment guide. 1. What to Order 2. Getting Started a. Hardware Setup b. Network Planning 3. Gather Required Software 4. OS Installation 5. Storage Array Configuration 6. Preparing the Servers a. Fibre Channel Driver b. Shared Storage Configuration c. Network Configuration 7. Serviceguard for Linux and Related Software Installation 8. Serviceguard for Linux Configuration a. Server Configuration b.
PAGE 5
http://docs.hp.com → High Availability (under “Software Products & Solutions”) → Serviceguard for Linux – Managing HP Serviceguard for Linux – HP Serviceguard for Linux Version A.11.19 Release Notes – Installing and Configuring Apache Toolkit for Serviceguard for Linux – Securing Serviceguard http://docs.hp.com → Network and Systems Management (under “Internet and Networking”) → System Administration → Installation and User’s Guide – Distributed Systems Administration Utilities User’s Guide http://www.hp.
PAGE 6
coincide with support contracts on hardware if desired. This solution also includes support for Red Hat, 3-year Red Hat Enterprise Linux Advanced Platform 24x7 either 1 to 2 sockets or unlimited sockets depending upon the server chosen (visit http://www.hp.com/go/proliantrhel for more information). Please note that support is highly recommended for all high availability solutions.
PAGE 7
Figure 1. Network and Storage Topology Network Switch clients Switch bond0 eth2 bond0 eth3 eth2 Switch eth0 eth3 eth0 Node 1 Node 2 Required Networking Information: 1. Get static IP Addresses for the following: a. 2 IP addresses and hostnames with subnet mask, one for each server b. 2 relocatable IP addresses (1 for consolidated logging package, 1 for sample package), DNS names (optional) and subnet mask c.
PAGE 8
Field Example Customer [fill-in] DNS Name for clog package (optional) Relocatable IP Address for ws Package DNS Name for ws package (optional) Subnet (Network) and Subnet Mask Not used in this example 16.89.84.218 Not used in this example 16.89.84.128, 255.255.255.128 Gateway 16.89.84.129 DNS Server Address 16.110.135.51, 16.110.135.52 Subnet Mask (Private heartbeat network) Not used in this example NTP Server Address 15.36.88.4 Table 2.
PAGE 9
4. Serviceguard for Linux Patches Currently, there are no patches available for Serviceguard and Serviceguard Manager. It is recommended that you download the most recent Serviceguard patches when available for Serviceguard for Linux A.11.19. Patches can be downloaded from HP Support Centre at http://www.hp.com/go/hpsc. 5. Java JDK Serviceguard Manager, the browser-based management interface for Serviceguard, requires Java 1.5 JDK or greater. JDK 6 Update 13 or later is recommended.
PAGE 10
7. On the “Software download confirmation” page, click “Download Directly >>”. At the time of publication, the version of the toolkit available was A.04.00-0. The downloaded file for this version is named sglxtools-A.04.00-0.product.redhat.tar. 8. Linux Driver Kit for the Fibre Channel HBAs Download the latest driver from Hewlett-Packard for the Fibre Channel host bus adapters ordered with the MSA2000.
PAGE 11
4. Watch the screen on the console for the following messages: Slot 0 HP Smart Array 6i Controller … Press [F8] to run the Optional ROM Configuration Arrays Utility 5. Hit F8 to pull up ORCA (Optional ROM Configuration for Arrays) to create a logical drive on the local disk. a. Select Create logical drive. b. Select appropriate RAID level (depends on number of local hard drives available and preference). c. Save the configuration. d. Exit ORCA. 6. Let the boot process flow through to install from DVD. 7.
PAGE 12
20. After reboot, go through the post-installation steps (from the console window). a. Welcome – click “Forward”. b. License Agreement – Select “Yes” to agree to the terms and click “Forward”. c. Enable Firewall (default is enabled) i. Make sure to allow ssh, allowed by default, and www (http). NOTE: http (port 80) is required by the optional Serviceguard package. You can omit http if not configuring the optional Serviceguard package and http is not otherwise needed.
PAGE 13
4. Install the rpms. For example: rpm –ivh kernel-2.6.18-92.el5.i686.rpm rpm –ivh kernel-devel-2.6.18-92.el5.i686.rpm 5. Edit (or check) the grub.conf file so that it boots the appropriate kernel. Update the “title” line, the “kernel” line to point to the new vmlinuz file under /boot and the “initrd” line to the new initrd file. The rpm install may have done these edits for you. For example: vi /boot/grub/grub.conf default=0 timeout=5 splashimage=(hd0,0)/grub/splash.xpm.
PAGE 14
2. If not installed, locate the lm_sensors rpm on the DVD under the Server directory, and install it. For example: 3. To check if net-snmp is installed, run the following command: NOTE: By default, net-snmp-libs is already installed. Inspect the output carefully to determine if net-snmp-5.3.1-24.el5, for example, is installed. 4. If not installed, locate the net-snmp rpm on the DVD under the Server directory, and install it. For example: The libXp package is required for Serviceguard Manager. 1.
PAGE 15
Plug in the Fibre Channel cables as follows: 1. Host 1 – plug 2 Fibre Channel cables from the dual channel HBA to the MSA2000 to a. Controller A Port 0 b. Controller B Port 0 2. Host 2– plug 2 Fibre Channel cables from the dual channel HBA to the MSA2000 to a. Controller A Port 1 b. Controller B Port 1 Figure 2.
PAGE 16
4. At the prompt, enter the “set network-parameters” command to configure the IP address for the controller connected to the network. For example, type the following command (as a single command): NOTE: It is assumed that one of the controllers is already connected to a network switch using an Ethernet cable. In this example, the Ethernet cable is plugged into controller A. 5. To verify the setting, enter the following command: 6. Disconnect from the CLI and exit the emulator.
PAGE 17
2. Set the a. b. c. d. date and time. Click “MANAGE“ in the left-hand pane. Click “GENERAL CONFIG” in the left-hand pane. Click “set date/time” in the left-hand pane. If NTP is available, locate the “Obtain Time with NTP” frame. i. Select Enable NTP ii. Enter the NTP Server Address, for example 15.36.88.4 e. Set current date, if incorrect, in “Set MSA Storage System Date” frame. f. Set current time, if incorrect, in “Set MSA Storage System Time” frame. g. To save changes, click the “Save Date/Time” button.
PAGE 18
vii. Click the “Create Virtual Disk” button. m. To add volumes to virtual disk “edenshare”, enter the following: Volume # Volume Size – Mbytes Volume Name 1 100 edenshare_lockLUN 2 200 edenshare_ws 3 300 edenshare_clog n. Click the “Add Volumes” button. NOTE: It could take a few hours to initialize the virtual disk depending on the size and RAID level. By default the virtual disk will be initialized “Online”, so it can be used immediately.
PAGE 19
If the QLogic driver is not installed, there will be no output from this command. If the QLogic driver is already installed, you will see command output showing the version, for example: 2. If it is an earlier version than the one downloaded, remove it: 3. Change to the directory where the kit has been downloaded, for example: cd /tmp/sglx_install 4. Untar the driver kit using the following command: 5. Change directory to the hp_qla2x00-yyyy-mm-dd directory. For example, 6.
PAGE 20
path_checker hardware_handler failback no_path_retry rr_min_io tur "0" immediate 12 100 } 3. Restart the multipath daemon by executing the following commands: /etc/init.d/multipathd restart /sbin/multipath 4. To view status of multipath devices, execute the following command: /sbin/multipath -ll The sample output shows there are 3 mpaths to the 3 volumes created on the MSA, dm-4, dm-3, and dm-2 and the physical paths they are mapped to, for example, dm-4 maps to sdc and sdf.
PAGE 21
Shared Volume Volume Name (on the MSA) Cluster lock LUN edenshare_lockLUN ws package LUN edenshare_ws clog package LUN edenshare_clog Standard device paths /dev/sda, /dev/sdd /dev/sdb, /dev/sde /dev/sdc, /dev/sdf Device Mapper persistent name Partition size Mount point /dev/mapper/mpath0p1 100 MB n/a /dev/mapper/mpath1p1 200 MB /ws /dev/mapper/mpath2p1 300 MB /clog Table 3.
PAGE 22
Command action e extended p primary partition (1-4) p Partition number (1-4): 1 First cylinder (1-24, default 1): 1 Using Last cylinder or +size or +sizeM or +sizeK (1-1016, default 1016): 1016 Command (m for help): t Selected partition 1 Hex code (type L to list codes): 8e Changed system type of partition 1 to 8e (Linux LVM) Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. Syncing disks. 3.
PAGE 23
b. If it is not a partitioned LUN, execute the following commands: pvcreate -f /dev/mapper/mpath1 vgcreate /dev/vgws /dev/mapper/mpath1 lvcreate -L 180M -n lvol1 vgws mke2fs -j /dev/vgws/lvol1 mkdir /ws vgchange -a n vgws 2. To create a logical volume for the clog package, do the following: a.
PAGE 24
2. Import the volume groups by running the vgscan command. vgscan Reading all physical volumes. This may take a while... Found volume group "vgclog" using metadata type lvm2 Found volume group "vgws" using metadata type lvm2 NOTE: If the volume groups, vgws and vgclog are not found, reboot the server. 3. Create the mount points mkdir /ws mkdir /clog 4. Backup the volume group configurations vgcfgbackup /dev/vgws /dev/vgclog 5.
PAGE 25
4. Edit the ifcfg-ethN file to contain the following content. Remove existing entries, if any, except for “DEVICE” and “HWADDR”. Make sure that the HWADDR field matches the specific MAC address for the card, do not use the value listed here. Here is an example for ifcfg-eth3: 5. Edit /etc/modprobe.conf to add the following 2 lines (the second and third lines shown here should be input as one line): 6. Restart the network from console: /etc/init.
PAGE 26
1. Check the /etc/services file for well-known reserved ports to look for an unreserved port, for example: more /etc/services 2. Verify that an unreserved port from step 1 is not in use by running the “netstat –an” command and searching the output to ensure the selected port is not in use: netstat –an Serviceguard for Linux and Related Software Installation Java JDK Serviceguard Manager requires Java JDK 1.5 or greater.
PAGE 27
which is required by Serviceguard Manager and Tomcat. For the Java JDK installation described earlier, the path will be usr/java/jdk1.6.0_13/bin/java. If you do not know where java is installed, you can try to search the server’s file system using the “find” command, for example “find / -name java”. Look for the java file in the bin directory of the JDK. The script comes with its own README. Refer to the README for additional information. To run 1. 2. 3. 4. 5. 6. 7.
PAGE 28
Set up the PATH and MANPATH environment variables Add cluster node entries to /etc/hosts Configure the firewall (if enabled) with Serviceguard-specific settings Configure the /etc/nsswitch.conf settings Configure lvm for exclusive volume group activation This script should be run from one of the servers and will perform configuration updates for all nodes intended for the cluster. The user will be prompted for the list of servers.
PAGE 29
#nodes participating in the cluster, repeat these pairs #for each cluster member node being configured. #Note: The HOSTNAME and IP_ADDR parameters are a pair of # parameters and need to be # specified together. ############################################################ HOSTNAME= adam.cup.hp.com IP_ADDR= 16.89.84.245 HOSTNAME= eve.cup.hp.com IP_ADDR= 16.89.84.
PAGE 30
c. Deactivate the volume group: umount /dev/vgws/lvol1 vgchange -a n vgws vgchange –-deltag $(uname –n) vgws 2. Repeat the steps on the second server. You should see the content from each server in the test file. Configure the Cluster In the next steps, you will create the cluster, define the node membership, configure the cluster heartbeat and cluster lock LUN device. 1. From an internet browser such as Internet Explorer, invoke HP System Management Homepage, https://[hostname]:2381.
PAGE 31
d. Administration -> Halt Node (select eve) Configure the Consolidated Log Package The consolidated logging tool is used to consolidate syslog and package log files from all nodes in the cluster. Configuration is done through a wizard in the Serviceguard Manager to create a clog package in Serviceguard. This makes the consolidated logging tool highly available. 1. In your browser on the HP Serviceguard Manager Summary page, go to the “Configuration” menu and select “Configure Log Consolidation Tool…” 2.
PAGE 32
Create Package from Serviceguard Manager 1. From your browser on the “HP Serviceguard Manager Summary” page, go to the “Configuration” menu and select “Create a Package…”. 2. Under the “Create a Modular Package” heading, you will find a link to create legacy package. Click on the link to create a legacy package. Enter the Package name, for example: ws Keep other defaults (for example, Type = Failover package). 3. Go to the “Monitored Resources” tab. a. Check the Subnet, for example: 16.89.84.128 b.
PAGE 33
k. l. Locate the string “ ”. Add the following customer defined run command, “/usr/local/cmcluster/conf/ws/toolkit.sh start”, such that the function looks like the following: function customer_defined_run_cmds { # ADD customer defined run commands. : # do nothing instruction, because .. /usr/local/cmcluster/conf/ws/toolkit.sh start test_return 51 } m. Locate the string “ ”. n. Add the following customer defined halt command, “/usr/local/cmcluster/conf/ws/toolkit.
PAGE 34
2. From the “Administration” menu and select “Run Package”. NOTE: You may need to start the cluster if it is not already running. To run the cluster, go the “Administration” menu and select “Run Cluster”. Create Sample html content for the Package In the following steps, you will create an html file for the “ws” package. 1. Login to the cluster node that is currently running the “ws” package. 2.
PAGE 35
search the entire system under “/”. Look for the result under the JDK, not the JRE, for example, /usr/java/jdk-1.6.0_13/bin/java. Then run /opt/hp/hpsmh/tomcat/bin/tomcat_cfg to input the correct path to the Java. Problem: Error configuring consolidated log using the Wizard when attempting to apply the configuration. ERROR: Command /etc/init.d/syslog-ng start failed on node adam. ERROR: Command /etc/init.d/syslog-ng start failed on node eve.