ClusterPack V2.5 Release Note Manufacturing Part Number: T1843-90014 E0507 U.S.A. © Copyright 2002-2007 Hewlett-Packard Development Company, L.P.
Legal Notices The information in this document is subject to change without notice. Hewlett-Packard makes no warranty of any kind with regard to this manual, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose. Hewlett-Packard shall not be held liable for errors contained herein or direct, indirect, special, incidental or consequential damages in connection with the furnishing, performance, or use of this material. Warranty.
ClusterPack V2.5 Release Note Announcement ClusterPack V2.5 Release Note Announcement This release note describes the release of ClusterPack V2.5. NOTE ClusterPack V2.5 supports both HP-UX 11iv2 and HP-UX 11iv3. The cluster operating system should be the same for the management server and all Compute Nodes. Mixing HP-UX 11iv2 and HP-UX 11iv3 within the same cluster is not supported.
ClusterPack V2.5 Release Note What’s in This Version What’s in This Version Benefits Manageability is one of the key considerations in cluster technology. ClusterPack V2.5 provides several benefits to system management.
ClusterPack V2.5 Release Note What’s in This Version • Easy upgrade path from supported ClusterPack versions. • Improvements to the online tutorial New command line utility for cluster power management (clpower) This utility performs multiple power operation on Compute Nodes using the Management Processor interface. System administrators will be able to use this utility to turn the power on and off, turn the indicator lights on and off, and inquire about the power status of Compute Nodes.
ClusterPack V2.5 Release Note What’s in This Version Support for non-intrusive Compute Node addition and deletion The Compute Nodes in the cluster that are not candidates for addition or removal will not be touched during these operations. Jobs can continue to run on those nodes while these operations are being performed. Removal of key configuration restrictions ClusterPack now has the ability to configure cluster networking with just the management LAN. It also now works in NIS and non-NIS environments.
ClusterPack V2.5 Release Note Known Problems and Workarounds Known Problems and Workarounds • ClusterPack V2.5 does not support secure shell ssh. • Giving clsh an unknown node name will cause the application to terminate. • The InfiniBand drivers are not active following a Golden Image installation of a Compute Node. The IB4X-00 driver bundle can be swcopy'd to the ClusterPack depot /var/opt/clusterpack/depot.
ClusterPack V2.5 Release Note QuickStart Install Instructions QuickStart Install Instructions If you have installed ClusterPack before, follow the instructions in this section as a quick reminder. Refer to “Comprehensive Install Instructions” on page 13 for detailed instructions. If you have not installed ClusterPack before, use the Comprehensive Install Instructions section instead. This QuickStart Guide does NOT cover the use of Golden Images.
ClusterPack V2.5 Release Note QuickStart Install Instructions • HP-UX 11iv2 TCOE • HP-UX 11i Ignite-UX (B5725AA) For HP-UX 11iv3 Install the following software on the Management Server. • HP-UX 11iv3 TCOE • HP-UX 11i Ignite-UX (IGNITE) Install the following software on each Compute Node. • HP-UX 11iv3 TCOE • HP-UX 11i Ignite-UX (IGNITE) Allow the default choices to install. ClusterPack requires a homogeneous operating system environment.
ClusterPack V2.5 Release Note QuickStart Install Instructions HP-UX 11iv2 • /var - 4GB • /opt - 4GB HP-UX 11iv3 • /var - 8GB • /opt - 4GB Step 4. Obtain a License File • Get the Host ID number of the Management Server. • Contact Hewlett-Packard Licensing Services to redeem your license certificates. • If you purchased the ClusterPack Base Edition, redeem the Base Edition license certificate. NOTE It may take up to 24 hours to receive the license file. Plan accordingly. Step 5.
ClusterPack V2.5 Release Note QuickStart Install Instructions • Log onto the switch through the console. • Type set up. • Select IP Config and select the manual option. • Select the IP address field and enter the IP address to be used for the switch. Step 8. Copy the License Files to the Management Server • Put the files in any convenient directory on the Management Server (e.g. /tmp). Step 9.
ClusterPack V2.5 Release Note QuickStart Install Instructions Step 12. Power Up the Compute Nodes Use the clbootnodes program to power up all Compute Nodes that have a connected Management Processor that you specified in the previous step. Provide the following information to the Compute Nodes: • Language to use • Host name • Time and time zone settings • Network configuration • Root password Step 13.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Comprehensive Install Instructions ClusterPack uses a two-stage process for setting up an HP-UX cluster. 1. Create a base configuration with a Management Server and one Compute Node. a. Prepare for installation. b. Install and configure the Management Server. c. Install and configure the initial Compute Node and its Management Processor. d. Verify the Management Server and the initial Compute Node. 2.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Background ClusterPack simplifies the creation and administration of a cluster of HP Integrity Servers running HP-UX by automating the collection, recording, and distribution of information about the systems in a network. The system administrator must still make decisions about how to identify and secure those network components. All of these decisions can be recorded on this form which is then used as the installation process is performed.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Background ClusterPack works on HP Integrity Servers running HP-UX. In order to install ClusterPack, the Technical Computing Operating Environment (TCOE) version of HP-UX must be installed. You must also have the Ignite-UX software, which is used for installation. Installing Ignite-UX on the Compute Nodes makes it possible to create and distribute ‘Golden Images’ from the Compute Nodes.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Details Install these items when you do a fresh install of HP-UX on the Management Server and the Compute Nodes. Or, Ignite-UX can be installed after rebooting using the following method: • Using the HP-UX 11iv2 or HP-UX 11iv3 TCOE DVD, mount and register the DVD as a software depot. • Install the Ignite-UX software on the Management Server using swinstall.
ClusterPack V2.5 Release Note Comprehensive Install Instructions • /var - 8GB • /opt - 4GB Details Allocate space for these file systems when you do a fresh install of HP-UX on the Management Server. To resize /opt 1. Go to single user mode. a. # /usr/sbin/shutdown -r now b. Interrupt auto boot. c. Select the EFI shell. d. Select the appropriate file system. (Should be fs0: but may be fs1:) Shell> fs0: e. Boot HP-UX. fs0:\>hpux f. Interrupt auto boot. g. Boot to single user mode.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Background For the ClusterPack Base Edition, please refer to the Base Edition license certificate for instructions on redeeming your license. As part of the normal installation and configuration process, you will be asked to provide the license key(s). ClusterPack will install the license files in the correct location(s), and all licensing services will be started. Overview • Get the Host ID number of the Management Server.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Overview Get a serial console cable long enough to reach all of the Compute Nodes from the Management Server. Details In order to allow the Management Server to aid in configuring the Management Processors, it is necessary to have a serial console cable to connect the serial port on the Management Server to the console port on the Management Processor that is to be configured.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Details • Select an IP address from the same IP subnet that will be used for the Compute Nodes. • Connect a console to the switch. • Log on to the switch through the console. • Type set up. • Select IP Config and select the manual option. • Select the IP address field and enter the IP address to be used for the switch. Step 8.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Overview • Mount and register the ClusterPack DVD as a software depot. • Install the ClusterPack Manager software (CPACK-MGR) using swinstall. • Leave the DVD in the DVD drive for the next step. Details How to mount a DVD on a remote system to a local directory On the system with the DVD drive (i.e. remote system) 1. Mount the DVD. % mount /dev/dsk/xxx /mnt/dvdrom 2. Edit the /etc/exports file.
ClusterPack V2.5 Release Note Comprehensive Install Instructions 7. Unexport the DVD file system. % exportfs -u -i /mnt/dvdrom 8. Unmount the DVD. % /etc/umount /mnt/dvdrom How to enable a DVD as a software depot During the installation process, two DVDs will be required. Generic instructions for making a DVD accessible as a software depot for installation onto the Management Server are provided here. Please refer to the steps that follow for the specific DVDs that are required.
ClusterPack V2.5 Release Note Comprehensive Install Instructions On the Management Server: % /usr/sbin/swinstall -s : /mnt/dvdrom CPACK-MGR • The ClusterPack DVD will be referenced again in the installation process. Please leave it in the DVD drive until the "Run manager_config on the Management Server" step has completed. Step 10. Run manager_config on the Management Server Background This program is the main installation and configuration driver.
ClusterPack V2.5 Release Note Comprehensive Install Instructions • Configure Cluster Management Software tools. The Management Server components of HP System Management Tools (HP Systems Insight Manager) is also configured if selected. • Print a PASS diagnostic message if all of the configuration steps are successful.
ClusterPack V2.5 Release Note Comprehensive Install Instructions manager_config is an interactive tool that configures the Management Server based on some simple queries. Most of the queries have default values assigned and you just need to press RETURN to assign those default values. Step 11. Run mp_register on the Management Server Background A Management Processor (MP) allows you to remotely monitor and control the state of a Compute Node.
ClusterPack V2.5 Release Note Comprehensive Install Instructions the /etc/hosts file. This name is derived as the name of the associated host appended with -mp (for Management Processor). For example, the MP associated with the host foo will be named foo-mp. Overview Provide the following information to the mp_register program about each MP card that is connected to a Compute Node. It will configure all of the MPs automatically, instead of requiring you to manually connect the MP to a serial console device.
ClusterPack V2.5 Release Note Comprehensive Install Instructions NOTE clbootnodes can only be used to boot nodes to the language specification: English The first time that HP-UX is booted after installation, it asks a series of questions: • What language to use • Hostname • Time and Time zone settings • Networking configuration • Root password Booting each node in a medium to large cluster can be a long and tedious task.
ClusterPack V2.5 Release Note Comprehensive Install Instructions • Keyboard selection: The keyboard selection is US English. • Time Zone: The time zone information is determined based on the setting of the Management Server. • Time: The current time is accepted. The time will later be synchronized to the Management Server using NTP. • Networking: The LAN card specified will be configured to the IP address specified through manager_config.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Step 13. Run compute_config on the Management Server Background This tool is the driver that installs and configures appropriate components on every Compute Node.
ClusterPack V2.5 Release Note Comprehensive Install Instructions • A netmask To define additional networks, use the command clnetworks. This tool is also called from compute_config. clnetworks provides a text-based interface for selecting nodes, network interfaces and IP addresses. It guides the user through the creation of a network. It is also possible to modify an existing network.
ClusterPack V2.5 Release Note Comprehensive Install Instructions compute_config can be used to install IB drivers on Compute Nodes following a Golden Image installation. This re-installation of the drivers will allow them to work properly. To use the function, the IB driver bundle (i.e.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Details Finalize and validate the installation and configuration of the ClusterPack software. % /opt/clusterpack/bin/finalize_config Step 16. Create a Golden Image of a Compute Node from the Management Server Background A system image is an archive of a computer’s file system. Capturing the file system of a computer captures the basic state of a computer system. An image does not generally include all files however.
ClusterPack V2.5 Release Note Comprehensive Install Instructions • In addition, you should either wait until all running jobs complete, or suspend them. % bstop -a -u all -m • Execute sysimage_create on the Management Server and pass the name of the file from which you would like the image to be made. For example: % /opt/clusterpack/bin/sysimage_create • Monitor the output for possible error conditions.
ClusterPack V2.5 Release Note Comprehensive Install Instructions % /opt/clusterpack/bin/sysimage_register If the image was created with sysimage_create, the full path of the image was displayed by sysimage_create.
ClusterPack V2.5 Release Note Comprehensive Install Instructions Overview This program completes the installation and configuration process, verifies the Cluster Management Software, and validates the installation. If it reports diagnostic error messages, repeat the installation process, performing all the steps in the order specified. Details Finalize and validate the installation and configuration of the ClusterPack software.
ClusterPack V2.5 Release Note Upgrading from V2.4 to V2.5 Upgrading from V2.4 to V2.5 ClusterPack V2.5 supports an upgrade path from ClusterPack V2.4. Customers that currently deploy ClusterPack V2.4 on HP Integrity servers use HP-UX 11i Version 2.0 TCOE. ClusterPack V2.5 provides a mechanism for the use of the majority of V2.4 configuration settings for the V2.5 configuration. Before starting the upgrade, it is important to have all of your Compute Nodes in good working order.
ClusterPack V2.5 Release Note Upgrading from V2.4 to V2.5 Step 7. Install the new software on the Compute Nodes. (The -u is important.) % /opt/clusterpack/bin/compute_config -u Step 8. Verify that everything is working as expected.
ClusterPack V2.5 Release Note Upgrading from V2.3 to V2.5 Upgrading from V2.3 to V2.5 ClusterPack V2.5 supports an upgrade path from ClusterPack V2.3. Customers that currently deploy ClusterPack V2.3 on HP Integrity servers use HP-UX 11i Version 2.0 TCOE. ClusterPack V2.5 provides a mechanism for the use of the majority of V2.3 configuration settings for the V2.5 configuration. Before starting the upgrade, it is important to have all of your Compute Nodes in good working order.
ClusterPack V2.5 Release Note Upgrading from V2.3 to V2.5 Step 7. Install the new software on the Compute Nodes. (The -u is important.) % /opt/clusterpack/bin/compute_config -u Step 8. Verify that everything is working as expected.
ClusterPack V2.5 Release Note Licensing Licensing ClusterPack V2.5 uses FLEXlm licensing technology. A license is required before the product is installed. One ClusterPack license is required for each CPU in the cluster. Licenses can be redeemed through HP Software Licensing by phone, e-mail, or fax. Please refer to the license certificate for instructions on redeeming your license. The license keys are node-locked to the Management Server.
ClusterPack V2.5 Release Note Associated Documentation Associated Documentation You may review online documents from the ClusterPack V2.5 DVD by pointing your browser to /CPACK-HELP/Tutorials/opt/clusterpack/ share/help/ohs/index.html. • ClusterPack Tutorial http://www.hp.com/techservers/clusterpack_tutorial/ or by pointing your browser to /CPACK-HELP/Tutorials/opt/ clusterpack/share/help/ohs/index.html.
ClusterPack V2.5 Release Note Associated Documentation • Documentation for HP Integrity Servers is available at http://docs.hp.com/hpux/hw/index.html • MPI documentation is available at http://www.hp.
ClusterPack V2.5 Release Note Software Availability in Native Languages Software Availability in Native Languages There is no information on non-English languages for ClusterPack V2.5.
ClusterPack V2.5 Release Note Support Information Support Information Support for ClusterPack V2.5 may be ordered, and service will be provided by the HP Response Center. Please refer to your support contract. Technical support is also available via http://www.hp.com/techservers or http://www.hp.com/techservers/clusters/hptc_clusterpack.html All users can access Hewlett-Packard’s Electronic Support Center on the World Wide Web where you can search for bug descriptions, updates, and available patches.
