HP StorageWorks Clustered File System 3.6.
Legal and notice information © Copyright 1999‐2009 Hewlett‐Packard Development Company, L.P. Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendorʹs standard commercial license. The information contained herein is subject to change without notice.
Contents 1 HP Technical Support HP Websites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 2 Configuration Information Supported Hardware. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Supported HBA Drivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Server Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Network Configuration Requirements . . . . . . . . . .
Contents 11. Create LUNs for the Membership Partitions and Modify Partition Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12. Log Into iSCSI Targets (iSCSI Configurations Only). . . . . . . 13. Run the mxcheck Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14. Install HP StorageWorks Clustered File System . . . . . . . . . . 15. Install Hardware Snapshot Software (Optional) . . . . . . . . . . 16. Configure the Cluster. . . . . . . . . . . . . . .
Contents Web Management‐Based Fencing . . . . . . . . . . . . . . . . . . . . . . . . . 53 Sample Configuration Script . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54 Command Descriptions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1 HP Technical Support Telephone numbers for worldwide technical support are listed on the following HP website: http://www.hp.com/support. From this website, select the country of origin. NOTE: For continuous quality improvement, calls may be recorded or monitored.
2 Configuration Information Supported Hardware HP is continually expanding its supported hardware and operating system configurations. For the latest information, see the HP QuickSpecs for HP X5500 Storage Gateway for Windows on http://www.hp.com. The following hardware can be used in an HP Clustered File System cluster. Hardware Configuration Limit Servers Two to 16 servers. Network Interface Cards (any card supported by Microsoft Windows 2003) Up to four network interfaces per server.
Chapter 2: Configuration Information 3 Supported HBA Drivers Before you install HP Clustered File System, we recommend that you install a supported HBA driver on the servers that will be in the cluster. If you do not install a supported driver, the operating system will select the default driver, which has not been validated with HP Clustered File System. Do not install the Emulex driver provided on the Windows CD, as it supports only arbitrated loop mode.
Chapter 2: Configuration Information 4 • Microsoft Windows Script Host (WSH) is required and should not be disabled. • The HP Management Console requires that the display be set to a minimum of 256 colors. • The minimum resolution for the HP Management Console is 1024x768. • HP Clustered File System has been verified with the English locale. To ensure that file times are consistent across the cluster, it is recommended that all cluster servers operate with synchronized time‐of‐ day clocks.
Chapter 2: Configuration Information 5 select Properties to display the window. Then select Advanced > Advanced Settings to see the Adapter and Bindings tab.) • HP Clustered File System supports only one “physical” IP address per subnet per NIC per node. If additional IP addresses are needed on the same subnet, use HP Clustered File System virtual hosts instead of adding additional IP addresses directly to the NIC. • For iSCSI configurations, we recommend that the storage be on a separate network.
Chapter 2: Configuration Information 6 NOTE: You can attach a cluster server to other SANs that are not under HP Clustered File System control. These SANs can include tape drives and non‐PSFS filesystems. You can use Windows utilities or other applications to access these devices and filesystems.
Chapter 2: Configuration Information 7 domain ID 7. Domain ID 6 must not exist on the fabric containing switch2 and domain ID 7 must not exist on the fabric containing switch1. Requirements for Active Directory HP Clustered File System requires that Active Directory be configured. You should be aware of the following: • With Windows 2003, all HP StorageWorks X5500 Network Storage Gateway for Windows (HP X5500 Storage Gateway for Windows) nodes must be members of an Active Directory domain.
3 Install HP StorageWorks Clustered File System This chapter describes how to perform a new installation of HP X5500 Storage Gateway for Windows on servers running Microsoft Windows. Contents of the HP Clustered File System Distribution The HP Clustered File System distribution contains the following files: • MxS_3.6.1...msi. The HP Clustered File System software package. The software is available in 32‐bit and 64‐bit versions.
Chapter 3: Install HP StorageWorks Clustered File System 9 • \documentation. Contains the HP Clustered File System product documentation in PDF format. Check http://www.hp.com/support/ manuals for the latest versions of the documents.
Chapter 3: Install HP StorageWorks Clustered File System 10 Files\Hewlett‐Packard\HP Clustered File System\conf\mounts and only NTFS filesystems support mount points. Install Microsoft Hot Fix HP recommends that you install the hotfix provided with the following Microsoft Knowledge Base article. The hotfix contains an updated Storport storage driver which corrects conditions that can cause the system to restart unexpectedly. http://support.microsoft.
Chapter 3: Install HP StorageWorks Clustered File System Action Description Review configuration requirements. See Chapter 2 for configuration requirements, including disabling 802.3x Ethernet flow control on all NICs. Set up the DNS hostname. HP Clustered File System requirements for DNS are located in section “1. Set Up the DNS Hostname” on page 12. Configure the server for WINS clients. This step is needed only if the server will be accessed by WINS clients. Install a firewall (optional).
Chapter 3: Install HP StorageWorks Clustered File System Action Description Install snapshot software (optional). This step is needed only if you will be using the hardware snapshot feature. Configure the cluster. Create an initial cluster configuration on one server, export that configuration to the other servers, and then start the HP Clustered File System service on all servers.
Chapter 3: Install HP StorageWorks Clustered File System 13 • Set up a DNS suffix. Select My Computer > Properties > Network Identification > Properties. On the Identification Changes window, select More. Then, on the DNS Suffix and NetBIOS Computer Name window, type the fully qualified domain name as the “Primary DNS suffix of this computer.” • Add the server to the suffix search list. Select Settings > Control Panel > Network and Dial‐Up Connections. Then select any network connection.
Chapter 3: Install HP StorageWorks Clustered File System 14 File System Administration Guide for more information about the ports used by HP Clustered File System. 5. Reboot the Server Reboot the server. This step ensures that the registry is in a known good most‐recent state. You may also want to back up the current state of the server (such as files, registry, and so on). Repeat steps 1–5 on each server that will be in the cluster. 6.
Chapter 3: Install HP StorageWorks Clustered File System 15 software. For information about HP’s MPIO software for HP arrays, check the following link: http://h18006.www1.hp.com/products/sanworks/softwaredrivers/ multipathoptions/windows.html. 9. Set Parameters for MPIO Software Different MPIO software solutions may require specific configuration steps. This section documents known setup for HP’s MPIO software in order for it to work with HP Clustered File System.
Chapter 3: Install HP StorageWorks Clustered File System 16 #(This parameter should not be set except in very specific cases!) # #allow_any_disk 0 On the last line, remove the # sign preceding allow_any_disk and change the value to 1: allow_any_disk 1 To set no_permanent_mountpoints, locate these lines in the scl.
Chapter 3: Install HP StorageWorks Clustered File System 17 ceases to effectively coordinate and communicate with other servers in the cluster, HP Clustered File System must remove the server’s access to filesystems to preserve data integrity. This step is called fencing. When you configure the cluster later in this procedure, you can select the fencing method that you want to use: • FibreChannel Switch‐based fencing (also called “fabric fencing”).
Chapter 3: Install HP StorageWorks Clustered File System 18 • Modify the SNMP setup. Make the following changes: – Enable access to the SNMP agent from each server that will be in the cluster. – Set the SNMP community string to the desired value. The community string must be the same for all FibreChannel switches. If you are using fabric fencing, ensure that the community string has write privileges. For server‐based fencing, you can optionally configure a read‐only community string.
Chapter 3: Install HP StorageWorks Clustered File System 19 If your disk array software provides the capability to create LUNs, we recommend that you create three LUNs for the membership partitions. Each LUN should contain a minimum of 1 GB. After creating the LUNs, use the Windows Logical Disk Management (WLDM) utility to create a single partition on each LUN. (See “Disk Partition Alignment,” below.) NOTE: When using WLDM to manage your SAN disks, be sure to set the disk type to “Basic.
Chapter 3: Install HP StorageWorks Clustered File System 20 way to avoid the situation is to create an unused partition at the start of the LUN and then ensure that the second partition starts on an aligned boundary. The Windows Logical Disk Manager or utilities such as diskpart can be used to create the partitions.
Chapter 3: Install HP StorageWorks Clustered File System 21 Partition Sizing It is important to properly size the partitions that will be used for membership partitions. (The minimum size is 1 GB.) 12. Log Into iSCSI Targets (iSCSI Configurations Only) Log into each iSCSI target via the iSCSI initiator and set the iSCSI Initiator Properties. On the Log On to Target dialog, be sure to check “Automatically restore this connection when the system reboots.” You will need to complete this step on each server.
Chapter 3: Install HP StorageWorks Clustered File System 22 14. Install HP StorageWorks Clustered File System To install HP Clustered File System, log on as the Administrator and complete these steps: 1. Insert the CD in the CD‐ROM drive. A screen should come up with options that allow you to install the software. If you do not see this automatic installation screen, locate the file MxS_3.6.1...
Chapter 3: Install HP StorageWorks Clustered File System 23 HP EVA Storage Arrays To take hardware snapshots or snapclones on Hewlett‐Packard StorageWorks Enterprise Virtual Array (EVA) storage arrays, a supported version of the HP StorageWorks Scripting System Utility (SSSU) must be installed on all servers in the cluster. Also, a supported version of CommandView EVA software must be installed on your Management Appliance. Be sure that your versions of SSSU and CommandView EVA are consistent.
Chapter 3: Install HP StorageWorks Clustered File System 24 • The partitions or LUNs that you want to use for membership partitions. • If you will be using the snapshot feature, information about the appropriate snapshot method. Connect to the Management Console On one server, select Start > Programs > HP StorageWorks CFS> HP CFS Management Console. On the HP Clustered File System Connect window that appears next, type the IP address or host name of the server in the “Connect to” field.
Chapter 3: Install HP StorageWorks Clustered File System 25 1. Enter a name or description for this Cluster. The cluster name or description appears on the title bar of the HP Management Console. The name or description can contain up to 80 characters. If you will be using a third‐party manager, the name/description will be sent to the manager to help identify the source of SNMP traps or Windows events. 2. License.
Chapter 3: Install HP StorageWorks Clustered File System 26 To install the license, click the Change License File button. Use the browse window that opens next to locate the license file on the server. By default, the license file will be installed at \%System Drive%\Program Files\Hewlett‐Packard\HP Clustered File System\conf\licenses\. 3. Secret Network Key. This password is required. It provides additional security for network communications among the cluster servers.
Chapter 3: Install HP StorageWorks Clustered File System 27 The SAN & Fencing tab allows you to select the method that HP Clustered File System should use to remove access to the SAN. There are two fencing methods: • FibreChannel switch‐based fencing. When a server needs to be fenced, HP Clustered File System will disable the server’s access in the FibreChannel fabric. The server must be rebooted to regain access to the SAN. This method is also called fabric‐based fencing. Web management‐based fencing.
Chapter 3: Install HP StorageWorks Clustered File System 28 Select your storage type and, for FibreChannel, specify the fencing method that you want to use. • Fibre‐Channel switch‐based fencing, below. • Web‐based fencing FibreChannel Switch‐Based Fencing Complete the following on the SAN & Fencing tab: 1. SAN Switches. Specify the hostnames or IP addresses of the FibreChannel switches that are directly connected to the nodes in the cluster.
Chapter 3: Install HP StorageWorks Clustered File System 29 2. SNMP Community String. The default SNMP community string for HP Clustered File System is private. If you want to use a custom community string, enter the appropriate value here. The SNMP community string must be set to the same value on HP Clustered File System and on the SAN switches configured above. When you have completed the information, go to the Storage Settings tab.
Chapter 3: Install HP StorageWorks Clustered File System 30 1. Remote Management Controller Vendor. Select the vendor for your Remote Management Controller. 2. Remote Management Controller ID. Specify how HP Clustered File System should identify the Remote Management Controller associated with each server. Use one of the following methods. – Enter the hostname or IP address for the Remote Management Controller associated with this server.
Chapter 3: Install HP StorageWorks Clustered File System 31 Hostname Suffix. Specify the common suffix to append to each server name to determine the associated Remote Management Controller name. For example, if your server names are server1 and server2 and their Remote Management Controllers are server1‐iLO and server2‐iLO, enter ‐iLO as the suffix. IP Delta. Specify the delta to add to each server’s IP address to determine the IP addresses of the associated Remote Management Controllers.
Chapter 3: Install HP StorageWorks Clustered File System 32 1. Shared configuration. Select the appropriate options. • Vendor and type selections apply to all servers. This option is enabled by default. • Login shared by all servers. Check this option if all servers in the cluster will be sharing the login account that you specified on the Remote Management Controller tab. If the login is not shared, you will be asked for the appropriate logins when the other servers are added to the cluster. 2.
Chapter 3: Install HP StorageWorks Clustered File System 33 If you have FibreChannel‐connected storage and want to configure your FibreChannel switches into the cluster, go to the Switch Information tab. (This step is optional; however, if the switches are configured the HP Management Console can display the switch ports used by the SAN.) 1. SAN Switches. Specify the hostnames or IP addresses of the FibreChannel switches that are directly connected to the nodes in the cluster.
Chapter 3: Install HP StorageWorks Clustered File System 34 Repeat this procedure to specify the remaining FC switches, including cascading switches. 2. SNMP Community String. The default SNMP community string for HP Clustered File System is private. If you want to use a custom community string, enter the appropriate value here. The SNMP community string must be set to the same value on HP Clustered File System and on the SAN switches configured above.
Chapter 3: Install HP StorageWorks Clustered File System 35 1. Membership Partitions. HP Clustered File System uses a set of membership partitions to control access to the SAN and to store the device naming database, which includes the global device names that HP Clustered File System assigns to the SAN disks placed under its control. You will need to select the LUN or disk partitions that should be used as membership partitions.
Chapter 3: Install HP StorageWorks Clustered File System 36 All of the available partitions on that disk or LUN then appear in the bottom of the window. Select one of these partitions and click Add. (The minimum size for a membership partition is 1 GB.) Repeat this procedure to select two more membership partitions. We recommend that the partitions be on different disks. When selecting partitions for use as membership partitions, be sure that they do not contain any needed data.
Chapter 3: Install HP StorageWorks Clustered File System 37 Engenio storage array. You will be asked for the hostnames or IP addresses and the password for your storage array controllers. Apply the configuration. When you have completed the Storage Settings tab, click Apply (at the bottom of the Cluster Configuration window) to save the configuration that you have created. The configuration is then installed on the server that you are using to connect to the Management Console.
Chapter 3: Install HP StorageWorks Clustered File System 38 1. Add servers to the cluster. To specify the first server, click Add Server and type the IP address or hostname of the server on the Input form. Then click OK to add the server to the Address column. Repeat this procedure to add the remaining servers to the Address column.
Chapter 3: Install HP StorageWorks Clustered File System 39 2. Export the configuration. Click Select All to select all of the servers in the Address column. Then click Export. The Last Operation Progress column will display status messages as the configuration is exported to each server. If you are using Web Management‐based fencing, you may be asked for additional information about each server.
Chapter 3: Install HP StorageWorks Clustered File System 40 HP Clustered File System then fences the servers in accordance with the method you specified on the SAN & Fencing tab. If the correct server is not fenced, you will need to check the configuration. For example, if you specified a pattern for the Remote Management Controller, the server may not be configured to use that pattern.
4 Install FS Option for Windows This chapter describes how to perform new installations of the Performance Monitor Service and FS Option for Windows. NOTE: Be sure to install a product version that corresponds to your operating system. Install the 32‐bit version of the software on the 32‐bit operating system, and install the 64‐bit version of the software on the 64‐bit operating system.
Chapter 4: Install FS Option for Windows 42 Performance Monitoring subsystem when there are many cluster state changes. To do this, run the following command once on any of the cluster nodes. (The key will automatically be applied to any new nodes added to the cluster.) \tools\mxdstool.exe set int32 /cluster/perfmon/ noreload_perfext 1 To re‐enable the automatic reload feature, run the following command: \tools\mxdstool.
Chapter 4: Install FS Option for Windows downloaded the software. Then double‐click the file MxFS_CIFS_3.6.1...msi to run the Installation Wizard. Install Hotfixes HP Clustered File System and any associated products (File Serving Option for Windows, Performance Dashboard) must be installed before any product hotfixes are installed.
5 Uninstall HP Software Uninstall HP Clustered File System To uninstall the HP Clustered File System package, select Start > Programs > HP Clustered File System > Uninstall to start the Uninstall Wizard. When you select Remove, you can choose to retain or delete your existing HP Clustered File System configuration files.
6 Other Procedures This chapter describes how to perform the following procedures: • Configure the XIOtech MAGNITUDE Storage Array • Add a new server to a cluster. • Move a server from one cluster to another. • Upgrade the HP Clustered File System license file. Hewlett‐Packard supports Clustered File System with a host of storage arrays from various vendors; however, XIOtech MAGNITUDE storage array needs a few variations described below.
Chapter 6: Other Procedures 46 with this configuration. However, you will need to set up the LUNs that will be used with HP Clustered File System before you begin the HP Clustered File System installation. For information about the LUNs required for HP Clustered File System operations, see “11. Create LUNs for the Membership Partitions and Modify Partition Tables” on page 18.
Chapter 6: Other Procedures 47 Set the Array to Fabric Mode HP Clustered File System requires that storage arrays be configured in fabric mode. You can check the mode setting on the Easy Storage Setup window. For each HAB used for the cluster, the Loop ID must be set to FPort. If you need to change the mode, click the HAB, select the FPort setting, and press Enter. Add a New Server to a Cluster Use the following procedure to add a new server to an existing cluster.
Chapter 6: Other Procedures 48 b. When the Configure Cluster window opens, click Import. On the Import window, type the IP address or DNS name of the server from which you want to import the configuration. 5. Add the new server to the cluster. Go to the Cluster Wide Configuration tab. The Address list shows the servers currently in the cluster. Click the Add button to add the new server to this list. You will be asked for the IP address or hostname of the new server.
Chapter 6: Other Procedures 49 8. Check the drive mappings. When you add a server, the operating system may assign drive letters that do not match the assignments you have made for your shared filesystems on the other nodes. There are several ways to correct this situation: • Use the mx fs unassign command to remove the incorrect drive assignments and the mx fs assign command to establish the correct assignments. • Use the HP Management Console to change drive letter assignments.
Chapter 6: Other Procedures 50 3. Select the server in the Address column, and then click Export. The Last Operation Progress column displays status messages as the configuration is exported to the server. 4. Start HP Clustered File System on the server. The server is still selected in the Address column. Click Start Service to start HP Clustered File System. A status message is displayed in the Last Operation Progress column.
Chapter 6: Other Procedures 51 NOTE: This procedure does not require any down time. Repeat this procedure on each server in the cluster. Upgrade One Server and Export This procedure requires that HP Clustered File System be stopped on all servers. Execute the procedure on one server in the cluster. 1. On one server, select Start > Programs > HP Clustered File System > Management Console.
A Configure the Cluster from the Command Line HP Clustered File System provides mx commands that can be used to create the initial cluster configuration. These commands are equivalent to the Configure Cluster graphical user interface described in Chapter 3 and can be used in configuration scripts. We recommend that you review the description of the Configure Cluster window (see section “16. Configure the Cluster” on page 23) to become familiar with the actions performed by the mx commands.
Appendix A: Configure the Cluster from the Command Line 53 The command sequence is: mx --matrix nodeA config license mx --matrix nodeA config secret mx --matrix nodeA config protocol [Multicast|Unicast] mx --matrix nodeA config santype fc mx --matrix nodeA config fcswitch [--community ] ...
Appendix A: Configure the Cluster from the Command Line 54 mx --matrix nodeA config santype [fc|iscsi] mx --matrix nodeA config fcswitch [--community ] ... (This command is optional for santype fc and not applicable for santype iSCSI.
Appendix A: Configure the Cluster from the Command Line 55 • The values for the mx commands are specified in a file named cluster.conf. • The cluster specified by this script uses FibreChannel switch‐based fencing. • Some commands such as mx config protocol are not included in the script because the default values for those commands will be used. Also note that mx config fcfencing does not need to be specified because that is the default. #!/bin/bash if [ ! -f cluster.conf ]; then echo "you need cluster.
Appendix A: Configure the Cluster from the Command Line 56 MP="6-6005-08B3-0090-A860-22BE-8098-CC0A-0041/1 6-6005-08B3-0090A860-22BE-8098-CC0A-0041/2 6-6005-08B3-0090-A860-22BE-8098-CC0A0041/3" # License File LICENSE="permanent.lic" # Community SNMP String used by Switches COMMUNITY="public" # The Secret Network Key SECRET="secret" # Authentication Information USER="Administrator" PASSWORD="Admin" Command Descriptions The mx commands used in the configuration specify the following information.
Appendix A: Configure the Cluster from the Command Line 57 The default SNMP community string for HP Clustered File System is private. If you want to use a custom community string, include the ‐‐ community option. The SNMP community string must be set to the same value on HP Clustered File System and the SAN switches. mx config fcfencing With FibreChannel switch‐based fencing, when a server needs to be fenced, HP Clustered File System will disable the server’s access in the FibreChannel fabric.
Appendix A: Configure the Cluster from the Command Line 58 mx config webfencing --ruser --vendor --mixedvendor yes|no --hostname |--hostsuffix |--ipdelta [--type reset|shutdown] [--bladeslot ] [--sharedlogin yes|no] [--rpassword ] Configure web management‐based fencing, in which HP Clustered File System uses remote management hardware on the server to remove its access to PSFS filesystems. iSCSI storage must use this fencing method.
Appendix A: Configure the Cluster from the Command Line 59 [--rpassword ] The password for the Remote Management Controller. --ruser The Remote Management Controller user name. [--sharedlogin yes|no] Whether the login account is shared by all servers. --type reset|shutdown When a server needs to be restricted from the SAN, HP Clustered File System can either power‐cycle the server or shut it down. Select the method that you want to use (either reset or shutdown).
Index A L Adding new servers 47 License file upgrade 50 C M Cluster SAN configuration 5, 10 Configuration cluster SAN configuration 5, 10 information 2 network requirements 4 supported hardware 2 Matrix File Serving Solution Pack prerequisites for installation 42 Moving servers 49 MPIO DSM setup 15 F FS Option for Windows installation 42 G Getting help 1 H Hardware supported 2 HP storage website 1 technical support 1 I Installation checklist 10 Management Console 40 installation, solution pack 42
