HP StorageWorks Clustered File System 3.6.
Legal and notice information © Copyright 1999-2008 Hewlett-Packard Development Company, L.P. Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. The information contained herein is subject to change without notice.
Contents 1 HP Technical Support HP Storage Website . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 HP NAS Services Website . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 2 Configuration Information Network Configuration Requirements . . . . . . . . . . . . . . . . . . . . . . . . . 7 Cluster SAN Configuration Guidelines . . . . . . . . . . . . . . . . . . . . . . . . 8 Requirements for Active Directory . . . . . . . . . . . . . . . . . . . . .
Contents Test the Fencing Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Install the Stand-Alone Management Console . . . . . . . . . . . . . . . . . System Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Install and Start the Management Console. . . . . . . . . . . . . . . . . . iv 39 39 39 40 4 Other Procedures Configure the XIOtech MAGNITUDE Storage Array . . . . . . . . . . . “No Mapping/Masking” Mode . . . . . . . . . . . . . . . . . .
1 HP Technical Support Telephone numbers for worldwide technical support are listed on the following HP website: http://www.hp.com/support. From this website, select the country of origin. For example, the North American technical support number is 800-633-3600. NOTE: For continuous quality improvement, calls may be recorded or monitored.
HP Technical Support 6 HP NAS Services Website The HP NAS Services site allows you to choose from convenient HP Care Pack Services packages or implement a custom support solution delivered by HP ProLiant Storage Server specialists and/or our certified service partners. For more information, see us at http://www.hp.com/hps/storage/ns_nas.html. For the latest documentation, go to http://www.hp.com/support/manuals.
2 Configuration Information Network Configuration Requirements All networks used with HP Clustered File System should be configured as follows: • Each network interface card (NIC) must be on a separate physical network. For example, you could use either a separate Ethernet switch for each network or a managed switch that allows network traffic to be isolated. • Each NIC must be on a separate logical IP network. • Network interfaces should be multicast-capable.
Chapter 2: Configuration Information 8 • HP Clustered File System supports only one “physical” IP address per subnet per NIC per node. If additional IP addresses are needed on the same subnet, use HP Clustered File System virtual hosts instead of adding additional IP addresses directly to the NIC. • For iSCSI configurations, we recommend that the storage be on a separate network.
Chapter 2: Configuration Information 9 – Each server must have exactly one path to each of the disks. (This requirement is not necessary if the disks are being managed by third-party MPIO software that can handle multiple paths). See Chapter 2 of the HP Clustered File System Administration Guide for more information about supported cluster configurations. Also see “Administrative Considerations” in Chapter 3 for information about SAN restrictions.
3 Setting Up HP StorageWorks Clustered File System This chapter describes how to configure HP StorageWorks Clustered File System on servers running Microsoft Windows. Contents of the HP Clustered File System Distribution The HP Clustered File System is pre-installed on an HP ProLiant Storage Server running the Windows Storage Server operating system. The following files are included in the \Program Files\Hewlett-Packard\HP Clustered File System folder: • MxConsole_3.6.0..msi.
Chapter 3: Setting Up HP StorageWorks Clustered File System 11 – HP StorageWorks Clustered File System command reference – HP StorageWorks Clustered File System Third Party Software User Authentication HP Clustered File System uses Windows credentials to authorize access to the cluster. By default, members of the machine local administrators group have access to the cluster and can perform all cluster operations.
Chapter 3: Setting Up HP StorageWorks Clustered File System Action Description Set up iLO When booting, press F8 to enter the iLO configuration mode. Set the network information (IP address) and user/password. Set up the DNS hostname. Each server must be able to resolve its hostname in DNS. HP Clustered File System requirements for DNS are located in section “2. Set Up the DNS Hostname” on page 13. Configure the server for WINS clients.
Chapter 3: Setting Up HP StorageWorks Clustered File System Action Description Configure FC switches if necessary. The FibreChannel switches that will be under cluster control need to be configured to enable cluster operations across the SAN. Create LUNs or disk partitions for use as membership partitions. Create LUNs for HP Clustered File System membership partitions. Also make any necessary changes to the partition tables on disks that will contain membership partitions.
Chapter 3: Setting Up HP StorageWorks Clustered File System 14 • Do not list any DNS servers for the private (non-routed or non-client reachable) NICs. For the private NICs and any other public NICs, uncheck the configuration option to “register this connection’s addresses in DNS.” • If you are using dynamic DNS, we recommend that you choose one public NIC to set up as a DNS client. Then list the DNS server(s) in the configuration for this NIC. (Static DNS entries may be preferable to dynamic DNS.
Chapter 3: Setting Up HP StorageWorks Clustered File System 15 We recommend that you disable the following on the private (non-routed or non-client reachable) interfaces: • NetBIOS over TCP/IP • Microsoft Client for Microsoft Networks • File and Print Sharing for Microsoft Networks (the NetBIOS over TCP/ IP or NetBT client) Also leave the DNS and WINS fields blank on the private interfaces. For more information, see Microsoft Knowledge Base Article 193890: http://support.microsoft.com/default.
Chapter 3: Setting Up HP StorageWorks Clustered File System 16 7. Configure the Storage Array Perform the initial configuration of the storage array as described in the product documentation. If you will be using the XIOtech MAGNITUDE storage array, click this title, “PolyServe Data Management Software Configuring the XIOtech MAGNITUDE Array” or search for the document on the www.hp.com web site. 8.
Chapter 3: Setting Up HP StorageWorks Clustered File System 17 HP SecurePath The HP SecurePath product is not included as part of HP HP Clustered File System. HP recommends the use of the newer MPIO DSM software. However, SecurePath software is known to work and is supported. The HP Clustered File System allow_any_disk and no_permanent_mountpoints parameters must be set manually on each server. These parameters are located in the scl.
Chapter 3: Setting Up HP StorageWorks Clustered File System 18 #Set to 1 to disable creation of permanent mountpoints. #(default behavior is that scl will create permanent mountpoints #for all imported devices.) # #no_permanent_mountpoints 0 On the last line, remove the # sign preceding no_permanent_mountpoints and change the value to 1: no_permanent_mountpoints 1 11. Configure FC Switches NOTE: For all FC switches, it is best practice to place each HBA port and its storage ports in a separate zone.
Chapter 3: Setting Up HP StorageWorks Clustered File System 19 Configuring the FibreChannel switches is not required for sites using server-based fencing. However, if the switches are configured as described here, certain HP Clustered File System commands can return more information. To configure FibreChannel switches, complete the following tasks: • Enable server access to the SAN. Each server that will be in the cluster must be able to access the disks in the SAN.
Chapter 3: Setting Up HP StorageWorks Clustered File System 20 12. Create LUNs for the Membership Partitions and Modify Partition Tables HP Clustered File System uses a set of membership partitions to control access to the SAN. The membership partitions are also used to store the device naming database, which includes the global device names that HP Clustered File System assigns to the SAN disks placed under its control. HP Clustered File System can use either one or three membership partitions.
Chapter 3: Setting Up HP StorageWorks Clustered File System 21 Partitions Containing Windows Filesystems If you will be using an existing partition for a membership partition and that partition currently contains a Windows filesystem, then that filesystem must be destroyed. One method for doing this is to delete the partition and then recreate it. This is best done before multiple servers have access to the disk.
Chapter 3: Setting Up HP StorageWorks Clustered File System 22 13. Log Into iSCSI Targets (iSCSI Configurations Only) Log into each iSCSI target via the iSCSI initiator and set the iSCSI Initiator Properties. On the Log On to Target dialog, be sure to check “Automatically restore this connection when the system reboots.” You will need to complete this step on each server. 14.
Chapter 3: Setting Up HP StorageWorks Clustered File System 23 HP EVA Storage Arrays To take hardware snapshots or snapclones on HP StorageWorks Enterprise Virtual Array (EVA) storage arrays, a supported version of the HP StorageWorks Scripting System Utility (SSSU) must be installed on all servers in the cluster. Also, a supported version of CommandView EVA software must be installed on your Management Appliance. Be sure that your versions of SSSU and CommandView EVA are consistent.
Chapter 3: Setting Up HP StorageWorks Clustered File System 24 • If you will be using the snapshot feature, information about the appropriate snapshot method. Connect to the Management Console On one server, select Start > Programs > HP Clustered File System > CFS Management Console. On the HP Clustered File System Connect window that appears next, type the IP address or host name of the server in the “Connect to” field. Then click on the down-arrow on the Connect button.
Chapter 3: Setting Up HP StorageWorks Clustered File System 25 1. Enter a name or description for this Cluster. The cluster name or description appears on the title bar of the HP Management Console. The name or description can contain up to 80 characters. If you will be using a third-party manager, the name/description will be sent to the manager to help identify the source of SNMP traps or Windows events. 2. License.
Chapter 3: Setting Up HP StorageWorks Clustered File System 26 To install the license, click the Change License File button. Type the location of the license file or use the Browse button to locate it. By default, the license file is installed at \%System Drive%\Program Files\Hewlett-Packard\HP Clustered File System\conf\licenses\. 3. Secret Network Key. This password is required. It provides additional security for network communications among the cluster servers.
Chapter 3: Setting Up HP StorageWorks Clustered File System 27 SAN & Fencing Tab When certain problems occur on a server (for example, hardware problems or the loss of cluster network communications), and the server ceases to effectively coordinate and communicate with other servers in the cluster, HP Clustered File System must remove the server’s access to filesystems to preserve data integrity. This step is called fencing.
Chapter 3: Setting Up HP StorageWorks Clustered File System 28 NOTE: After HP Clustered File System is configured, you can verify that it has the correct information to fence each server. See “Test the Fencing Configuration” on page 39. Select your storage type and, for FibreChannel, specify the fencing method that you want to use. (ISCSI storage must use web managementbased fencing.) • Fibre-Channel switch-based fencing, below.
Chapter 3: Setting Up HP StorageWorks Clustered File System 29 1. SAN Switches. Specify the hostnames or IP addresses of the FibreChannel switches that are directly connected to the nodes in the cluster. Click Add, and then specify the hostname or IP address of the first FC switch. Repeat this procedure to specify the remaining FC switches, including cascading switches. If you are using an MPIO configuration, be sure to configure all of the switches. 2. SNMP Community String.
Chapter 3: Setting Up HP StorageWorks Clustered File System 30 The Remote Management Controller tab asks for information about the controllers associated with your servers. 1. Remote Management Controller Vendor. Select the vendor for your Remote Management Controller. 2. Remote Management Controller ID. Specify how HP Clustered File System should identify the Remote Management Controller associated with each server. Use one of the following methods.
Chapter 3: Setting Up HP StorageWorks Clustered File System 31 Controllers (either a hostname suffix or an IP address delta, as described below). Hostname Suffix. Specify the common suffix to append to each server name to determine the associated Remote Management Controller name. For example, if your server names are server1 and server2 and their Remote Management Controllers are server1-iLO and server2-iLO, enter -iLO as the suffix. IP Delta.
Chapter 3: Setting Up HP StorageWorks Clustered File System 32 1. Shared configuration. Select the appropriate options. • Vendor and type selections apply to all servers. This option is enabled by default. • Login shared by all servers. Check this option if all servers in the cluster will be sharing the login account that you specified on the Remote Management Controller tab. If the login is not shared, you will be asked for the appropriate logins when the other servers are added to the cluster. 2.
Chapter 3: Setting Up HP StorageWorks Clustered File System 33 If you have FibreChannel-connected storage and want to configure your FibreChannel switches into the cluster, go to the Switch Information tab. (This step is optional; however, if the switches are configured the HP Management Console can display the switch ports used by the SAN.) 1. SAN Switches. Specify the hostnames or IP addresses of the FibreChannel switches that are directly connected to the nodes in the cluster.
Chapter 3: Setting Up HP StorageWorks Clustered File System 34 Repeat this procedure to specify the remaining FC switches, including cascading switches. 2. SNMP Community String. The default SNMP community string for HP Clustered File System is private. If you want to use a custom community string, enter the appropriate value here. The SNMP community string must be set to the same value on HP Clustered File System and on the SAN switches configured above.
Chapter 3: Setting Up HP StorageWorks Clustered File System 35 1. Membership Partitions. HP Clustered File System uses a set of membership partitions to control access to the SAN and to store the device naming database, which includes the global device names that HP Clustered File System assigns to the SAN disks placed under its control. You will need to select the LUN or disk partitions that should be used as membership partitions.
Chapter 3: Setting Up HP StorageWorks Clustered File System 36 All of the available partitions on that disk or LUN then appear in the bottom of the window. Select one of these partitions and click Add. (The minimum size for a membership partition is 1 GB.) Repeat this procedure to select two more membership partitions. We recommend that the partitions be on different disks. When selecting partitions for use as membership partitions, be sure that they do not contain any needed data.
Chapter 3: Setting Up HP StorageWorks Clustered File System 37 Apply the configuration. When you have completed the Storage Settings tab, click Apply (at the bottom of the Cluster Configuration window) to save the configuration that you have created. The configuration is then installed on the server that you are using to connect to the Management Console. You will then be asked whether you want to start the cluster on that server. If you configured Web management-based fencing, answer No.
Chapter 3: Setting Up HP StorageWorks Clustered File System 38 1. Add servers to the cluster. To specify the first server, click Add Server and type the IP address or hostname of the server on the Input form. Then click OK to add the server to the Address column. Repeat this procedure to add the remaining servers to the Address column. 2. Export the configuration. Click Select All to select all of the servers in the Address column. Then click Export.
Chapter 3: Setting Up HP StorageWorks Clustered File System 39 When HP Clustered File System is running on all of the servers, you can close the Server Configuration window. The installation is now complete. See the HP StorageWorks Clustered File System Administration Guide or the HP Management Console online help for information about configuring the cluster components.
Chapter 3: Setting Up HP StorageWorks Clustered File System 40 • 64 MB memory • Windows 2000, Windows XP, or Windows 2003 Install and Start the Management Console To install the stand-alone Management Console, locate the file MxConsole_3.6.0..msi available under C:\Program Files\HewlettPackard\HP Clustered File System\ManagementConsole\Installer on the cluster nodes, onto the host from where the cluster will be managed. Double-click the file and then run the Installation Wizard.
4 Other Procedures This chapter describes how to perform the following procedures: • Configure the XIOtech MAGNITUDE Storage Array • Add a new server to a cluster. • Move a server from one cluster to another. • Upgrade the HP Clustered File System license file. Hewlett-Packard supports Clustered File System with a host of storage arrays from various vendors; however, XIOtech MAGNITUDE storage array needs a few variations described below.
Chapter 4: Other Procedures 42 with this configuration. However, you will need to set up the LUNs that will be used with HP Clustered File System before you begin the HP Clustered File System installation. For information about the LUNs required for HP Clustered File System operations, see “12. Create LUNs for the Membership Partitions and Modify Partition Tables” on page 20.
Chapter 4: Other Procedures 43 Set the Array to Fabric Mode HP Clustered File System requires that storage arrays be configured in fabric mode. You can check the mode setting on the Easy Storage Setup window. For each HAB used for the cluster, the Loop ID must be set to FPort. If you need to change the mode, click the HAB, select the FPort setting, and press Enter. Add a New Server to a Cluster Use the following procedure to add a new server to an existing cluster.
Chapter 4: Other Procedures 44 b. When the Configure Cluster window opens, click Import. On the Import window, type the IP address or DNS name of the server from which you want to import the configuration. 5. Add the new server to the cluster. Go to the Cluster Wide Configuration tab. The Address list shows the servers currently in the cluster. Click the Add button to add the new server to this list. You will be asked for the IP address or hostname of the new server.
Chapter 4: Other Procedures 45 8. Check the drive mappings. When you add a server, the operating system may assign drive letters that do not match the assignments you have made for your shared filesystems on the other nodes. There are several ways to correct this situation: • Use the mx fs unassign command to remove the incorrect drive assignments and the mx fs assign command to establish the correct assignments. • Use the HP Management Console to change drive letter assignments.
Chapter 4: Other Procedures 46 3. Select the server in the Address column, and then click Export. The Last Operation Progress column displays status messages as the configuration is exported to the server. 4. Start HP Clustered File System on the server. The server is still selected in the Address column. Click Start Service to start HP Clustered File System. A status message is displayed in the Last Operation Progress column.
Chapter 4: Other Procedures 47 NOTE: This procedure does not require any down time. Repeat this procedure on each server in the cluster. Upgrade One Server and Export This procedure requires that HP Clustered File System be stopped on all servers. Execute the procedure on one server in the cluster. 1. On one server, select Start > Programs > HP Clustered File System > Management Console.
A Configure the Cluster from the Command Line HP Clustered File System provides mx commands that can be used to create the initial cluster configuration. These commands are equivalent to the Configure Cluster graphical user interface described in Chapter 3 and can be used in configuration scripts. We recommend that you review the description of the Configure Cluster window (see section “16. Configure the Cluster” on page 23) to become familiar with the actions performed by the mx commands.
Appendix A: Configure the Cluster from the Command Line 49 The command sequence is: mx --matrix nodeA config license mx --matrix nodeA config secret mx --matrix nodeA config protocol [Multicast|Unicast] mx --matrix nodeA config santype fc mx --matrix nodeA config fcswitch [--community ] ...
Appendix A: Configure the Cluster from the Command Line 50 mx --matrix nodeA config protocol [Multicast|Unicast] mx --matrix nodeA config santype [fc|iscsi] mx --matrix nodeA config fcswitch [--community ] ... (This command is optional for santype fc and not applicable for santype iSCSI.
Appendix A: Configure the Cluster from the Command Line 51 Sample Configuration Script The following example shows how a script can be used to configure the cluster. Although this is a bash script, the same ideas apply to other scripting methods. Note the following in the sample script: • The values for the mx commands are specified in a file named cluster.conf. • The cluster specified by this script uses FibreChannel switch-based fencing.
Appendix A: Configure the Cluster from the Command Line 52 MATRIX="nodeA" # Other Nodes NODES="nodeB nodeC nodeD" # FibreChannel Switch Information SWITCHES="99.10.180.253" # Membership Partitions MP="6-6005-08B3-0090-A860-22BE-8098-CC0A-0041/1 6-6005-08B3-0090A860-22BE-8098-CC0A-0041/2 6-6005-08B3-0090-A860-22BE-8098-CC0A0041/3" # License File LICENSE="permanent.
Appendix A: Configure the Cluster from the Command Line 53 mx config fcswitch [--community ] ... Configuring FibreChannel switches is required for FibreChannel switch-based fencing and optional for web management-based fencing. Specify the hostnames or IP addresses of the switches that are directly connected to the nodes in the cluster, including cascading switches. If you are using an MPIO configuration, be sure to configure all of the switches.
Appendix A: Configure the Cluster from the Command Line 54 mx server start Start HP Clustered File System on the specified node. mx config description The cluster name or description appears on the title bar of the HP Management Console. The name or description can contain up to 80 characters.
Appendix A: Configure the Cluster from the Command Line 55 The other webfencing options are: --vendor The vendor for your remote management controller (dell, hp, ibm, or ipmi). [--bladeslot ] For IBM Blade Center only, the blade slot. --mixedvendor yes|no Whether the vendor and type settings apply to all servers. [--rpassword ] The password for the Remote Management Controller. --ruser The Remote Management Controller user name.
Index A Adding new servers 43 C Cluster SAN configuration 8, 11 Configuration cluster SAN configuration 8, 11 network requirements 7 F Fencing configuration test 39 G Getting help 5 H HP NAS services website 6 storage website 5 technical support 5 I Installation checklist 11 Management Console 40 L License file upgrade 46 M installation 40 Moving servers 45 MPIO DSM setup 16 N Network requirements 7 S Servers adding 43 moving 45 Setting up HP CFS 10 Setup checklist 11 T Technical support, HP 5 Te
