HP StorageWorks Clustered File System 3.2.
Legal and notice information © Copyright 1999-2006 Polyserve, Inc. Portions © Copyright 2006 Hewlett-Packard Development Company, L.P. Neither PolyServe, Inc. nor Hewlett-Packard Company makes any warranty of any kind with regard to this material, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose.
Contents 1 HP Technical Support HP Storage Web Site . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 HP NAS Services Web Site . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 2 Configuration Information Network Configuration Requirements . . . . . . . . . . . . . . . . . . . . . . . . . 3 Cluster SAN Configuration Guidelines . . . . . . . . . . . . . . . . . . . . . . . .
Contents iv 4 Upgrade HP Clustered File System Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Back Up the Existing Cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Custom Installations of HP Clustered File System . . . . . . . . . . . Upgrade Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Upgrade HP Clustered File System. . . . . . . . . . . . . . . . . . . . . . . . . . .
1 HP Technical Support Telephone numbers for worldwide technical support are listed on the following HP web site: http://www.hp.com/support. From this web site, select the country of origin. For example, the North American technical support number is 800-633-3600. NOTE: For continuous quality improvement, calls may be recorded or monitored.
Chapter 1: HP Technical Support 2 HP NAS Services Web Site The HP NAS Services site allows you to choose from convenient HP Care Pack Services packages or implement a custom support solution delivered by HP ProLiant Storage Server specialists and/or our certified service partners. For more information see us at http://www.hp.com/hps/storage/ns_nas.html.
2 Configuration Information Network Configuration Requirements Configure networks used with HP Clustered File System as follows: • Each network interface card (NIC) must be on a separate physical network. For example, you could use either a separate Ethernet switch for each network or a managed switch that allows network traffic to be isolated. • Each NIC must be on a separate logical IP network. • Network interfaces should be multicast-capable.
Chapter 2: Configuration Information 4 Cluster SAN Configuration Guidelines Following are guidelines for configuring the cluster SAN to be used with HP Clustered File System: • When the cluster is configured for fabric fencing, arrays must operate in fabric or switch-attached mode (not arbitrated-loop-only devices). This requirement does not apply for non-fabric fencing configurations. HP recommends using iLO based fencing with Clustered Gateway.
3 Setting Up HP StorageWorks Clustered File System This chapter describes how to perform a new installation of HP StorageWorks Clustered File System on servers running Microsoft Windows. HP Clustered File System Distribution The HP Clustered File System is pre-installed on an HP ProLiant Storage Server running the Windows Storage Server operating system. The following files are included in the \Program Files\Hewlett-Packard\HP Clustered File System folder: • mxcheck.
Chapter 3: Setting Up HP StorageWorks Clustered File System 6 Setup Procedure Before starting the installation, be sure to review the configuration and hardware requirements specified in Chapter 1. Setup Checklist The setup procedure consists of the following steps, which are described in detail following this checklist. Action Description Set up iLO. When booting, press F8 to enter the iLO configuration mode. Set the network information (IP address) and user/password. Set up the DNS hostname.
Chapter 3: Setting Up HP StorageWorks Clustered File System Action Description Install MPIO If you have multiple paths to LUNs in your software (optional). storage fabric, you will need MPIO software. The MPIO DSM software is included with the product. Information about installing and configuring this software is in the “SAN Connection Guide” document on the desktop. Locate the installable MPIO software in: C:\hpnas\Components\SANConnect\MPIO.
Chapter 3: Setting Up HP StorageWorks Clustered File System Action Description Configure the cluster. Create an initial cluster configuration on one server, export that configuration to the other servers, and then start the HP Clustered File System service. Connect to the cluster. The cluster now includes all of the servers. 8 If you plan to use a client PC outside the cluster to administer your cluster, install the stand-alone Management Console package on that PC. 1.
Chapter 3: Setting Up HP StorageWorks Clustered File System 9 If you are not using dynamic DNS or DHCP, you can use static entries to set up DNS. Use one of the following methods to set up the hostname on each server: • Set up a DNS suffix. Select My Computer > Properties > Network Identification > Properties. On the Identification Changes window, select More. Then, on the DNS Suffix and NetBIOS Computer Name window, type the fully qualified domain name as the “Primary DNS suffix of this computer.
Chapter 3: Setting Up HP StorageWorks Clustered File System 10 4. Install a Firewall (Optional) If you will be installing a firewall, ensure that the service ports required by HP Clustered File System are open. Contact HP Technical Support for more information about the service ports used by HP Clustered File System. Repeat steps 1–4 on each server that will be in the cluster. 5. Configure the Storage Array Perform the initial configuration of the storage array as described in the product documentation.
Chapter 3: Setting Up HP StorageWorks Clustered File System 11 • FibreChannel Switch-based fencing (also called “fabric fencing”). When a server needs to be fenced, HP Clustered File System disables the server’s access in the FibreChannel fabric. • Web Management-Based Fencing via Server Reset/Shutdown (also called “flexible fencing” or “iLO fencing”). HP Clustered File System uses remote management hardware on the server to remove its access to PSFS filesystems.
Chapter 3: Setting Up HP StorageWorks Clustered File System 12 – On Brocade switches only, run the snmpMibCapSet command on the switch. Change the famib setting to yes and accept the default values for the other settings. • For McDATA switches, place each server in a separate zone with its storage. Disable domain-wide RSCNs. • For Cisco switches, place each server in a separate zone with its storage. You typically perform these tasks from the FC switch or from third-party applications.
Chapter 3: Setting Up HP StorageWorks Clustered File System 13 For Windows Storage Server 2003 SP1, HP Clustered File System supports only MBR basic disks; GPT basic disks are not supported. For MBR basic disks, you can use either primary partitions or extended partitions with logical drives. When you configure the cluster in step 11, you can create HP Clustered File System membership partitions on the partitions that you just created.
Chapter 3: Setting Up HP StorageWorks Clustered File System 14 If you should later need to repartition a disk containing a membership partition, you will need to stop HP Clustered File System before you change the layout. While the cluster is stopped, you will not be able to access other disks in the cluster. You will also need to take one of the above steps to force the servers in the cluster to recognize the changes.
Chapter 3: Setting Up HP StorageWorks Clustered File System 15 10. Set Parameters for MPIO Software Different MPIO software solutions may require specific configuration steps. This section documents known setup for HP’s MPIO software in order for it to work with HP Clustered Gateway. HP MPIO DSM No additional setup is required after this software has been installed. Note that there are different MPIO DSM packages for different HP arrays.
Chapter 3: Setting Up HP StorageWorks Clustered File System allow_any_disk 16 1 To set no_permanent_mountpoints, locate these lines in the scl.conf file: # no_permanent_mountpoints #(This parameter is only for Windows; it has no affect on Linux) #Indicates whether scl utilities will create 'permanent' mountpoints #for all imported device partitions. (They are permanent in that #they will persist until the disk is deported).
Chapter 3: Setting Up HP StorageWorks Clustered File System 17 • The IP address or hostname of each FibreChannel switch that is included in the SAN. (This step is required for FibreChannel switch-based fencing and optional for Web Management-based fencing via server reset/shutdown.) • The partitions or LUNs that you want to use for membership partitions. Connect to the Management Console On one server, select Start > Programs > HP Clustered Gateway > HP CFS Management Console.
Chapter 3: Setting Up HP StorageWorks Clustered File System 18 1. License. HP Clustered File System is shipped with a permanent license. No action is required to install an additional license. If a new license is provided by HP in the future, use the following procedure to install the new license. (This file must be present on the server that you are using to connect to the Management Console.) To install the license, click the Change License File button.
Chapter 3: Setting Up HP StorageWorks Clustered File System 19 2. Secret Network Key. This password is required. It provides additional security for network communications among the cluster servers. To set this key, click the Set Secret Network Key button. You can enter anything you want for this password. 3. Administrator Password. You will need to be an HP Clustered File System user admin to configure the cluster. By default, the password for this user is set to hpinvent.
Chapter 3: Setting Up HP StorageWorks Clustered File System 20 When you have completed the fields on the General Settings tab, go to the Fencing tab. Fencing Tab When certain problems occur on a server (for example, hardware problems or the loss of cluster network communications), and the server ceases to effectively coordinate and communicate with other servers in the cluster, HP Clustered File System must remove the server’s access to filesystems to preserve data integrity. This step is called “fencing.
Chapter 3: Setting Up HP StorageWorks Clustered File System 21 There are two fencing methods (HP recommends iLO based fencing): • FibreChannel Switch-based fencing. When a server needs to be fenced, HP Clustered File System will disable the server’s access in the FibreChannel fabric. The server must be rebooted to regain access to the SAN. If you select this method, next go to the Storage Configuration tab and configure the FC switches. (See “Storage Configuration Tab” on page 25.
Chapter 3: Setting Up HP StorageWorks Clustered File System 22 • Web Management-Based Fencing via Server Reset/Shutdown. HP Clustered File System uses remote management hardware on the server to remove its access to PSFS filesystems. When you select Web Management Based Fencing via Server Reset/Shutdown, the Fencing tab will refresh and ask you for configuration information.
Chapter 3: Setting Up HP StorageWorks Clustered File System 23 1. Remote Management Controller Vendor. Select the Hewlett Packard option. 2. Remote Management Controller ID. Specify how HP Clustered File System should identify the Remote Management Controller associated with each server. Use one of the following methods. – Select “Cluster-wide Pattern” and then specify the common naming scheme that you are using for the Remote Management Controllers (either a hostname suffix or an IP address delta).
Chapter 3: Setting Up HP StorageWorks Clustered File System 24 – Enter the hostname or IP address for the Remote Management Controller associated with this cluster server. (If you removed the checkmark from “Vendor and type selection apply to all controllers for the cluster,” you will need to use this method.) – For IBM BladeCenter servers, specify the Hostname/IP Address and the Blade slot. Hostname Suffix.
Chapter 3: Setting Up HP StorageWorks Clustered File System Storage Configuration Tab The Storage Configuration tab allows you to identify the FibreChannel switches included in the cluster and to select membership partitions, which HP Clustered File System uses to control access to the SAN.
Chapter 3: Setting Up HP StorageWorks Clustered File System 26 1. SAN Switches. If you are using FibreChannel switch-based fencing, you will need to configure FC switches. If you are using Web Management-based (iLO) fencing via server reset/shutdown, this step is optional; however, if the switches are configured the HP Clustered File System Management Console can display the switch ports used by the SAN. (The preceding window shows the text that is displayed for FibreChannel switch-based fencing.
Chapter 3: Setting Up HP StorageWorks Clustered File System 27 To create a membership partition, click Add. The Add Membership Partition window then lists all of the disks or LUNs that it can access. Select the disk or LUN where you want to place the first membership partition. All of the available partitions on that disk or LUN are displayed in the bottom of the window. Select one of these partitions and click Add. (8 MB is adequate for a membership partition.
Chapter 3: Setting Up HP StorageWorks Clustered File System 28 The following message is displayed. Click Yes to continue. The configuration is then installed on the server that you are using to connect to the Management Console. You will be asked whether you want to start the cluster on that server. Click Yes. The server is now configured and is running HP Clustered File System. Go to the Cluster Wide Configuration tab.
Chapter 3: Setting Up HP StorageWorks Clustered File System 29 1. Select the servers to be configured. To specify the first server, click Add Server and type the hostname or IP address of the server on the Input form. Click OK to add the server to the Address column.
Chapter 3: Setting Up HP StorageWorks Clustered File System 30 Repeat this procedure to add the remaining servers to the Address column. 2. Export the configuration. Click Select All to select all of the servers in the Address column, and then click Export. The Last Operation Progress column displays status messages as the configuration is exported to each server. If you are using Web Management-based (iLO) fencing, you may be asked for additional information about each server.
Chapter 3: Setting Up HP StorageWorks Clustered File System 31 HP Clustered File System then fences the servers in accordance with the method you specified on the Fencing tab. If the correct server is not fenced, you will need to check the configuration. For example, if you specified a pattern for the Remote Management Controller, the server may not be configured to use that pattern.
Chapter 3: Setting Up HP StorageWorks Clustered File System 32
4 Upgrade HP Clustered File System Overview This chapter describes how to upgrade to HP Clustered File System 3.2.1. Upgrades are supported from HP Clustered File System 2.7.2. It is not necessary to upgrade the stand-alone Management Console, which is used to connect to the cluster from hosts not running the cluster software. When you use the stand-alone Management Console to connect to a cluster running version 3.2.1, the latest version of the Management Console will be downloaded to the host.
Chapter 4: Upgrade HP Clustered File System 34 • It is important to preserve the original cluster configuration in case you need to back out of the upgrade. • Back up all PSFS filesystems for disaster recovery purposes. Custom Installations of HP Clustered File System When you upgrade HP Clustered File System, the Installer looks for the cluster configuration files in the location where HP Clustered File System is currently installed, and then applies the configuration files to the new installation.
Chapter 4: Upgrade HP Clustered File System 35 Upgrade HP Clustered File System There are three ways to perform the upgrade to HP Clustered File System 3.2.1: • Perform a rolling upgrade. In this procedure, servers are removed from the cluster, upgraded, and returned to the cluster one-at-a-time. No downtime is required. • Upgrade all servers at once. This procedure requires that the cluster be completely shut down during the upgrade. • Upgrade the servers in two groups.
Chapter 4: Upgrade HP Clustered File System 36 • If you are upgrading from 2.7.2, the HP Clustered File System upgrade package will include a new license file. You will need to install this file during the upgrade. If the new file is not in place when you start HP Clustered File System, license violations will be reported on the Management Console and in the cluster log, and the product will shut down after one hour and 45 minutes.
Chapter 4: Upgrade HP Clustered File System 37 8. If you upgraded the operating system, run the mxcheck utility provided with HP Clustered File System 3.2.1. This utility verifies that the server’s configuration meets the requirements for running HP Clustered File System. To run mxcheck, insert the HP Clustered File System CD into the CD drive or go to the directory where you downloaded the product, and then double-click the file mxcheck.exe.
Chapter 4: Upgrade HP Clustered File System 38 NOTE: If the Apply fails, verify that the FC switch ports are enabled for all of the servers. If the switch ports are enabled, check the Windows Disk Management MMC snap-in to determine whether the node can see the disks on the SAN. Also check the HBA driver. 14. When asked if you want to start the HP Clustered File System service, answer yes.
Chapter 4: Upgrade HP Clustered File System 39 3. Uninstall the previous version of HP Clustered File System from each server in group A. Use Start > Programs > HP Clustered Gateway > Uninstall HP CFS. Select the checkbox to “Keep the existing MatrixServer configuration.” Reboot the server when the “reboot” popup message is displayed. NOTE: Do not use the Add/Remove Programs option on the Control Panel to remove HP Clustered File System. This method will remove your cluster configuration. 4.
Chapter 4: Upgrade HP Clustered File System 40 NOTE: You will see a security warning stating that the publisher could not be verified. You can ignore this warning; software from HP, Inc. is safe to install. 10. On each server in group A, install any HP Solution Packs. – For HP Clustered File System for CIFS, insert the Solution Pack CD into the CD drive or go to the location where you have downloaded the software. Then double-click the file MxFS_3.2.1.0138.msi and run the Installation Wizard. 11.
Chapter 4: Upgrade HP Clustered File System 41 NOTE: If the export fails, verify that the FC switch ports are enabled for all of the servers. If the switch ports are enabled, check the Windows Disk Management MMC snap-in to determine whether the node can see the disks on the SAN. Also check the HBA driver. 15.
Chapter 4: Upgrade HP Clustered File System 42 19. On each server in group B, uninstall the HP Clustered File System for CIFS Solution Pack, if it is installed on the server. Use the Control Panel Add/Remove Programs interface to do this. 20. On each server in group B, upgrade the operating system and/or service pack if necessary. 21. If you will be adding third-party MPIO software to the cluster, install it on each server in group B according to the product documentation. 22.
Chapter 4: Upgrade HP Clustered File System 43 27. Start the HP CFS Management Console (if you are not already connected) and connect to one of the servers in group A (a server that has already been upgraded). Verify that all of the servers in group B have rebooted, and then export the configuration from the group A server to the servers in group B. NOTE: If an export fails, verify that the FC switch ports are enabled for all of the servers. 28.
Chapter 4: Upgrade HP Clustered File System 44 Change the Fencing Method If you are upgrading to HP Clustered File System 3.2.1 and also want to change the fencing method, complete these steps: 1. Use the procedure described earlier to upgrade to the 3.2.1 release. 2. Stop HP Clustered File System on all servers in the cluster. 3. Connect to one server in the cluster via the HP CFS Management Console.
5 Other Procedures This chapter describes how to perform the following procedures: • Configure the XIOtech MAGNITUDE Storage Array • Add a new server to a cluster. • Move a server from one cluster to another. • Upgrade the HP Clustered File System license file. • Uninstall HP Clustered File System and the stand-alone Management Console.
Chapter 5: Other Procedures 46 “No Mapping/Masking” Mode All servers that can target the MAGNITUDE device can also see all of the LUNs on the device. HP Clustered File System can be installed normally with this configuration. However, you will need to set up the LUNs that will be used with HP Clustered File System before you begin the HP Clustered File System installation. See section “9.
Chapter 5: Other Procedures 47 Set the Array to Fabric Mode HP Clustered File System requires that storage arrays be configured in fabric mode. You can check the mode setting on the Easy Storage Setup window. For each HAB used for the cluster, the Loop ID must be set to FPort. If you need to change the mode, click the HAB, select the FPort setting, and press Enter. Add a New Server to a Cluster Use the following procedure to add a new server to an existing cluster.
Chapter 5: Other Procedures 48 b. When the Configure Cluster window opens, click Import. On the Import window, type the IP address or DNS name of the server from which you want to import the configuration. 5. Add the new server to the cluster. Go to the Cluster Wide Configuration tab. The Address list shows the servers currently in the cluster. Click the Add button to add the new server to this list. You will be asked for the IP address or hostname of the new server.
Chapter 5: Other Procedures 49 8. Check the drive mappings. When you add a server, the operating system may assign drive letters that do not match the assignments you have made for your shared filesystems on the other nodes. There are several ways to correct this situation: • Use the mx fs unassign command to remove the incorrect drive assignments and the mx fs assign command to establish the correct assignments. • Use the HP Management Console to change drive letter assignments.
Chapter 5: Other Procedures 50 3. Select the server in the Address column, and then click Export. The Last Operation Progress column displays status messages as the configuration is exported to the server. 4. Start HP Clustered File System on the server. The server is still selected in the Address column. Click Start Service to start HP Clustered File System. A status message is displayed in the Last Operation Progress column.
Chapter 5: Other Procedures 51 Upgrade One Server and Export This procedure requires that HP Clustered File System be stopped on all servers. Execute the procedure on one server in the cluster. 1. On one server, select Start > Programs > HP Clustered File System > Management Console. On the Connection Parameters window that opens next, enter the IP address of the server, type the user and password, and then click the Configure button. NOTE: If there is a .
Chapter 5: Other Procedures 52
Index A L Adding new servers 47 License file upgrade 50 LUN creation 12 C Cluster configuration 16 Cluster SAN configuration guidelines 4 Configuration information 3 network requirements 3 Configure server for WINS clients 9 Considerations for upgrading 34 M D N Disk partition table changes 13 Network configuration requirements 3 F P FC switch configuration 10 Firewall installation 10 Partition sizing 14 Partitions containing Windows filesystems 13 G Moving servers 49 MPIO DSM setup 15 MPIO i
Index procedure 6 Storage array configuration 10 T Technical support, HP 1 U Upgrade license file 50 54 one server and export 51 one server at a time 50 Upgrade servers groups or at once 38 Upgrades caveats for Windows 2003 43 change fencing method 44 considerations 34
