HP StorageWorks Clustered File System 3.
Legal and notice information © Copyright 1999-2005 PolyServe, Inc. Portions © 2005 Hewlett-Packard Development Company, L.P. Neither PolyServe, Inc. nor Hewlett-Packard Company makes any warranty of any kind with regard to this material, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose.
Contents HP Technical Support HP Storage Web Site . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .vi HP NAS Services Web Site . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .vi 1 HP Clustered File System Commands clusterpulse – ClusterPulse daemon . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 destroypsfs – destroy a PSFS filesystem . . . . . . . . . . . . . . . . . . . . . . . . 2 diskupdate – reattempt to access a disk . . . . . . . . . . . . .
Contents iv Setup Option . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Repair Menu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Membership Partition Status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Repair Menu Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . mxmpio – monitor or manage MPIO devices . . . . . . . . . . . . . . . . . . Enable or Disable Failover for a Server . . . .
Contents v sanconfigure – obsolete . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . sandiskinfo – show SAN disk information . . . . . . . . . . . . . . . . . . . . Disk Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Options for Dynamic Volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . . sanlibmig.sh – migrate the SAN identity . . . . . . . . . . . . . . . . . . . . . . sanpulse – SanPulse daemon . . . . . . . . . . . . . . . .
HP Technical Support Telephone numbers for worldwide technical support are listed on the following HP web site: http://www.hp.com/support. From this web site, select the country of origin. For example, the North American technical support number is 800-633-3600. NOTE: For continuous quality improvement, calls may be recorded or monitored.
1 HP Clustered File System Commands HP Clustered File System includes several commands that can be helpful for administrators managing a HP Clustered File System cluster. Other HP Clustered File System commands provide diagnostic information and should be used only under the direction of HP personnel. HP Clustered File System also includes commands that are used internally and should not be run directly.
Chapter 1: HP Clustered File System Commands 2 clusterpulse – ClusterPulse daemon Synopsis /opt/hpcfs/sbin/clusterpulse Description The ClusterPulse daemon monitors the cluster, controls failover of virtual hosts and devices, handles communications with the Management Console, and manages monitors and event notification. This daemon is used internally by HP Clustered File System and should never be run directly.
Chapter 1: HP Clustered File System Commands This daemon is used internally by HP Clustered File System and should never be run directly. dlmdebug – debug DLM problems Synopsis/ /opt/hpcfs/tools/dlmdebug Description This utility should be run only at the request of HP personnel.
Chapter 1: HP Clustered File System Commands 4 get_fenceidentity – get fencing information Synopsis /opt/hpcfs/sbin/get_fenceidentity Description The get_fenceidentity utility retrieves the fence identification information for the system on which it is run. The utility is used internally during HP Clustered File System configuration and should not be run manually.
Chapter 1: HP Clustered File System Commands 5 log_collect – obtain log files Synopsis /opt/hpcfs/tools/log_collect Description This command is used internally by the mxcollect utility and should not be run directly. mkpsfs – create a PSFS filesystem Synopsis /opt/hpcfs/sbin/mkpsfs [-n ] [-l
Chapter 1: HP Clustered File System Commands 6 -n max-nodes The maximum number of nodes that can be in the cluster. -l label The label to be applied to the filesystem. mx – HP Clustered File System command-line interface The mx utility provides a command-line interface for administering a cluster and monitoring its operation. See Chapter 2 for more information about the commands provided with this utility.
Chapter 1: HP Clustered File System Commands 7 mxconfig – configure the cluster Synopsis /opt/hpcfs/bin/mxconfig [--import] [--help] Description The mxconfig utility performs the initial configuration of HP Clustered File System.
Chapter 1: HP Clustered File System Commands 8 mxfence – verify fencing module configuration Synopsis /opt/hpcfs/sbin/mxfence Description The mxfence utility can be used to verify that HP Clustered File System has the information needed to fence a server. This utility is intended for server-based fencing configurations where you must specify the hostname or IP address of the remote controller associated with the server.
Chapter 1: HP Clustered File System Commands For the webmgt fence agent, specify the appropriate fence parameters: -r Set the fencing action to RESET. -s Set the fencing action to SHUTDOWN. -v Specify the vendor for the remote controller -i Specify the IP address of the remote controller. -u Specify the username needed to access the remote controller. -p Specify the password needed to access the remote controller.
Chapter 1: HP Clustered File System Commands 10 Description The mxinit utility is started automatically as a daemon on each server and monitors all HP Clustered File System processes running there. (You can start another instance of mxinit to perform other tasks provided by the utility.) If a HP Clustered File System process dies unexpectedly on a server, mxinit will restart it if possible. However, certain process failures may force a restart of that particular server.
Chapter 1: HP Clustered File System Commands 11 -H, --hard Perform a hard, immediate stop of the HP Clustered File System processes. mxinit first attempts to terminate any applications accessing PSFS filesystems. It then unmounts the filesystems, terminates the HP Clustered File System processes, and unloads HP Clustered File System modules. -L, --load-mod Load all HP Clustered File System modules. -U, --unload-mod Unload all HP Clustered File System modules.
Chapter 1: HP Clustered File System Commands pswebsvr clusterpulse panpulse psd_devfs psfs dlm sanpulse 12 15890 15892 15912 Loaded Loaded 15913 15917 FibreChannel adapter module status: qla2300 - QLogic 2300 FibreChannel Adapter, is Loaded The PID is displayed for running processes; “Stopped” is displayed for processes that are not running. For modules, the status specifies whether the module is loaded.
Chapter 1: HP Clustered File System Commands 13 -e entity The type of message that you are adding. entity can be USER1, USER2, USER3, USER4, USER5, USER6, USER7, or USER8. You will need to determine how you want to use these entities. -l level The severity of the message. level can be ERROR, WARN, INFO, EVENT, FATAL, STATE, TRACE, or DEBUG. -G|L -G specifies that the message to be added is global; -L specifies that it is local. The default is local. log-text The text of the message.
Chapter 1: HP Clustered File System Commands 14 This file specifies the locations of the membership partitions. Each membership partition also has its own MP list. Because the membership partitions control access to the SAN, it is important that all servers in the cluster have the same view of where the partitions are located. The mxmpconf utility can be used to repair any problems if a failure causes servers to have inconsistent views of the membership partitions.
Chapter 1: HP Clustered File System Commands 15 If the status is NOT FOUND or INACCESSIBLE, there may be a problem with the disk or with another SAN component. When the problem is repaired, the status should return to OK. If the status is CORRUPT, you should resilver the partition. This step copies the membership data from a valid membership partition to the corrupted partition. NOTE: The membership partition may have become corrupt because it was used by another application.
Chapter 1: HP Clustered File System Commands 16 Remove Allows you to remove an existing membership partition. This operation removes the membership data and formatting from the partition. It also deletes the partition from the local MP list and from the membership partition lists on the remaining membership partitions. Replace Allows you to remove an existing membership partition and then to select a partition to replace it. (When you have completed your selections, choose “Done”.
Chapter 1: HP Clustered File System Commands 17 Clear the Host Registry This option removes all entries from the server registry. CAUTION: Before clearing the server registry, be sure to reboot or power off any servers that were previously removed from the cluster and no longer had access to the SAN. After the servers have been rebooted, they can safely access the SAN. (If the servers are not rebooted, it is possible for them to corrupt filesystems.
Chapter 1: HP Clustered File System Commands 18 -u Display I/O latencies in microseconds instead of the default milliseconds. This option applies only to the iostat command. The commands are: enable/disable Enable or disable MPIO failover on the specified devices. enableall/disableall Globally enable or disable MPIO failover on this node. timeout value Set the timeout on the specified device. active target Set the active target on the specified device.
Chapter 1: HP Clustered File System Commands 19 You can use the following command to control whether this failover behavior can occur on a particular node. Run the command on the server where you want to change the failover behavior. # mxmpio enableall|disableall HP Clustered File System starts with failover enabled. Enable or Disable Failover for a PSD Device When a failure occurs in the I/O path to a particular PSD device, HP Clustered File System will by default fail over to another I/O path.
Chapter 1: HP Clustered File System Commands 20 scsiN/C A scsi bus ID. N is the scsi host adapter ID (0..) and C is the scsi host channel number (0..) as defined in /proc/scsi/scsi and /proc/scsi/*/[0-9]. If C is omitted, zero is assumed. sdNsP A device node in /dev. The value is converted to a major/minor number identifying the corresponding host adapter.
Chapter 1: HP Clustered File System Commands 21 # /opt/hpcfs/sbin/mxmpio status -l MPIO Failover is globally enabled Failover Timeout Targets psd1 enabled 30000 0. (41:50) scsi2/0/2/19 1. (08:90) scsi1/0/2/19 psd1p1 enabled 10000 0. (41:51) scsi2/0/2/19 1. (08:91) scsi1/0/2/19 psd1p2 enabled 30000 0. (41:52) scsi2/0/2/19 1. (08:92) scsi1/0/2/19 psd2 enabled 30000 0. (41:10) scsi2/0/1/20 1. (08:50) scsi1/0/1/20 psd2p1 enabled 10000 0. (41:11) scsi2/0/1/20 1. (08:51) scsi1/0/1/20 psd2p2 enabled 30000 0.
Chapter 1: HP Clustered File System Commands 22 Show Number of Transient Errors The mpiostat command lists the number of transient errors for each target and shows the number of failovers and fatal errors for each device. Values represent the number of respective events since the device was bound. If devices have not been rebound since boot, then this represents the number of events since boot.
Chapter 1: HP Clustered File System Commands 23 Latencies are in milliseconds. The minimum and maximum latency is reset every interval. The number of I/Os queued is an instantaneous value that is taken at the time of the sample. NOTE: If interval is too long, the average latency computation may be affected by 32-bit computer wrap-around. A total of 71 minutes of I/O may be measured before counter wrap-around. This does not necessarily equate to 71 minutes in realtime.
Chapter 1: HP Clustered File System Commands 24 12... Per-target I/O statistics in tuples, or groups of two numbers. (The number of targets is indicated in field 4.) Each tuple consists of the following fields for each target: • SCSI I/Os queued • Transient failures Note that the “SCSI I/Os queued” numbers are for the underlying disk, not the partition. PSD devices that share the same underlying disk will share the same numbers here. 12+$4*2... I/O statistics in quads, or groups of four numbers.
Chapter 1: HP Clustered File System Commands 25 Some NFS clients will return an error to the client applications if the lock cannot be reclaimed. Other clients (for example, the Linux 2.6 NFS client) will not return any error. If no error is returned by the client, the application may proceed under the false assumption that the lock has been granted. Data corruption may be the result.
Chapter 1: HP Clustered File System Commands To change an existing password, use the following syntax. Users can change their own passwords. If you are root, you can change any user password without specifying the old password. $ mxpasswd mxpasswd> {user} {new_password} {old_password} mxperftool – view performance counters Synopsis /opt/hpcfs/tools/mxperftool Description This command should be run only at the request of HP personnel.
Chapter 1: HP Clustered File System Commands 27 Description The mxsancheck command determines whether a server has SAN access and is ready to mount filesystems. The command is intended to be used in scripts and returns 0 on success and 1 on failure. mxsanconf – configure FC switches Synopsis /opt/hpcfs/sbin/mxsanconf
Chapter 1: HP Clustered File System Commands 28 mxsanlk displays the status of the SANlock stored in each membership partition. It can be used to determine whether any of the membership partitions need to be repaired. Also, if a network partition occurs, mxsanlk can be used to determine which network partition has control of the SAN. Following is some sample output. The command was issued on host 10.10.30.3. The SDMP administrator is the administrator for the cluster to which the host belongs.
Chapter 1: HP Clustered File System Commands 29 unlocked, trying to lock The SANlock does not appear to be held. The host on which mxsanlk was run is trying to acquire the SANlock. unlocked The SANlock does not appear to be held. If a host holds the SANlock, it has not yet committed its hold. initiating sdmp, not yet examined This is a transitional state. It indicates that the sdmp process responsible for the SANlock has been started but has not yet accessed the SANlock.
Chapter 1: HP Clustered File System Commands 30 Checking for SDMP activity, please wait... Still trying... The SDSMP is inactive at this host. The SDMP appears to be inactive at this host. If the SDMP daemon is not responding on the host, wait a few seconds and retry the command. If the command continues to fail, shut down the cluster and then restart it. This step should restart the SDMP daemon. If you continue to have problems, contact HP Technical Support.
Chapter 1: HP Clustered File System Commands 31 mxsetsecret – set the network secret password Synopsis /opt/hpcfs/bin/mxsetsecret -f [--filename] Description This command is typically run by mxconfig and should be run manually only at the request of HP personnel.
Chapter 1: HP Clustered File System Commands 32 For a start operation, mxinit starts the HP Clustered File System processes in the correct order and loads the kernel modules. For a stop operation, it stops the HP Clustered File System processes, unloads the kernel modules, and performs cleanup tasks. The status option displays the same information as the mxinit --status command. You do not need to be user root to run the command.
Chapter 1: HP Clustered File System Commands 33 The options are: -n Print the contents of the Naming Database. -s Wait seconds between probes of the FC switch. -u Wait microseconds between probes of the FC switch. If no options are specified, PSANinfo displays the status of the switch one time only. Following is a sample snapshot: Switch 10.10.11.240 : 1588 Fibre Channel Switch. IP addr 10.10.11.
Chapter 1: HP Clustered File System Commands 34 Description The psfsck utility looks for a PSFS filesystem on a device, replays transactions that are to be replayed, and either checks or repairs the filesystem. device is a psd or psv device and is specified as follows: • For a psd device partition, the device is specified as /dev/psd/psdXXXpYY, where XXX is the drive number and YY is the partition number. For example, /dev/psd/psd6p4 specifies partition 4 on disk psd6.
Chapter 1: HP Clustered File System Commands 35 If --rebuild-tree encounters any files that had been open and unlinked, psfsck will move the files into the lost+found directory. --rebuild-sb Rebuild the superblock. --interactive, -i Stop psfsck after each pass is completed. --quiet, -q Prevent psfsck from reflecting its progress. --logfile filename, -l logfilename Tell psfsck to place information about any corruption it finds into the specified logfile instead of sending it to stderr.
Chapter 1: HP Clustered File System Commands 36 psfsdebug – get PSFS filesystem image Synopsis /opt/hpcfs/tools/psfsdebug -p psfsdebug -P Description When used to obtain a PSFS filesystem image, the psfsdebug command extracts all metadata from the specified filesystem and sends it to stdout. The -p option compresses the data, while the -P option does not.
Chapter 1: HP Clustered File System Commands 37 When you have completed your work with the suspended filesystem, use the psfsresume utility to resume the filesystem. Issue the psfsresume command from the server where you executed psfssuspend. You must be user root. NOTE: If an attempt to mount the copied filesystem fails with an “FSID conflict” error, run the following command as user root.
Chapter 1: HP Clustered File System Commands 38 If the semaphore is already locked by another node in the cluster, the calling process blocks until the semaphore becomes available. An error is returned if does not exist or has not been initialized by psfssema -i, or if does not exist. -r Unlock the PSFS command-line semaphore associated with , which is the name of a semaphore file created by psfssema -i.
Chapter 1: HP Clustered File System Commands 39 psfsunpack – unpack a PSFS filesystem image Synopsis /opt/hpcfs/tools/psfsunpack Description The psfsunpack command unpacks a PSFS filesystem that was packed with the psfsdebug command. It reads the PSFS metadata from stdin and creates a corresponding filesystem on the given device. Following is a typical execution sequence: psfsdebug -p /dev/psd/psd1p2 > psd1p2.pack psfsunpack /dev/sdb1 < psd1p2.
Chapter 1: HP Clustered File System Commands 40 resizepsfs – resize a PSFS filesystem Synopsis /opt/hpcfs/sbin/resizepsfs -s [+|-]size[K|M|G|T] Description The resizepsfs program can be used to increase the size of a PSFS filesystem. resizepsfs can grow a filesystem online if the filesystem is mounted on the server where the utility is invoked. Otherwise, the filesystem must be unmounted on all servers before it is resized. The utility can be used with either psd or psv devices.
Chapter 1: HP Clustered File System Commands 41 • Specify the amount (in kilobytes, megabytes, gigabytes, or terabytes) by which the filesystem should be increased: -s [+|-]size[K|M|G|T] The following example increases the size of the filesystem by 1 GB. resizepsfs -s +1G /dev/psd/psd6p4 sanconfigure – obsolete This command is obsolete and will be removed in a future release.
Chapter 1: HP Clustered File System Commands 42 The -U option displays output in the format used by the Management Console. This option is used internally by HP Clustered File System and does not produce human-readable output. Show Partition Information The -a option also lists the partitions on each disk. When combined with -u, it displays partition information for unimported disks.
Chapter 1: HP Clustered File System Commands 43 Show Available Volumes The -v option lists available volumes on imported disks. These volumes are not currently in use for a PSFS filesystem or a membership partition.
Chapter 1: HP Clustered File System Commands 44 # sandiskinfo --dynvol_properties Dynamic Volume: psv1 Size: 2439M Stripe=Unstriped Subdevice: 20:00:00:04:cf:13:38:18::0/5 Size: 490M psd1p5 Subdevice: 20:00:00:04:cf:13:38:18::0/2 Size: 1950M psd1p2 Dynamic Volume: psv2 Size: 490M Stripe=32K/optimal Subdevice: 20:00:00:04:cf:13:38:18::0/7 Size: 490M psd1p7 Dynamic Volume: psv3 Size: 490M Stripe=8K/optimal Subdevice: 20:00:00:04:cf:13:38:18::0/10 Size: 490M psd1p10 sanlibmig.
Chapter 1: HP Clustered File System Commands 45 snapctl – manage snapshot operations Synopsis /opt/hpcfs/sbin/snapctl Description This command is used internally by HP Clustered File System and should not be run directly. spctl – dump the SanPulse trace buffer Synopsis /opt/hpcfs/tools/spctl -l Description This command should be run only at the request of HP personnel.
2 mx Commands The mx utility provides a command-line interface for administering a cluster and monitoring its operation. Using the mx utility The matrixrc file The mx utility can be used both interactively and in scripts. Because cluster administration requires a password, HP Clustered File System uses an external configuration file named matrixrc to provide authentication. This file is required for mx operation and contains password information.
Chapter 2: mx Commands 47 • The fourth field, default, specifies that this server will be connected to by default if a server name is not specified on the command line. One entry in the file must contain this field. Blank lines and lines beginning with a # character are ignored.
Chapter 2: mx Commands 48 --file Executes the commands from the specified file. If you specify – instead of a file, the commands will be read from standard input. You can also specify --continue to tell mx to continue processing the batch file if an error occurs. --prompt Specifies the prompt string that will be printed when mx is ready for another command. This option is useful when you initiate an interactive session with the option --file -.
Chapter 2: mx Commands Class Cluster Object snapshot Snapshot vhost Virtual host vnfs Virtual NFS Service 49 To specify a command affecting a class, use this syntax: For example, the following command displays the status of servers that are currently up: mx server status --up You can specify --help to see a short command synopsis for each class. mx device – device monitor commands Use the following commands to configure device monitors or to display their status.
Chapter 2: mx Commands 50 [--type CUSTOM|DISK|GATEWAY|SHARED_FILESYSTEM] The type of device monitor. [--probeSeverity nofailover|autorecover|noautorecover] The failover behavior for the monitor. nofailover prevents failover of virtual hosts when the monitored device fails. autorecover fails over the virtual hosts, and when the device is restored, fails the virtual hosts back to the original network interfaces.
Chapter 2: mx Commands 51 [--recoveryTimeout ] The amount of time to wait for the Recovery script to complete. [--startScript
