HP Smart Array 6400 Series Controller Support Guide HP-UX 11i v1, 11i v2, 11i v3 HP Part Number: J6369-90051 Published: September 2007 Edition: 7
© Copyright 2007 Hewlett-Packard Development Company L.P Legal Notices © Copyright 2007 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Table of Contents About This Document .....................................................................................................11 Intended Audience................................................................................................................................11 New and Changed Documentation in This Edition.............................................................................11 Publishing History...............................................................................
Configuring for HP-UX 11i v1 Using Ignite-UX Offline.................................................................43 3 Configuring Smart Array 6400 Series Controllers...................................................45 Planning the RAID Configuration........................................................................................................45 The saconfig Configuration CLI...........................................................................................................
D Electrostatic Discharge................................................................................................75 Handling Parts......................................................................................................................................75 Grounding.............................................................................................................................................75 E Frequently Asked Questions.......................................................
List of Figures 1-1 1-2 1-3 1-4 2-1 2-2 2-3 B-1 C-1 HP A9890A Smart Array 6402 Series Controller...........................................................................16 Smart Array 6402 Controller Board Runtime LEDs......................................................................17 Smart Array 6402 Controller Cache Module LEDs.......................................................................18 Smart Array 6404 Controller Expansion Module Components............................................
List of Tables 1 2 1-1 1-2 1-3 1-4 1-5 1-6 2-1 2-2 2-3 A-1 A-2 B-1 Publishing History Details............................................................................................................11 HP-UX 11i Releases.......................................................................................................................13 Smart Array Controller Comparisons...........................................................................................
About This Document This document describes how to install, configure, and troubleshoot the HP Smart Array 6400 Series Controllers (A9890A Smart Array 6402 Controller and A9891A Smart Array 6404 Controller) on HP-UX 11i v1 and HP-UX 11i v2. The latest version of this document can be found online at: http://docs.hp.com/en/netcom.
Document Organization The HP Smart Array 6400 Series Controller Support Guide is divided into several chapters containing information about RAID in general, the RAID levels supported by each Smart Array Controller specifically, and installation, configuration, and troubleshooting details for the Smart Array Controllers. There are also several appendixes containing supplemental information.
Table 2 HP-UX 11i Releases Release Identifier Release Name Supported Processor Architecture HP-UX 11i v3 (September 2007) B.11.31 HP-UX 11i v3 (February 2007) HP-UX 11i v2 (June 2007) HP-UX 11i v2 (December 2006) B.11.23 Intel® Itanium®, PA-RISC HP-UX 11i v2 (December 2005) HP-UX 11i v2 (September 2004) HP-UX 11i v2 (March 2004) Intel® Itanium® HP-UX 11i v1 (December 2006) B.11.
1 Smart Array 6400 Series Controller Overview This chapter provides an overview of RAID technology and descriptions of the different RAID levels that are supported by the HP Smart Array 6400 Series Controllers.
Board Components and Features The Smart Array 6402 Series Controller has two Ultra320 SCSI channels and 192 MB of cache, 128 MB in the cache module and 64 MB on the board. The Smart Array 6404 Series Controller has two controllers. Each controller has two Ultra320 SCSI channels and 256MB of cache, 128MB in the cache module and 64MB on each controller. CAUTION: The Smart Array Controllers have two (6402) or four (6404) channels.
Table 1-2 HP A9890A Smart Array 6402 Series Controller Components (continued) Item ID Description 6 Battery-backed cache module 7 Connector for expansion board Controller Board Runtime LEDs The Smart Array 6402 Controller board has nine runtime LEDs that indicate various activities and error conditions. Figure 1-2 illustrates their location, and Table 1-3 describes how to interpret them.
Cache Module LEDs The cache module has two runtime LEDs that indicate various activities and error conditions. Figure 1-3 illustrates their location, and Table 1-4 describes how to interpret them. Figure 1-3 Smart Array 6402 Controller Cache Module LEDs Table 1-4 Interpretation of Cache Module LEDs LED Color State Interpretation 1 Green Steady The cache batteries are charging. Fast Blink The cache micro controller is waiting for the host controller to communicate.
Expansion Module Components This section describes the components of the Expansion Module. Figure 1-4 illustrates their location, and Table 1-5 provides additional information. Figure 1-4 Smart Array 6404 Controller Expansion Module Components Table 1-5 6404 Expansion Module Components Item ID Description 0-7 Runtime LEDs (CR10-CR17). Identical to the controller board runtime LEDs.
and Ultra2 drives are installed on the same bus with the Smart Array Controllers, individual drives operate at their respective supported speeds (Ultra320, Ultra160 and Ultra2). Fault Management Features The Smart Array Controllers and the HP-UX operating system support several fault management and data reliability features that minimize the impact of disk drive defects on your systems.
Fault Management in Supported RAID Configurations If a physical disk fails in RAID 1, RAID 1+0, RAID 5, or ADG, the system will still process I/O requests, but at a reduced performance level. Replace the failed physical disk as soon as possible to restore performance and full fault tolerance for the logical drive it belongs to.
2 Installing Smart Array 6400 Series Controllers This chapter provides information to help you plan the installation and configuration of each Smart Array Controller.
1. 2. 3. 4. Read the latest RAID–01 (ciss) Release Notes for your HP-UX version to check for any known problems, required patches, or other information you need for installation. Plan your disk configurations. Make sure you have superuser (root) privileges. Confirm that your HP-UX operating system version is supported by the Smart Array Controllers.
Downloading Software for the Smart Array 6400 Series Controllers The drivers, utilities and manpages for the Smart Array 6400 series controllers are located at the HP Software Depot. • • • • • • Go to http://www.software.hp.com Search for “Smart Array 6402” or “Smart Array 6404”. Click Receive for Free. Select the HP-UX version that your system runs, then complete the required registration information and click Next.
1. 2. 3. 4. Close all applications. Power off the server. Power off any peripheral devices that are attached to the server. Unplug the AC power cord from the outlet, and then from the server. WARNING! To reduce the risk of personal injury or damage to the equipment, consult the safety information and user documentation provided with your server before attempting installation. Many computers are capable of producing energy levels that are considered hazardous.
Figure 2-1 Installing A Smart Array 6400 Series Controller NOTE: 6. 7. 8. Your server may look slightly different from that in Figure 2-1. Press the controller board firmly into the slot so the contacts on the board edge are properly seated in the system board connector. Secure the board in place with the hot-plug latch or retaining screw. Go on to the procedure in “Connecting the Cables and the StorageWorks or MSA 30 Disk Enclosures” (page 29).
To determine whether your server supports OL* or OLAR, see the HP Smart Array Controller Support Matrix. For detailed instructions and information on using the OLAR feature, Chapter 2, “Managing PCI Cards with OLAR” in the latest edition of the Configuring HP-UX for Peripherals. For detailed information about using SAM, see Using System Administration Manager (SAM). These documents can be viewed or downloaded at: http://docs.hp.com/en/netcom.html Alternately, you can order a hard copy from HP.
Connecting the Cables and the StorageWorks or MSA 30 Disk Enclosures The following rules govern how you can connect drives to a Smart Array 6400 Series controller: • • • Each channel on the Smart Array Controller supports up to 14 drives. Port A1 (Channel 1) and Port A2 (Channel 2) each have two SCSI connectors, one for external storage units and one for internal hard drives in the server. You cannot use the internal and external connectors on a channel at the same time.
External Cabling for HP Servers All HP storage enclosure models include external SCSI cables. Check the connector type on your storage device to identify the cable type needed. See Figure 3-2 and Table 3-1 for details.
NOTE: There may be system-specific cables required for connections to internal disks on servers that support SmartArray with internal disks. Review the System Configuration Guides for your system for more information. Connecting External Storage NOTE: Offset VHDCI cables must be used with the Smart Array Controller. Early versions of the VHDCI cables do not accommodate side-by-side connection to the Smart Array Controller.
3. Install drives in the removable media bays on the server. CAUTION: drives. Do not use hot-pluggable drives on the same SCSI bus as non-hot-pluggable TIP: Drives that are to be grouped in the same array should all have comparable capacity for efficient use of total storage capacity. For additional information about drive installation, see Appendix B (page 67). Also consult the drive documentation. When you have finished installing drives, go to the next step.
1. Enter the swlist command: # swlist If the Smart Array Controller is installed correctly, the generated output will look similar to the following examples: For HP-UX 11i v3: RAID-01 B.11.31.0709.01 RAID SA; Supptd HW=A7143A/A9890A/A9891A For HP-UX 11i v2: RAID-01 B.11.23.0706 RAID SA; Supptd HW=A7143A/A9890A/A9891A For HP-UX 11i v1: RAID-01 B.11.11.
======================================================================== ext_bus 4 0/3/1/0/4/0 ciss CLAIMED INTERFACE PCI-X SmartArray 6404 RAID Controller /dev/ciss4 ext_bus 7 0/3/1/0/5/0 ciss CLAIMED INTERFACE PCI-X SmartArray 6404 RAID Controller /dev/ciss7 ext_bus 6 0/5/1/0/4/0 ciss CLAIMED INTERFACE PCI-X SmartArray 6402 RAID Controller /dev/ciss6 In the example, /dev/ciss4 and /dev/ciss7 are the device files for the Smart Array 6404 Controller.
# sautil /dev/ciss4 -s ****************************************************************************** **** **** **** S A U T I L S u p p o r t U t i l i t y **** **** **** **** for the HP SmartArray RAID Controller Family **** **** **** **** version A.02.09 **** **** **** (C) Copyright 2003-2005 Hewlett-Packard Development Company, L.P.
****************************************************************************** ---- DRIVER INFORMATION -----------------------------------------------------Driver State........................ READY ---- CONTROLLER INFORMATION -------------------------------------------------Controller Product Number........... Controller Product Name............. Hardware Path....................... Device File.........................
Before running the sautil command to confirm or update physical disk firmware, you must know the device file name for the Smart Array Controller and the SCSI channel and SCSI ID for each of the physical disks attached to the Smart Array Controller. Determining the Smart Array 6400 Series Controller Device File Determine the device file name for the Smart Array Controller from the output of the ioscan -kfnd ciss command.
# of Logical Drives................. 1 # of Physical Disks Configured...... 2 # of Physical Disks Detected........ 2 ---- ARRAY ACCELERATOR (CACHE) INFORMATION ----------------------------------Array Accelerator Board Present?.... Cache Configuration Status.......... Cache Ratio......................... Total Cache Size (MB)............... Battery Pack Count.................. Battery Status (pack #1)............ Battery Status (pack #2)............
Connector Location............................... Channel Number................................... SCSI ID.......................................... Device Type...................................... Device Vendor ID................................. Device Product ID................................ SCSI Transfer Rate...............................
When you enter the sautil download_dev_fw : command, the currently installed physical disk firmware version is listed along with the firmware version you selected to replace it with.
Setting up a Smart Array 6400 Series Controller as a Boot Device This section describes the additional steps that you will need to follow to enable your system to boot from a Smart Array 6400 Series Controller. NOTE: On HP Integrity systems, use the Option ROM Configuration for Arrays (ORCA) to create the logical drives. On HP/9000 systems, use Ignite/UX-saconfig to create the logical drives.
NOTE: Pressing the F8 key at the ORCA prompt may not start ORCA on all terminals. If ORCA does not start when you press the F8 key, reboot the system and use ESC 8 at the ORCA prompt to start ORCA. Figure 2-3 ORCA Main Menu Screen To create a logical drive using ORCA, follow these steps: 1. 2. Select Create Logical Drive. The screen displays a list of all available (unconfigured) physical drives and the valid RAID options for the system.
Configuring for HP-UX 11i v1 Using Ignite-UX Offline To set up a Smart Array Controller as a boot device, you must install HP-UX 11i v1 on one of the controller’s logical drives. Follow these steps: 1. Start Ignite-UX from the HP-UX 11i v1 Core OS Install and Recovery Media. The Ignite-UX Welcome screen displays: Welcome to Ignite-UX! Use the key to navigate between fields, and the arrow keys within fields. Use the key to select an item.
7. Once the logical drives and arrays have been configured, exit the recovery shell by entering reboot at the prompt. The system reboots and you return to the Boot Console Handler (BCH) prompt. 8. At the BCH prompt, start Ignite-UX from the HP-UX 11i v1 Core OS Install and Recovery Media. The Ignite-UX Welcome screen displays (see Step 1). 9. Select Install HP-UX. 10. Select the kind of installation (Guided or Advanced) you want to do. The installation starts, and the Ignite-UX GUI appears. 11.
3 Configuring Smart Array 6400 Series Controllers This chapter details the use of the saconfig command to configure Smart Array 6400 Series Controllers. This chapter addresses the following topics: “Planning the RAID Configuration” (page 45) “The saconfig Configuration CLI” (page 45) NOTE: Some of the commands and outputs in this chapter differ between HP-UX 11i v3 and previous versions. In those cases, examples from each HP-UX version are provided, and are clearly identified.
• • • • • • Create multiple logical drives in an array Perform RAID level migration Perform stripe size migration Extend the capacity of a logical drive Expand the capacity of an array Change the expand priority You must log in as a superuser to run the saconfig command. Enter saconfig without any options to display the help screen with command options and syntax.
saconfig /dev/cissX -D -s To delete all spare drives of a logical drive saconfig /dev/cissX -D -s all To change the rebuild priority for the logical drives saconfig /dev/cissX -r To specify the percentage of total cache size to be used for read caching saconfig /dev/cissX -C Read caching percentage can be 0, 25, 50, 75, or 100.
saconfig /dev/cissX -D To clear configuration saconfig /dev/cissX -D all To add spare drive to existing logical drive saconfig /dev/cissX -A -s To delete a spare drive of a logical drive saconfig /dev/cissX -D -s To delete all spare drives of a logical drive saconfig /dev/cissX -D -s all To change the rebuild priority for the logical drives saconfig /dev/cissX -r To specify the
Displaying the Smart Array 6400 Series Controller Configuration To display the physical disks connected to a Smart Array Controller and any configured logical drives and spare drives, use the saconfig /dev/cissX command, where X represents the device file number for the Smart Array Controller. The channel, SCSI ID, size, and status of each physical disk attached to the Smart Array Controller is included in the saconfig /dev/cissX output.
The physical disks included in the logical drive. Each physical disk is identified by the channel it is connected to and the SCSI ID it is assigned. Obtain this information from the output of the saconfig command, as described in “Displaying the Smart Array 6400 Series Controller Configuration” (page 49). Configures a physical disk as a spare. The physical disk is identified by the channel it is connected to and the SCSI ID it is assigned.
NOTE: When RAID 1 is configured on two physical disks, the saconfig /dev/cissX command output displays the RAID level as 1+0.
The following example deletes all the spare drives of logical drive 0 at once: # saconfig /dev/ciss7 -D 0 -s all All spare drives are deleted from logical drive 0 Changing the Rebuild Priority of a Logical Drive Use the saconfig /dev/cissX -r command to set the rebuild priority of logical drives. For example: # saconfig /dev/ciss7 -r high In this example, the rebuild priority is set to high for the logical drives under controller ciss7.
NOTE: If you do not specify a stripe size using -S , the default stripe size will be used.
The expand priority setting applies to both “Extending the Capacity of a Logical Drive” (page 53) and ““Expanding the Capacity of an Array” (page 53).
4 Troubleshooting This chapter describes diagnostic and troubleshooting tools for Smart Array 6400 Series Controllers. This chapter addresses the following topics: “HP Support Tools Manager” (page 55) “Event Monitoring Service” (page 55) “ODE” (page 55) “The sautil Command” (page 56) HP Support Tools Manager HP Support Tools Manager (STM) is a software application that you can run from the console to obtain status and descriptive information about HP Smart Array Controllers.
System Library (SysLib) A set of common routines for use by both the Test Controller and the Test Modules. These routines perform I/O, string parsing, and system control. For detailed information about ODE, go to: http://docs.hp.com/en/diag.html#Offline%20Diagnostics The sautil Command This section focuses on sautil command options that are used for online troubleshooting of the HP Smart Array Controller. Before troubleshooting with the sautil command, run STM.
for more information on privileged users. - See sautil(1M) for tool details. NOTE: In HP-UX 11i v3, the -N option causes sautil to display persistent device file information. If the -N option is not specified, sautil will display legacy device file information. This provides backward compatibility with previous versions of HP-UX. For more information on persistent device files in HP-UX 11i v3, see the intro(7) manpage.
# sautil download_dev_fw : This command option is described in “Physical Disk Firmware” (page 36). The sautil reset_ctlr command resets the Smart Array Controller. An example of a situation that might require a controller reset is when you perform an online replacement of the Smart Array Controller, but the logical drives on the enclosure are not detected.
**** (C) Copyright 2003, 2004 Hewlett-Packard Development Company, L.P. **** ****************************************************************************** ---- DRIVER INFORMATION -----------------------------------------------------Driver State........................ READY ---- CONTROLLER INFORMATION -------------------------------------------------Controller Product Number........... Controller Product Name............. Hardware Path....................... Serial Number.......................
Logical Drive Status................ OK # of Participating Physical Disks... 2 Participating Physical Disk(s)...... Ch:ID 2: 5 2: 8 Participating Spare Disk(s)......... Ch:ID none Stripe Size......................... Logical Drive Cache Status.......... Configuration Signature............. Media Exchange Detected?............ 128 KB cache enabled 0xAAA644E9 no ---- SCSI DEVICE 2:5 [DISK] -------------------------------------------------Connector Location............................... Channel Number......
Device Type...................................... DISK Disk Capacity.................................... Fault Tolerance Mode................ RAID 1+0 (Disk Mirroring) Logical Drive Size.................. 17361 MB Logical Drive Status................ OK # of Participating Physical Disks... 2 Participating Physical Disk(s)...... Ch:ID 2: 5 2: 8 Participating Spare Disk(s)......... Ch:ID none Stripe Size......................... Logical Drive Cache Status.......... Configuration Signature.............
Device Type...................................... Device Vendor ID................................. Device Product ID................................ SCSI Transfer Rate...............................
RECOVERING WRONG PHYSICAL DISK WAS REPLACED PHYSICAL DISK(S) NOT PROPERLY CONNECTED EXPANDING NOT YET AVAILABLE QUEUED FOR EXPANSION One or more physical disks in this logical drive are being rebuilt. When the logical drive was in a degraded state, the system was powered off and a disk other than the failed disk was replaced. When the system was powered off, one or more disks were removed. Any other logical drives are held in a temporary FAILED state when this occurs.
**** S A U T I L S u p p o r t U t i l i t y **** **** **** **** for the HP SmartArray RAID Controller Family **** **** **** **** version A.02.09 **** **** **** **** (C) Copyright 2003, 2004 Hewlett-Packard Development Company, L.P. **** ****************************************************************************** ---- DRIVER INFORMATION -----------------------------------------------------Driver State........................
A Controller Specifications This appendix provides specification details for HP Smart Array 6402 and Smart Array 6404 Controllers. This appendix addresses the following topics: Table A-1: “Smart Array 6402 Controller Specifications” (page 65) Table A-2: “Smart Array 6404 Controller Specifications” (page 65) Smart Array 6400 Series Controller Specifications Table A-1 provides specification details for HP Smart Array 6402 Controllers.
Table A-2 Smart Array 6404 Controller Specifications (continued) Storage/Shipping Temperature Range -20 to 55 degrees C (-4 to 121 degrees F) Operating Relative Humidity (noncondensing) 10% to 70% (Storage/Shipping 5% to 90%) 66 RAID Levels Supported 0, 1, 1+0, 5, and ADG Processor Type PowerPC 405 at 266 MHz DDR SDRAM Bus Transfer Rate Up to 2.0 GB/s at 266 MHz (DDR, 72 bit) PCI Specification Complies with PCI-X revision 1 PCI-X Bus Connector Type 3.
B Physical Disk Installation and Replacement This appendix discusses the procedure for replacing physical disks in an array. This appendix addresses the following topics: “Overview” (page 67) “Physical Disk Failure” (page 67) “Compromised Fault Tolerance” (page 70) “Automatic Data Recovery” (page 70) “Physical Disk Replacement Overview” (page 71) “Physical Disk Failure During Rebuild” (page 71) Overview Each SCSI channel on a Smart Array Controller can support up to 14 physical disks.
Figure B-1 Physical Disk Status LED Indicators Table B-1 Physical Disk Status from LED Illumination Pattern Activity (1) Online (2) Fault (3) Interpretation On, Off, or Flashing On or Off Flashing A predictive failure alert has been received for this disk. Replace the disk as soon as possible. On, Off, or Flashing On Off The disk is online and configured as part of an array.
Table B-1 Physical Disk Status from LED Illumination Pattern (continued) Activity (1) Online (2) Fault (3) Interpretation Off Off On The disk has failed and has been placed offline. You can replace the disk. Off Off Off One of the following conditions applies: • It is not configured as part of an array. • It is part of an array, but it is a replacement drive that is not being accessed or being rebuilt yet. • It is configured as an online spare.
Compromised Fault Tolerance Compromised fault tolerance commonly occurs when more physical disks have failed than the fault tolerance method can support. When fault tolerance fails, the logical volume also fails and unrecoverable disk error messages are returned to the host. Data loss is likely to occur. For example, one drive fails in an array configured with RAID 5 fault tolerance while another drive in the same array is still being rebuilt. If the array has no online spare, the logical drive fails.
If the Online LED of the replacement disk drive stops blinking during automatic data recovery, there are three possible causes: • If the Online LED is glowing continuously, automatic data recovery is successful and finished. • If the Fault LED is illuminated or other LEDs go out, the replacement disk has failed and is producing unrecoverable disk errors. Remove and replace the failed replacement disk.
To minimize the likelihood of fatal system errors, take the following precautions when removing failed disks: • Do not remove a degraded drive when any other disk in the array is offline (the Online LED is off). The following exceptions apply: • When RAID 1+0 is used, drives are mirrored in pairs. Several disks can fail simultaneously, and they can all be replaced simultaneously without data loss as long as no two failed disks belong to the same mirrored pair.
C Logical Drive Failure Probability This appendix discusses the probability of logical drive failure. RAID Level and Probability of Drive Failure The probability that a logical drive will fail depends on the RAID level setting. • A RAID 0 logical drive fails if only one physical disk fails.
Figure C-1 Relative Probability of Logical Drive Failure 74 Logical Drive Failure Probability
D Electrostatic Discharge This appendix discusses ways to prevent damage to your system due to Electrostatic Discharge (ESD). This appendix addresses the following topics: “Handling Parts” (page 75) “Grounding” (page 75) Handling Parts To prevent damage to your system, you must take precautions when setting up the system or handling parts. A discharge of static electricity from a finger or other conductor can damage system boards or other static-sensitive devices.
E Frequently Asked Questions Smart Array 6400 Series Controller FAQ Q: Are simultaneous internal and external connections supported for one channel? A: No, simultaneous internal and external connections are not supported for one channel. For example, you cannot have both an internal connection for channel A and an external connection for channel A. However, you can have an internal connection for channel A and an external connection for channel B.
RAID 5, and the two sets of parity data are calculated and written across all the drives in the array. RAID ADG provides an extremely high level of fault tolerance and can sustain two simultaneous drive failures without downtime or data loss. This fault tolerance level is useful for mission-critical data.
Glossary array A set of physical disks configured into one or more logical drives. Arrayed disks have significant performance and data protection advantages over non-arrayed disks. array accelerator A component of some Smart Array Series controllers that dramatically improves disk read and write performance by providing a buffer. Data integrity is protected by a backup battery and ECC memory. array capacity expansion See capacity expansion.
logical drive has performance advantages over individual physical disks. Also known as a logical volume. logical drive capacity extension See capacity extension. Low Voltage Differential (LVD) A type of SCSI signaling that enables a maximum transfer rate of either 80 MB/s or 160 MB/s, conforming to either the Wide Ultra2 or Wide Ultra160 SCSI standards, respectively. online spare A fault-tolerant system that normally contains no data.
*J6369-90051* Printed in the US
