User Service Guide, Server Expansion Unit for the HP Integrity rx8640 HP Part Number: AB301-9007A_ed5 Published: March 2010 Edition: Fifth Edition
Legal Notices © Copyright 2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Microsoft and Windows are U.S.
Table of Contents About this Document.......................................................................................................11 Book Layout..........................................................................................................................................11 Intended Audience................................................................................................................................11 Printing History.....................................................
Air Flow...........................................................................................................................................31 3 Installing the Server Expansion Unit..........................................................................33 Inspecting the Server Cabinet...............................................................................................................33 Unpacking the Server Expansion Unit....................................................................
Troubleshooting...............................................................................................................................80 Troubleshooting Aids......................................................................................................................81 Maintenance Processor...............................................................................................................81 ODE Diagnostics............................................................................
B MP Commands...........................................................................................................111 Server Management Commands.........................................................................................................111 C Templates...................................................................................................................113 Equipment Footprint Templates.............................................................................................
List of Figures 1-1 1-2 1-3 1-4 1-5 1-6 2-1 3-1 3-2 3-3 3-4 3-5 3-6 3-7 3-8 3-9 3-10 3-11 3-12 3-13 3-14 3-15 3-16 3-17 3-18 3-19 3-20 3-21 3-22 3-23 3-24 3-25 3-26 3-27 3-28 3-29 3-30 3-31 4-1 4-2 4-3 4-4 4-5 4-6 4-7 4-8 4-9 4-10 4-11 4-12 4-13 SEU (Front View)...........................................................................................................................15 SEU (Without Front Bezel)..................................................................................................
4-14 5-1 5-2 5-3 5-4 5-5 5-6 5-7 5-8 5-9 5-10 5-11 C-1 C-2 C-3 C-4 8 Air Flow.........................................................................................................................................94 DDS-4 or DVD Drive Location......................................................................................................98 DDS-4 or DVD Drive Detail..........................................................................................................98 Disk Drive Location .......
List of Tables 1-1 1-2 1-3 1-4 1-5 1-6 1-7 1-8 2-1 2-2 2-3 2-4 2-5 2-6 2-7 3-1 3-2 4-1 4-2 4-3 4-4 4-5 4-6 4-7 4-8 4-9 4-10 4-11 4-12 4-13 4-14 4-15 4-16 5-1 5-2 5-3 A-1 B-1 B-2 B-3 SEU Core I/O Boot Path.................................................................................................................17 Cell 2 PCI Slot Boot Paths..............................................................................................................19 Cell 3 PCI Slot Boot Paths..........................
List of Examples 4-1 4-2 4-3 10 Attention Light Is Blinking............................................................................................................80 Full Status Output.........................................................................................................................87 Cell Partition Output.....................................................................................................................
About this Document This document covers the new HP Server Expansion Unit. This document does not describe system software or partition configuration operations in any detail. For information concerning those topics refer to the HP System Partitions Guide.
Diagnostics and Event Monitoring: Hardware Support Tools Complete information about HP’s hardware support tools, including online and offline diagnostics and event monitoring tools, is at the following website: www.hp.com/go/bizsupport .This site has manuals, tutorials, FAQs, and other reference material. Web Site for HP Technical Support: HP’s IT resource center located at the following website: http://www13.itrc.hp.com/service/home/home.
— — • Call 1-800-HP-INVENT (1-800-474-6836). This service is available 24 hours a day, 7 days a week. For continuous quality improvement, calls may be recorded or monitored. If you have purchased a Care Pack (service upgrade), call 1-800-633-3600. For more information about Care Packs, see the HP website: (http://www.hp.com/hps). In other locations, see the Contact HP worldwide (in English) webpage (http:// welcome.hp.com/country/us/en/wwcontact.html) Documentation feedback HP welcomes your feedback.
1 Server Expansion Unit Overview The Server Expansion Unit (SEU) is a member of the HP business-critical computing platform family: a 9U tall, mid-range, mid-volume I/O expansion cabinet. It provides additional I/O performance with the inclusion of 16 PCI-X slots or a combination of 8 PCI-X slots and 8 PCI-e slots, two additional core I/O cards, four more hard disk drives, and two removable media drives. The SEU connects to the HP Integrity rx8640 server, providing additional I/O slots to the server.
Figure 1-2 SEU (Without Front Bezel) Features include: • • • • • • • • • • • Better availability and up time than previous SEU Depth optimized (shallower, fewer racking issues) Increased performance density Increased PCI-X performance Internal removable media Up to four additional internal disks Dual power cords enable N+1 redundancy on AC input Up to sixteen additional PCI-X slots Combination of eight additional PCI-X slots and eight additional PCI-e slots (with PCI-X/PCIe backplane).
contains clock generation circuits, manageability circuits, DC-to-DC converters, power monitor logic, and fan control. Core I/O Backplane Module The core I/O backplane is housed in a separate sheet metal module holding the backplane and the core I/O boards. This module can be removed from the rear of the chassis for easy access to the core I/O backplane. The module adapts the core I/O sockets in a horizontal mounting position to the system backplane, which is mounted vertically.
Table 1-1 SEU Core I/O Boot Path (continued) Core I/O card Device Path Description 3 1 Gb LAN 3/0/0/1/0 The SYS LAN connector located on core I/O 3. 3 SCSI drive 3/0/0/2/0.6.0 Hard drive located in the bottom left disk bay. 3 SCSI drive 3/0/0/2/1.X.0 Removable media DVD (X = 2) or DDS-4 (X = 3) tape drive located in the upper disk bay. 3 SCSI drive 3/0/0/3/0.6.0 Hard drive located in the bottom right disk bay.
NOTE: Fans driven to a high RPM in dense air cannot maintain expected RPM and will be considered bad by the MP leading to a “False Fan Failure” condition. PCI-X Slot Boot Paths Table 1-3 and Table 1-3 list the mapping of PCI-X slots to ropes and boot paths. Pathing will have to be modified for PCI cards that have different devices and functions.
Each PCI/PCI-X slot has a host-to-PCI bridge associated with it, and each PCIe slot has a host-to-PCIe bridge associated with it. A dual slot hot swap controller chip and related logic is also associated with each pair of PCI or PCIe slots. The I/O chip on either cell location 0 or 1 is a primary I/O system interface. Upstream, the I/O chips communicate directly with the cell controller ASIC on the host cell board via a high bandwidth logical connection known as the HSS link.
Figure 1-3 Internal Disks Table 1-4 Removable DVD Media Drive Path DVD Media Path Slot 0 Media 2/0/0/2/1.2.0 Slot 1 Media 3/0/0/2/1.2.0 Table 1-5 Removable DDS-4 Media Drive Path DDS-4 Media Path Slot 0 Media 2/0/0/2/1.3.0 Slot 1 Media 3/0/0/2/1.3.0 Table 1-6 Hard Disk Drive Path Hard Drive Path Slot 0 Drive 2/0/0/2/0.6.0 Slot 1 Drive 2/0/0/3/0.6.0 Slot 2 Drive 3/0/0/2/0.6.0 Slot 3 Drive 3/0/0/3/0.6.
Figure 1-4 System Backplane (Side View in Chassis) The voltage regulator modules (VRMs) that provide 3.3 V and 3.3 V standby are located on this backplane. The backplane also has the connectors to provide a hardware interface to the SEU chassis. Clocks and Reset The system backplane contains reset and clock circuitry that propagates through the whole system. The system backplane central clocks drive all major chip set clocks.
slots are keyed for 3.3V connectors (accepting both Universal and 3.3V cards). The PCI-X backplane does not provide any 5V slots for the I/O cards. The external link for the SEU attaches the cell controller on cell board 2 to SBA 0 and attaches the cell controller on cell board 3 to SBA 1 of the PCI-X board in the SEU cabinet. The PCI-X backplane is physically one board but behaves like two independent partitions. SBA 0 and its associated LBAs and eight PCI-X slots form one I/O partition.
Table 1-8 PCI-X/PCIe I/O Backplane Slot Types I/O Partition 0 1 1 2 Slot1 Maximum Speed MHz Ropes Supported Cards PCI Mode Supported 82 66 001 3.3 V PCI or PCI-X Mode 1 7 133 002/003 3.3 V PCI or PCI-X Mode 1 6 266 004/005 3.3 V PCIe 5 266 006/007 3.3 V PCIe 4 266 014/015 3.3 V PCIe 3 266 012/013 3.3 V PCIe 2 133 010/011 3.3 V PCI or PCI-X Mode 1 1 133 008/009 3.3 V PCI or PCI-X Mode 1 82 66 001 3.3 V PCI or PCI-X Mode 1 7 133 002/003 3.
SEU Description Dimensions The dimensions of the SEU are as follows: • • Width: 17.5 inches, constrained by electronic industries alliance (EIA) standard 19-inch racks. Depth: Defined by cable management constraints to fit into a standard 36-inch deep rack: * 25.5 inches from front rack column to PCI connector surface. * 26.7 inches from front rack column to core I/O connector surface. * 30 inches overall package dimension, including 2.7 inches protruding in front of the front rack columns.
The PCI on-line replacement (OLR) fan modules are located in front of the PCI cards. These six fans are housed in plastic carriers. They are configured in two rows of three fans. Four OLR system fan modules, externally attached to the chassis, are 120-mm (4.7-inch) fans. Two fans are mounted on the front surface of the chassis and two are mounted on the rear surface.A cable harness that connects from the rear of the BPSs to the system backplane provides DC power distribution.
2 Server Site Preparation This chapter describes the basic configuration, physical specifications and requirements for the server. Dimensions and Weights This section provides dimensions and weights of the Server Expansion Unit components. Table 2-1 SEU Dimensions and Weights Standalone Packaged Height—Inches (centimeters) 15.8 (40.0) 28.0 (71.1) Width—Inches (centimeters) 17.5 (44.5) 28.38 (72.1) Depth—Inches (centimeters) 30.0 (76.2) 35.75 (90.8) Weight1—Pounds (kilograms) 165 (74.8) 210.
Circuit Breaker The Marked Electrical for the SEU is 7A per line cord. The recommended circuit breaker size is 20 amps for North America. For countries outside North America, consult your local electrical authority that has jurisdiction for the recommended circuit breaker size. The SEU contains two C20 power receptacles located at the bottom rear bulkhead. A minimum of one power cord must be used to maintain normal operation of the SEU.
Table 2-5 System Power Requirements Power Required (50 - 60 Hz) Watts VA Comments Maximum Theoretical Power 921 940 See Note 1 Marked Electrical Power ––– 1300 30A @ 180 VAC, See Note 2 Typical Maximum Power 601 613 See Note 3 Note 1: Maximum Theoretical Power: or “Maximum Configuration” (Input power at the ac input expressed in Watts and Volt-Amps to take into account Power factor correction.) The calculated sum of the maximum worst case power consumption for every subsystem in the server.
Table 2-6 Example ASHRAE Thermal Report (continued) Condition Full configuration Typical configuration 601 394 ASHRAE class 150 150 255 255 165 165 70.50 75.00 h=17.29 401.32 w=17.50 444.50 d=30.00 762.00 h=17.29 401.32 w=17.50 444.50 d=30.00 762.
ventilation and to help reduce the localized airflow dead spots that typically occur at the faceplate tail of each PCI card. Standby Cooling Several components within the chassis consume significant amounts of power while the system is in standby mode. The fans within the power supply operate at full speed during standby. Typical Power Dissipation and Cooling Table 2-7 provides calculations for configurations exactly as described in the table.
Figure 2-1 Airflow Diagram 32 Server Site Preparation
3 Installing the Server Expansion Unit The following instructions are included for unpacking a racked SEU. There are also instructions for unpacking a non-racked SEU. Inspect shipping containers when the equipment arrives at the site. Check equipment after the packing has been removed. This chapter discusses how to inspect and receive the SEU. Inspecting the Server Cabinet NOTE: The server will ship in one of three different configurations.
If the equipment has any damage, a damage claim form must be obtained by the customer from the shipping representative. The customer should complete the form and return it to the shipping representative. NOTE: The SEU may come already racked or ready for rack installation. Unpacking a Racked SEU This section contains information about unpacking the cabinet. WARNING! Wear protective glasses while cutting the plastic bands around the shipping container. These bands are under tension.
4. Remove the packing materials. CAUTION: The plastic wrapping material should be cut off rather than pulled off. Pulling the plastic covering off represents an electrostatic discharge (ESD) hazard. Figure 3-1 Removing the Polystraps and Cardboard 5. Remove the four bolts securing the ramps to the pallet and remove the ramps. See Figure 3-2.
Figure 3-2 Removing the Shipping Bolts and Plastic Cover 36 Installing the Server Expansion Unit
6. Remove the six bolts from the base attaching the rack to the pallet. See Figure 3-3. Figure 3-3 Preparing to Roll Off the Pallet WARNING! Be sure that the leveling feet on the rack are raised before you roll the rack down the ramp and any time you roll the rack on the casters. Use caution when rolling the cabinet off the ramp. A single server in the cabinet weighs several hundred pounds. HP strongly recommends that two people roll the cabinet off the pallet.
Unloading with a Lifter Use the following procedure to unload the SEU from the pallet using a lifter. WARNING! Use caution when using a lifter. Because of the weight of the SEU, it must be centered on the lifter forks before raising it off the pallet to avoid injury. Never extend more than one server from the same cabinet while installing or servicing either an SEU or another server product. Failure to follow these instructions could result in the cabinet tipping over.
Figure 3-6 Positioning RonI Lifter with the SEU Pallet 4. 5. 6. Insert the lifter forks under the SEU. Carefully roll the lift forward until it is fully positioned against the side of the SEU. Slowly raise the SEU off the pallet until it clears the pallet cushions.
7. Roll the lifter and SEU away from the pallet. Do not raise the SEU any higher than necessary when moving it over to the rack. Figure 3-7 Lifting the SEU into Position for Rack Installation Installing the Cable Management Arm After the SEU is installed in the rack, the cable management arm (CMA) must be installed on the rear of the SEU. Follow the instructions for installing the CMA in the Installation Guide, HP J1530B, Rack Integration Kit (MPN J1530–90003), beginning on page 14.
System damage can occur through improper removal and replacement of devices. This task must be performed by trained personnel only. Instructions for removing and replacing these components can be found in the Removal & Replacement chapter of the Service Guide. CAUTION: Observe all ESD safety precautions before attempting this procedure. Failure to follow ESD safety precautions could result in damage to the server. Any HP SEU installed into a rack is shipped with equipment slides.
Figure 3-8 Embedded Disks Hard Disk Drive Installation The disk drives are located in the front of the chassis. The hard disk drives are hot-plug drives. CAUTION: Observe all ESD safety precautions before attempting this procedure. Failure to follow ESD safety precautions could result in damage to the SEU. 1. 2. 3. 4. Be sure the front locking latch is open, then position the disk drive in the chassis. Slide the disk drive into the chassis; a slow, firm pressure is needed to properly seat the connector.
Table 3-1 covers cards supported in the SEU when connected to the respective server shown in the table. Refer to the Installation Guide for the server to obtain the number and type of PCI/PCI-X/PCIe cards supported in a server.
Table 3-1 HP Integrity rx8640 SEU PCI-X/PCIe I/O Cards (continued) Part Number Card Description HP-UX Windows Linux VMS AB379B QLogic 2-port 4Gb FC card (PCI-X 266) B B B B B B 1 AB429A 1-Port 4Gb FC QLogic – AB378A equivalent AB465A1 2-port 1000b-T 2Gb FC Combo AB466A1 Emulex 1050DC Fibre Channel B AB467A Emulex 1050D Fibre Channel B AB545A 4-Port 1000b-T Ethernet AD167A1 Emulex 4Gb/s AD193A 1-port 4Gb FC & 1-port GbE HBA PCI-X Bb B AD194A 2-port 4Gb FC & 2-port GbE HBA PCI
PCI I/O Card Installation CAUTION: While the installation process for PCI/PCI-X cards and PCIe cards is the same; PCIe cards are physically smaller than PCI-X cards and are not interchangeable with PCI/PCI-X cards. Check Table 1-8 (page 24) to verify the slot types and order. NOTE: The PCI I/O card installation process varies depending on which version of the HP-UX operating system you are running on your system. PCI I/O card installation procedures should be downloaded from the www.hp.
NOTE: The Server Expansion Unit implements manual retention latch (MRL) hardware for use in online add or replacement (OLAR) operations. If an MRL is left open while the server is booting, HP-UX can incorrectly cache PCI slot power status causing OLAR operations to fail. To prevent this situation, ensure all the MRLs are closed before booting the server.
HP Integrity rx8640 Server E-Link Cable Installation NOTE: server. This section describes the installation of the E-link cables between the SEU and the INSTALLATION NOTES BEFORE GETTING STARTED • • • • • • • Before attaching the SEU, the server must be shut down. Schedule this with the customer prior to beginning the SEU installation. The SEU is only supported with servers containing a minimum of three cell boards. The cell boards must be loaded in the server in cell board slots 0, 1, and 2.
Type Control-b (^B) to exit the VFP display. • If an nPartition has booted HP-UX, or if it is in the process of launching HP-UX, you must shut down HP-UX on the nPartition. When HP-UX is running on an nPartition, its VFP displays the “HP-UX heartbeat” with a blinking asterisk * to indicate its interactivity. In this case, proceed with the next step. • • If the nPartition is at its extensible firmware interface (EFI) shell, then HP-UX has already been shut down.
Figure 3-10 Server Top Cover Removal Removing the Server Top Cover 1. 2. 3. 4. 5. Connect to ground with a wrist strap. Loosen the blue retaining screws securing the cover to the chassis. Slide the cover toward the rear of the chassis. Lift the cover up and away from the chassis. Place the cover in a safe location.
Side Cover Removal Figure 3-11 Side Cover Removal 1. 2. 3. Loosen the blue retaining screw securing the side cover to the chassis. (See Figure 3-11.) The screw is located at the bottom of the server chassis. Slide the cover from the chassis toward the rear of the system. Place the cover in a safe location. After removing the side cover, the system backplane is visible.
Figure 3-12 Server System Backplane Location Connecting E-Link Cables to the Server The cables will be routed inside the server chassis and connected to the shrouds on the server backplane. 1. 2. 3. 4. Remove the E-link cable bridge bracket, located at the rear of the server chassis in the upper right side, by turning the two thumbscrews counterclockwise. Lift the U-shaped SBA hold-down bracket positioned behind the E-link cable bridge bracket up and away from the chassis.
7. Complete the procedure by securing the remaining three E-link cables in place with the captive screw located on each cable. See Figure 3-13 for E-link cable orientation. Figure 3-13 E-link Cable Orientation on Server Connecting E-link Cables to the SEU 1. 2. 3. 4. 5. 6. Remove the top and left side covers from the SEU. Remove the E-link cable bridge bracket, hold-down bracket, and filler plates at the rear of the SEU in the upper right corner. Discard the parts just removed from the SEU.
Figure 3-14 E-Link Cable Bracket Secured to SEU Backplane 8. Reinstall the top and side covers.
Figure 3-15 E-Link Cable Connection (Server to Server Expansion Unit) E-Link Cable Routing for SEU Installed in Same Cabinet as the Server The E-link cable bundle must be routed on the right side of the cabinet using the path shown in Figure 3-16 when the SEU is installed in the same rack cabinet with the server.
Figure 3-16 E-Link Cable Routing (Rear of Cabinet) E-Link Cable Routing for SEU Installed in Adjacent Cabinet to the Server The E-link cable bundle must be routed using the path shown in Figure 3-17 when the SEU is installed in a rack cabinet adjacent to the server.
Figure 3-17 E-Link Cable Routing (Rear of Cabinets) • When the SEU is installed in an adjacent rack to the server, adhere to the following guidelines for installation: — Two SEUs can be installed in a single rack cabinet. — The racks must be either 41U or 33U. A 25U rack is not permitted for SEU installation. — The rack cabinets must be installed with proper anti-tip feet, system interlock rods, and ballast.
Figure 3-18 Cabinet Label Placement Voltage Check This section provides voltage check information for use on the customer site. The emphasis focuses on measuring the voltages at the power cord plug end specified as an IEC-320 C19 type plug. This is the end that plugs directly into the back of the SEU chassis.
NOTE: These procedures must be performed for each power cord that will be plugged directly into the back of the SEU. If the expected results from this procedure are not observed during the voltage check, refer to the next section titled “Voltage Check (Additional Procedure).” Voltage Range Verification of Receptacle This measures the voltage between L1 and L2, L1 to ground, and L2 to ground. Three separate measurements are performed during this procedure.
Safety Ground Verification This measures the voltage level between B0 and A0. The measurement is taken between ground pins of the two power cords. Refer to Figure 3-20 for ground reference points when performing this measurement. Figure 3-20 Safety Ground Reference Check 1. 2. 3. 4. Measure the voltage between B0 and A0. Take the AC voltage down to the lowest scale on the volt meter. Insert one probe into the ground pin for B0. Insert the other probe into the ground pin for A0.
Figure 3-21 Wall Receptacle Pinouts WARNING! There is a risk of shock hazard while testing primary power. Use properly insulated probes. 5. 6. 7. 8. Verify that the voltage between receptacle pins X and Y is between 200–240V AC. Set the site power circuit breaker to OFF. Ensure that power is removed from the server. Route and connect the server power connector to the site power receptacle. • For locking type receptacles, line up the key on the plug with the groove in the receptacle.
Figure 3-22 Power Cord Receptacle Configuration Power cord receptacles are identified using a label at the rear side of the chassis indicating which receptacle is B0 and which receptacle is A0. The SEU follows the power configuration that is selected for the server. So, if grid A0 & B0 are selected for the server, the SEU needs to have both power cords connected. Otherwise, power fault messages are logged. You cannot select one power configuration for the SEU and another power configuration for the server.
Figure 3-23 Power Source versus Power Distribution WARNING! Voltage is present at various locations within the SEU whenever a power source is connected. This voltage is present even when the main power switch is in the OFF position. To completely remove power, both power cords must be removed from the SEU. Failure to observe this warning could result in personal injury or damage to equipment. 1. 2. 3.
Figure 3-24 IO Expander Line Cord Anchor MP Core I/O Connections Each SEU has two core I/O cards installed and each core I/O card has a management processor (MP). This enables two partitions to operate, or enables MP core I/O redundancy in a single partition configuration. Each MP core I/O board is oriented horizontally and accessed from the back of the server. IMPORTANT: The MP LAN, local and remote console ports are never functional for a core I/O card installed in the SEU.
• • • • One Ultra 320 (320Mb/second) 68-pin SCSI port—A connection for external SCSI devices (by way of a VHDCI connector). VHDCI is an industry-standard term that stands for Very High-Density Cable Interconnect. One RJ-45 style 10Base-T/100Base-T/1000Base-T system LAN connector—This LAN uses standby power and is active when AC is present and the front panel power switch is off. One RJ-45 style 10Base-T/100Base-T MP LAN connector—This LAN port is not functional when the core I/O is installed in the SEU.
Standby Power and Logging in to the MP Housekeeping power (also known as standby power) is generated as soon as AC power is applied to the server. Because the MP uses standby power, it is possible to login to the server MP even when the power switch is in the OFF position. The power switch is a DC power switch that controls +48V DC. NOTE: 1. Connection to the MP is performed through the core I/O card installed in the server.
Configuring LAN Information for the MP To set the server MP LAN IP address: 1. At the server MP Main Menu prompt (MP>), enter cm.From the MP Command Menu prompt (MP:CM>), enter lc (for LAN configuration). The screen lists the default values and asks if you want to modify them. It is a good idea to write down the information, as it may be required for future troubleshooting. NOTE: If the Command Menu is not shown, enter q to return to the MP Main Menu, then enter cm. Enter lc and press the Return key.
11. A screen similar to the following appears allowing verification of the settings: Figure 3-29 The ls Command Screen To return to the server MP main menu, enter ma. To exit the server MP, enter x at the MP main menu. Examining the MP Bus Devices To determine what is seen by the MP in the system: 1. At the server MP prompt, enter cm. The Command Menu is displayed. With the Command Menu, you can view or modify the configuration and look at utilities controlled by the MP.
following procedure to check the configuration for the AC line status and configure it to match the customer’s environment. NOTE: Connection to the MP is performed through the core I/O card installed in the server. The SEU follows the power configuration selected for the server. 1. 2. At the server MP prompt, enter cm. The command menu is displayed, and allowing the viewing and configuring of various utilities controlled by the MP. From the command prompt (MP:CM>), enter pwrgrd.
NOTE: After turning on the 48V sub system, wait 1–2 minutes for the partition configuration (complex A, B & C configurations) information to be transferred to the core I/O cards. To determine this has been accomplished, log in to the MP and view the MP Main Menu selections available. The CO: Consoles option is not available until the transfer of partition configuration is complete. See examples below.
Cell 2 : Cell 3 : 001.002.000 001.002.000 001.002.000 001.002.000 001.005.001 001.005.001 FIRMWARE: Core IO MP-0 ED-0 MP-1 ED-1 Cell 0 PDHC PDHC PDC_FW PDC_FW Cell 1 PDHC PDHC PDC_FW PDC_FW Cell 2 PDHC PDHC PDC_FW PDC_FW Cell 3 PDHC PDHC PDC_FW PDC_FW : : : : B.002.005.012 002.007.000 B.002.005.012 002.007.000 : : : : B.023.003.038 - Active B.023.003.037 043.006.000 - Active 043.005.000 : : : : B.023.003.038 - Active B.023.003.037 043.006.000 - Active 043.005.000 : : : : B.023.003.
4 Troubleshooting The following sections contain general procedures to help you locate installation problems. Common Installation Problems CAUTION: Do not operate the server with the top cover removed for extended period of time. Otherwise, overheating can damage chips, boards, and mass storage devices. However, you can safely remove the top cover while the server is running to remove and replace PCI hot-plug cards. Most problems are the result of incorrect system and SCSI subsystem configurations.
1. 2. 3. 4. 5. Check for fault LEDs and check the MP logs for errors. Check that a conductive item has not been dropped or left inside the SEU chassis. Check the connections on all boards. Check the system backplane for bent pins. Minimize configuration to isolate a potential bad device. SEU LED Indicators The SEU has LEDs that indicate system health. This section defines those LEDs. Front Panel LEDs There are five (5) LEDs located on the front panel.
Table 4-1 Front Panel LEDs (continued) LED Status I/O Chassis 0–Cell 2 and I/O Off Chassis 1–Cell 3 Green (solid) (Cell “n” = 2, 3) Amber (flashing) Amber (solid) Description Cell power Off Cell power On, I/O backplane powered On Cell I/O fault warning. Check for: • LPM not ready • Loss of power redundancy Cell “n” I/O link not connected I/O link connected but Cell “n” not present Locate Red (solid) Cell “n” I/O fault.
PCI-X Power Supply LEDs There are three LEDs on the PCI-X power supply. The green power LED reports overall power status for the PCI power supply. The multi-colored fault LED reports faults and warnings. Figure 4-3 PCI-X Power Supply LED Locations Table 4-3 PCI-X Power Supply LEDs LED State Description Power¹ On Green All output voltages generated by the power supply are within limits. Off Power to entire system has been removed. Off Normal operation.
Figure 4-4 Fan LED Locations Table 4-4 contains the LED states for the front, rear, and PCI I/O fans. Table 4-4 Front, Rear and I/O Fan LED States LED Driven By State Description Fan Status Fan Solid Green Normal Flash Yellow Predictive failure Flash Red Failed Off No Power PCI OL* Card Divider LEDs The PCI OL* card LEDs are located on each of the 16 PCI slot dividers in the PCI-X card cage assembly area. The green power LED indicates whether power is supplied to the card slot.
Figure 4-5 PCI OL* LED Locations Table 4-5 OL* LED States State Power (Green) Attention (Yellow) Normal operation, slot power on On Off Slot selected, slot power on On Flashing Slot needs attention, slot power on On On Slot available, slot power off Off Off Ready for OL*, slot power off Off Flashing Fault detected, slot power off Off On Slot powering down or up Flashing Off Core I/O LEDs The core I/O LEDs in Table 4-6 are located on the bulkhead of the installed core I/O PCA.
IMPORTANT: The MP LAN, local and remote console ports are never functional for a core I/O card installed in the SEU. The system LAN and UPS ports are not functional until the operating system is configured and running.
Figure 4-7 Disk Drive LED Location Table 4-7 Disk Drive LEDs ActivityLED StatusLED Flash Rate Description Off Green Steady Normal operation, power applied Green Off Steady Green stays on during foreground drive self-test Green Off Flutter at rate of activity I/O Disk activity Off Yellow Flashing at 1Hz or Predictive failure, needs immediate investigation 2 Hz Off Yellow Flashing at 0.
Figure 4-8 SEU Cabinet FRUs (Front View) Figure 4-9 SEU Cabinet FRUs (Rear View) MP Code FRU Reporting 79
NOTE: The secondary core I/O card inserted in the upper slot is identified as core I/O 3 and the primary core I/O card inserted in the lower slot is identified as core I/O 2. The SEU will work without the top (secondary) core I/O card installed but it will not operate without the bottom (primary) core I/O card installed.
Figure 4-10 Basic Troubleshooting Flowchart Troubleshooting Aids There are many troubleshooting "aids" available to help the investigator locate a failed FRU: Maintenance Processor The most useful is the Error Log indications as read using the maintenance processor (MP). Also, the MP ps command and others enables the user to interrogate the server quickly.
Using Logs and Files to Troubleshoot Several key files provide much of the information required to fully troubleshoot a failed system. This section list the files, indicate where they are located, and provide some information on how to use them. Management Processor Error Logs There are three error logs accessed from the MP: • • • System Event Log Forward Progress Log Live Events To invoke these logs, enter sl from the MP main menu.
Figure 4-11 Invoking the System Event Log Viewer Management Processor Outputs Three MP outputs can be used to determine vital status of the system: • • • sysrev— Displays system revision ps— Displays power status cp — Displays cell partition information Troubleshooting Aids 83
Server Expansion Unit Firmware Revision Verify that sx2000 Server Expansion Unit (SEU) firmware and programmable hardware versions match the PA-RISC HP 9000 rp8440 Server versions during initial installation. A single process is used at the factory for shipping the sx2000 SEU. The process uses an HP Integrity server for factory integrated and non-integrated SEU's. Therefore, the SEU will always contain an IPF firmware recipe when it ships from the factory to a customer.
PDHC PDC_FW PDC_FW Cell 2 PDHC PDHC PDC_FW PDC_FW Cell 3 PDHC PDHC PDC_FW PDC_FW : : : B.023.003.037 043.006.000 - Active 043.005.000 : : : : B.023.003.038 - Active B.023.003.037 043.006.000 - Active 043.005.000 : : : : B.023.003.038 - Active B.023.003.037 043.006.000 - Active 043.005.000 IO Cabinet FPGA and Firmware revision report PROGRAMMABLE HARDWARE : System Backplane : GPM ----------001.002.000 EMMUX ----------001.000.000 IO Backplane : IO_LPM-1 ----------001.003.
Figure 4-12 Initial Power Status Window 86 Troubleshooting
Example 4-2 Full Status Output Cell Partition Use the cp command to display a table of cells assigned to partitions, arranged by cabinets. The cp command generates display output only; no configuration is possible with this command. To invoke this output, enter cm from the MP Main Menu, and then enter cp. Example 4-3 shows example output of the cell partition command.
Example 4-3 Cell Partition Output Configuration Problems Configuration problems are often related to an improper configuration. This section provides a brief summary of nPartition configuration methods and tools. Refer to the HP System Partitions Guide for detailed information on this topic. HP nPartition-capable servers enable you to configure a single server complex as one large system or as multiple smaller systems.
Bulk Power Supplies The power subsystem is comprised of two bulk power supplies (BPS) and the power distribution Unit (PDU).. When properly loaded the BPS provide N+1 redundancy. The BPS and the PDU are in the bottom of the server chassis Each BPS has a power good LED on the front of the supply. Additionaly the system monitors and reports the current power contidion to the server. Use the ps command to view the current power status.
Table 4-9 PCI-X Power Converter Troubleshooting Symptom Action Common power failure indications: Power Good A green LED will be illuminated to indicate that all DC output LED not on. Power Fault LED is on. rails are operating within specification. The Power Good LED indicates the status of the PWR_OK signals. Backplane Power Power to the system backplane is provided throught the power distribution module located in the bottom of the server chassis.
Table 4-11 Cooling Troubleshooting Symptom Action Common cooling failure indications:- System When troubleshooting cooling, LED indications, the MP "ps" will not power up- Green fan LED may not command, and the Error Log are your most useful tools. be lighted- Error log indicates a failed fan Cooling problems are most often isolated to a failed fan or a high ambient room temperature. Visual inspections for LED indications and the use of the "ps" command should pinpoint the failing FRU.
Table 4-13 Utility Troubleshooting Symptom Action Common power failure indications:- Cannot When troubleshooting utilities, LED indications, and the Error Log log into MP.- MP not responding. are your most useful tools. Utility problems are often isolated to an access, power, or firmware problem. Verify the username & password are correct.Verify the MP port is not disabled.
Table 4-15 Booting Problems Symptom Action On an HP Integrity server, HP-UX B.11.23 begins booting but is interrupted with a panic when launching the HP-UX kernel (/stand/vmunix). The nPartition ACPI configuration might not be properly set for booting HP-UX. In order to boot the HP-UX operating system an nPartition must have its acpiconfig value set to default.At the EFI Shell interface, enter the acpiconfig command with no arguments to list the current ACPI configuration for an nPartition.
• • Computer room power Computer room grounding Figure 4-14 Air Flow Table 4-16 Server Operational Physical Environment Operating Limits Operating Temperature 20˚C to 30˚C 20˚C to 25˚C recommended Maximum Rate of Temperature Change 20˚C/hr Operating Relative Humidity 15% to 80% @ 30˚C Non-condensing40% to 55% Recommended The customer should be kept aware of the consequences of blocked airflows, heat, humidity, and unstable power on the Superdome server.
5 Removal and Replacement This chapter provides a detailed description of the Support Expansion Unit (SEU) FRU removal and replacement procedures.
2. 3. Log in to the service processor (MP) of the host server. Use the Virtual Front Panel (VFP) to view the current state of the nPartition that you will shut down. From the MP Main menu, type VFP to access the Virtual Front Panel menu, and select the nPartition whose boot state you want to view. Enter Control-b (^B) to exit the VFP display. • If an nPartition has booted HP-UX, or if it is in the process of launching HP-UX, you must shut down HP-UX on the nPartition.
4. Use the MP Command menu PS command to check details about the hardware component you plan to power off. The PS command enables you to check the status of the cabinet, system backplane, MP Core I/O, PCI power domains — or bricks — in the I/O card cage, and cells. 5. Use the MP Command menu PE command to power off the hardware component. Using the PE command, you can power on or off the cabinet (including all cells and I/O in the cabinet), individual cells, or PCI power domains (bricks).
CAUTION: Observe all ESD safety precautions before attempting this procedure. Failure to follow ESD safety precautions could result in damage to the SEU.
NOTE: The figure shown above displays two DVD components. Either or both items may be replaced by a DDS-4 component. 1. To remove the DDS-4 or DVD drive, push the front locking tab toward the DDS-4 or DVD drive, then pull the tab out to slide the DDS-4 or DVD drive out of the chassis. NOTE: DDS-4 or DVD drive components include removable rails attached to both sides. If the component is to be replaced, ensure that the replacement component includes the plastic rails.
NOTE: DDS-4 or DVD drive components include removable rails attached to both sides. If the component is to be replaced, ensure that the replacement component includes the plastic rails. If the rails are not included, extract the pin that holds each rail, remove the rail, and install both rails on the replacement component. There are two sets of holes on each side of the DDS-4 or DVD drive component. Ensure that the rails are mounted so that the pins fit into the bottom set of holes.
Removing a Disk Drive Figure 5-4 Removing the Disk Drive 1. Disengage the front locking latch on the disk drive by pushing the release tab to the right and the latch lever to the left. Figure 5-5 Disk Drive Detail 2. Pull forward on the front locking latch and carefully slide the disk drive from the chassis. Replacing a Disk Drive NOTE: Sometimes, the diskinfo and ioscan commands will produce cached data. To resolve this, these commands should be run when the disk drive is removed. 1. 2.
Where cxtxdx = the device file of the disk removed. 3. Then type the following: #ioscan -f The response message after running this command is: NO_HW 4. 5. 6. 7. Ensure that the front locking latch is open, then position the disk drive in the chassis. Slide the disk drive into the chassis; apply slow firm pressure to properly seat the connection. Press the front locking latch to secure the disk drive in the chassis.
Table 5-1 PCI Power Supply LED Indications LED LED State Meaning Power LED (Green) Off Power module failure or the power to the respective I/O chassis is OFF. On Normal operation Off Normal operation Blink amber Over temperature condition internal to supply Amber Imminent failure detected Blink red Module internal failure Fault LED (Multi-color) Removing a PCI Power Supply (Brick) 1. 2. 3. Securely grasp the handle on the front of the power supply. Firmly depress the securing thumb latch.
Removing and Replacing a Standby/Main Fan (Front) Assembly The Front Standby/MStandby/Main fan Assembly is located in the front of the chassis. The fan assembly is a hot-swap component. CAUTION: Observe all ESD safety precautions before attempting this procedure. Failure to follow ESD safety precautions could result in damage to the SEU.
4. 5. Tighten the two blue-colored captive screws (lower left and upper right sides). Replace the bezel. NOTE: The fan LED will show that the fan is operational (green). Removing and Replacing a Standby/Main Fan (Rear) Assembly The Rear Standby/Main fan Assembly is located in the rear of the chassis. The fan assembly is a hot swap component. CAUTION: Observe all ESD safety precautions before attempting this procedure. Failure to follow ESD safety precautions could result in damage to the SEU.
2. 3. Loosen the two blue screws securing the fan to the chassis. Pull the fan from the chassis. Replacing the Rear Standby/Main Fan Assembly 1. 2. 3. 4. 5. Visually inspect the replacement part for proper number and revision. Position the fan assembly in the chassis. Push the fan into the connector. Tighten the two thumb screws to secure the fan to the chassis. The LED should be GREEN. See the previous table for a listing of LED definitions.
IMPORTANT: When a BPS is pulled from the SEU and then immediately re-inserted, the SEU may report an overcurrent condition and shut down. Removing a BPS Figure 5-11 BPS Detail 1. Remove the bezel. NOTE: Bulk Power Supplies are interchangeable. To install the right-hand BPS in the left-side housing, turn the BPS 180 degrees. Ensure that the locking lever is on the inside of the component and slide the BPS into the housing until the locking lever seats. 2.
Replacing a BPS 1. Verify that the locking lever is on the inside of the component, then insert the BPS into the empty slot and slide it all the way in. NOTE: The BPS easily slides into the chassis; however, a slow, firm pressure will be needed to properly seat the connection. 2. You will know that the BPS has seated by the clicking sound made by the locking lever. NOTE: The BPS LED should show that the BPS is operational and there is no fault. The BPS LED should be GREEN.
A Replaceable Parts The CRU list contains replacement part numbers for the SEU. Where applicable, exchange part numbers are included. For a more updated list of part numbers, go to the HP Part Surfer web site at: http://www.partsurfer.hp.com.
B MP Commands This appendix contains a list of the Server Management Commands. Server Management Commands Table B-1 lists the server management commands.
Table B-3 System and Access Config Commands (continued) 112 DE Display entity status DI Disconnect Remote or LAN console DFW Duplicate firmware DU Display devices on bus FW Firmware update utility ID Change certain stable complex configuration profile fields IF Display network interface information IT Modify command interface inactivity time-out LC Configure LAN connections LS Display LAN connected console status PD Modify default Partition for this login session PWRGRD Allows user
C Templates This appendix contains blank floor plan grids and equipment templates. Combine the necessary number of floor plan grid sheets to create a scaled version of the computer room floor plan. Figure C-1 illustrates the overall dimensions required for the servers. Figure C-1 Server Space Requirements Equipment Footprint Templates Equipment footprint templates are drawn to the same scale as the floor plan grid (1/4 inch = 1 foot).
2. 3. 4. 5. Cut and join them together (as necessary) to create a scale model floor plan of your computer room. Remove a copy of each applicable equipment footprint template (Figure C-2). Cut out each template selected in step 3; then place it on the floor plan grid created in step 2. Position pieces until you obtain the desired layout, then fasten the pieces to the grid. Mark locations of computer room doors, air-conditioning floor vents, utility outlets, and so on.
Figure C-3 Planning Grid Computer Room Layout Plan 115
Figure C-4 Planning Grid 116 Templates
Index A E AC power specifications, 28 access commands, 111 air ducts, 31 illustrated, 32 AR, 111 EL, 111 electrical specifications, 27 electrostatic discharge, 95 environmental specifications, 29 ER, 111 ESD precautions ESD kit, part number, 95 B backplane, 21 mass storage, 24, 27 PCI, 16, 22 PCI-X, 18 PCI-X/PCIe I/O backplane, 19 system, 16, 21, 22, 24, 26, 27, 30, 97 BO, 111 BPS (Bulk Power Supply), 65 F C HE, 111 housekeeping power, 65 humidity, 29 CA, 111 cable management arm, 40 CC, 111 cell bo
login name, 65 password, 65 MP (Management Processor) logging in, 65 powering on, 65 MP core I/O, 20, 25, 26, 41, 63, 64, 97 MP network name, 66 MP/SCSI, 63 MR, 111 MS, 111 system specifications, 27 T TC, 111 TE, 111 temperature, 29 Templates, 113 W N warranty, 33 WHO, 111 wrist strap, 95 ND, 111 noise emission specifications, 31 X XD, 111 O operating environment, 29 P password MP, 65 PCI backplane, 16, 22 PCI-X backplane, 18 PCI-X/PCIe I/O backplane backplane, 19 PD, 111 PE, 111 power housekeeping
