HP Integrity NonStop BladeSystem Planning Guide HP Part Number: 545740-002 Published: May 2008 Edition: J06.
© Copyright 2008 Hewlett-Packard Development Company, L.P. Legal Notice Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor’s standard commercial license. The information contained herein is subject to change without notice.
Table of Contents About This Document.......................................................................................................11 Supported Release Version Updates (RVUs)........................................................................................11 Intended Audience................................................................................................................................11 New and Changed Information in This Edition...............................................
Modular Cabinet Power and I/O Cable Entry......................................................................................31 Emergency Power-Off Switches...........................................................................................................31 EPO Requirement for NonStop BladeSystems................................................................................31 EPO Requirement for HP R12000/3 UPS......................................................................................
Dedicated Service LAN Cables........................................................................................................53 Length Restrictions for Optional Cables.........................................................................................53 Cable Product IDs............................................................................................................................54 ServerNet Fabric and Supported Connections............................................................
IP Addresses....................................................................................................................................84 Ethernet Cables................................................................................................................................88 SWAN Concentrator Restrictions....................................................................................................88 Dedicated Service LAN Links Using G4SAs...............................................
List of Figures 1-1 1-2 1-3 3-1 3-2 3-3 3-4 3-5 3-6 4-1 4-2 4-3 4-4 5-1 6-1 6-2 Example of a NonStop NB50000c BladeSystem............................................................................16 c7000 Enclosure Features...............................................................................................................18 Connections Between Storage CLIMs and ESS.............................................................................
List of Tables 3-1 4-1 Example of Cabinet Load Calculations.........................................................................................52 Default User Names and Passwords.............................................................................................
About This Document This guide describes the HP Integrity NonStop™ BladeSystem and provides examples of system configurations to assist you in planning for installation of a new HP Integrity NonStop™ NB50000c BladeSystem. Supported Release Version Updates (RVUs) This publication supports J06.03 and all subsequent J-series RVUs until otherwise indicated in a replacement publication.
UPPERCASE LETTERS Italic Letters Computer Type Uppercase letters indicate keywords and reserved words. Type these items exactly as shown. Items not enclosed in brackets are required. For example: MAXATTACH Italic letters, regardless of font, indicate variable items that you supply. Items not enclosed in brackets are required. For example: file-name Computer type letters indicate: • C and Open System Services (OSS) keywords, commands, and reserved words. Type these items exactly as shown.
| Vertical Line A vertical line separates alternatives in a horizontal list that is enclosed in brackets or braces. For example: INSPECT { OFF | ON | SAVEABEND } … Ellipsis An ellipsis immediately following a pair of brackets or braces indicates that you can repeat the enclosed sequence of syntax items any number of times.
HP Encourages Your Comments HP encourages your comments concerning this document. We are committed to providing documentation that meets your needs. Send any errors found, suggestions for improvement, or compliments to: pubs.comments@hp.com Include the document title, part number, and any comment, error found, or suggestion for improvement you have concerning this document.
1 NonStop BladeSystem Overview NOTE: This document describes products and features that are not yet available on systems running J-series RVUs. These products and features include: • CLuster I/O Modules (CLIMs) • The Cluster I/O Protocols (CIP) subsystem • Serial attached SCSI (SAS) disk drives and their enclosures The Integrity NonStop BladeSystem provides an integrated infrastructure with consolidated server, network, storage, power, and management capabilities.
Figure 1-1 “Example of a NonStop NB50000c BladeSystem” shows the front view of an example NonStop NB50000c BladeSystem with eight server blades in a 42U modular cabinet with the optional HP R12000/3 UPS and the HP AF434A extended runtime module (ERM).
• • • High-end scalability Application virtualization Cluster programming transparency The NonStop NB50000c BladeSystem can be configured with 2 to 16 processors, communicates with other NonStop BladeSystems using Expand, and achieves ServerNet connectivity using a ServerNet mezzanine, PCI Express (PCIe) interface card installed in the server blade. NonStop NB50000c BladeSystem Hardware A large number of enclosure combinations is possible within the modular cabinets of a NonStop NB50000c BladeSystem.
• • Six power supplies that implement Dynamic Power Saving Mode. This mode is enabled by the OA module, and when enabled, monitors the total power consumed by the c7000 enclosure in real-time and automatically adjusts to changes in power demand. Ten Active Cool fans use the parallel, redundant, scalable, enclosure-based cooling (PARSEC) architecture where fresh, cool air flows over all the blades (in the front of the enclosure) and all the interconnect modules (in the back of the enclosure).
NonStop Server Blade The NonStop BL860c Server Blade is a two socket full-height server blade featuring an Intel® Itanium® dual-core processor. Each server blade contains a ServerNet interface mezzanine card with PCI-Express x4 to PCI-x bridge connections to provide ServerNet fabric connectivity. Other features include four integrated Gigabit Ethernet ports for redundant network boot paths and 12 DIMM slots providing a maximum of 48 GB of memory per server blade.
Storage CLIM HBA Slot Configuration Provides 2 Optional customer order SAS or Fibre Channel 1 Optional customer order SAS or Fibre Channel Connections to FCDMs are not supported. For an illustration of the Storage CLIM HBA slots, see “Storage CLIM Devices” (page 57). SAS Disk Enclosure The SAS disk enclosure is a rack-mounted disk enclosure and is part of some NonStop BladeSystem configurations.
The NonStop BladeSystem requires multiple connections to the maintenance switch. The following describes the required connections for each hardware component.
Up to four ERMs can be used for even longer battery-supported system run time. HP supports the HP AF434A ERM. WARNING! UPS's and ERMs must be mounted in the lowest portion of the NonStop BladeSystem to avoid tipping and stability issues. NOTE: The R12000/3 UPS has two output connectors. For I/O racks, only the output connector to the rack level PDU is used. For processor racks, one output connector goes to the c7000 chassis and the other to the rack PDU.
Figure 1-3 Connections Between Storage CLIMs and ESS For fault tolerance, the primary and backup paths to an ESS logical device (LDEV) must go through different Fibre Channel switches. Some storage area procedures, such as reconfiguration, can cause the affected switches to pause. If the pause is long enough, I/O failure occurs on all paths connected to that switch. If both the primary and the backup paths are connected to the same switch, the LDEV goes down.
• • “Cluster I/O Protocols (CIP) Subsystem” (page 24) “Subsystem Control Facility (SCF) Subsystem” (page 24) OSM Package The HP Open System Management (OSM) product is the required system management tool for NonStop BladeSystems. OSM works together with the Onboard Administrator (OA) and Integrated Lights Out (iLO) management interfaces to manage c7000 enclosures. A new client-based component, the OSM Certificate Tool, facilitates communication between OSM and the OA.
Terminology These are terms used in locating and describing components: Term Definition Cabinet Computer system housing that includes a structure of external panels, front and rear doors, internal racking, and dual PDUs. Rack Structure integrated into the cabinet into which rackmountable components are assembled.
Rack and Offset Physical Location Rack name and rack offset identify the physical location of components in a NonStop BladeSystem. The rack name is located on an external label affixed to the rack, which includes the system name plus a 2-digit rack number. Rack offset is labeled on the rails in each side of the rack. These rails are measured vertically in units called U, with one U measuring 1.75 inches (44 millimeters). The rack is 42U with U1 located at the bottom and 42U at the top.
NonStop Server Blade Group-Module-Slot Numbering These tables show the default numbering for the NonStop Server Blades of a NonStop BladeSystem when the server blades are powered on and functioning: GMS Numbering For the Logical Processors: Processor ID Group* Module Slot* 0 100 1 1 1 100 1 2 2 100 1 3 3 100 1 4 4 100 1 5 5 100 1 6 6 100 1 7 7 100 1 8 8 101 1 1 9 101 1 2 10 101 1 3 11 101 1 4 12 101 1 5 13 101 1 6 14 101 1 7 15 101 1 8 *In
IOAM Group Module Slot Port Fiber 112 100 2 5 5 (EB) 1-4 100 3 7 5 (EB) 1-4 100 2 5 7 (ED) 1-4 100 3 7 7 (ED) 1-4 101 2 5 4 (EA) 1-4 101 3 7 4 (EA) 1-4 101 2 5 6 (EC) 1-4 101 3 7 6 (EC) 1-4 113 114 115 IOAM Group X ServerNet Module 110 - 115 (See 2 preceding table.
Fibre Channel Disk Module Group-Module-Slot Numbering This table shows the default numbering for the Fibre Channel disk module: IOAM Enclosure FCDM Group Module Slot FCSA F-SACs Shelf 110-115 2 - X fabric; 1-5 1, 2 1 - 4 if 0 daisy-chained; Fibre Channel disk module 1 if single disk 1-14 enclosure 89 Disk drive bays 3 - Y fabric Slot Item Transceiver A1 90 Transceiver A2 91 Transceiver B1 92 Transceiver B2 93 Left FC-AL board 94 Right FC-AL board 95 Left power supply 96 Right
System Installation Document Packet To keep track of the hardware configuration, internal and external communications cabling, IP addresses, and connect networks, assemble and retain as the systems records an Installation Document Packet.
2 Site Preparation Guidelines This section describes power, environmental, and space considerations for your site. Modular Cabinet Power and I/O Cable Entry Power and I/O cables can enter the NonStop BladeSystem from either the top or the bottom rear of the modular cabinets, depending on how the cabinets are ordered from HP and the routing of the AC power feeds at the site.
exceeded. Severe electrical disturbances can exceed the design specifications of the equipment.
NOTE: Retrofitting a system in the field with a UPS and ERMs will likely require moving all installed enclosures in the rack to provide space for the new hardware. One or more of the enclosures that formerly resided in the rack might be displaced and therefore have to be installed in another rack that would also need a UPS and ERMs installed. Additionally, lifting equipment might be required to lift heavy enclosures to their new location.
NOTE: Failure of site cooling with the NonStop BladeSystem continuing to run can cause rapid heat buildup and excessive temperatures within the hardware. Excessive internal temperatures can result in full or partial system shutdown. Ensure that the site’s cooling system remains fully operational when the NonStop BladeSystem is running.
pallets using supplied ramps. Also be sure adequate personnel are present to remove each cabinet from its shipping pallet and to safely move it to the installation site. WARNING! A fully populated cabinet is unstable when moving down the unloading ramp from its shipping pallet. Arrange for enough personnel to stabilize each cabinet during removal from the pallet and to prevent the cabinet from falling. A falling cabinet can cause serious or fatal personal injury.
3 System Installation Specifications This section provides specifications necessary for system installation planning. NOTE: All specifications provided in this section assume that each enclosure in the modular cabinet is fully populated. The maximum current for each AC service depends on the number and type of enclosures installed in the modular cabinet. Power, weight, and heat loads are less when enclosures are not fully populated; for example, a Fibre Channel disk module with fewer disks.
One c7000 power feed is from the main power source and the other is from a backup UPS grid. For the R12000/3 UPS installed in a rack, the backup power source for the c7000 is one of the dedicated three phase outputs. There is no power sharing between the c7000 and the rack PDU feed. Two three-phase rack PDUs power all the other components except the c7000 in the NonStop BladeSystem. One PDU is connected to the main power input grid: the other to the backup grid.
Figure 3-1 North America/Japan 3-Phase Power Setup With Rack-Mounted UPS North America/Japan Power Setup Without Rack-Mounted UPS To setup the power feed connections as shown in Figure 3-2: 1. 2. Connect two 3-phase 30A power feeds to the two AF504A PDU NEMA L15-30P (30A, 4 wire/3 pole) input connectors. Connect two 3-phase 30A power feeds to the two NEMA L15-30P (30A, 4 wire/3 pole) input connectors within the c7000 enclosure.
Figure 3-2 North America/Japan Power Setup International Power Setup With Rack-Mounted UPS To setup the power feed connections as shown in Figure 3-3 (page 41): 1. 2. 3. 40 Connect one 3-phase 32A power feed to the rack-mounted UPS IEC309 532P6 (32A, 5 wire/4 pole) input connector. Connect one 3-phase 16A power feed to the AF508A PDU IEC309 516P6 (16A, 5 wire/4 pole) input connector. Connect one 3-phase 16A power feed to the c7000 enclosure's IEC309 516P6 (16A, 5 wire/4 pole) input connector.
Figure 3-3 International 3-Phase Power Setup With UPS International Power Setup Without Rack-Mounted UPS To setup the power feed connections as shown in Figure 3-4: 1. 2. Connect two 3-phase 16A power feeds to the two AF508A PDU IEC309 516P6 (16A, 5 wire/4 pole) input connectors. Connect two 3-phase 16A power feeds to the two IEC309 516P6 (16A, 5 wire/4 pole) input connectors within the c7000 enclosure.
Figure 3-4 International Power Setup Without Rack-Mounted UPS Power Distribution Units (PDUs) Two power distribution units (PDUs) are installed to provide redundant power outlets for the components mounted in the modular cabinet. The PDUs are oriented inward, facing the components within the rack. Each PDU is 60 inches long and has 39 AC receptacles, three circuit breakers, and an AC power cord.
Figure 3-5 shows the power feed cables on PDUs with AC feed at the bottom of the cabinet and the AC power outlets along the PDU. These power outlets face in toward the components in the cabinet.
AC Input Power for Modular Cabinets This subsection provides information about AC input power for modular cabinets and covers these topics: • • • • • “North America and Japan: 208 V AC PDU Power” “International: 400 V AC PDU Power” “Branch Circuits and Circuit Breakers” “Enclosure AC Input” (page 45) “Enclosure Power Loads” (page 46) Power can enter the NonStop BladeSystem from either the top or the bottom rear of the modular cabinets, depending on how the cabinets are ordered from HP and the AC power fee
In cabinets without the optional rack-mounted UPS, each of the two PDUs requires a separate branch circuit of these ratings: Region Volts Amps (see following “CAUTION”) North America and Japan 208 30 International 400 161 1 Category D circuit breaker is required. CAUTION: Be sure the hardware configuration and resultant power loads of each cabinet within the system do not exceed the capacity of the branch circuit according to applicable electrical codes and regulations.
input, with each phase (International) or pairs of phases (North America/Japan) associated with one of the c7000 power supplies. When the c7000 is operating in Dynamic Power Saving Mode, the minimum number of power supplies are enabled to redundantly power the enclosure. This mode increases power supply efficiency, but leaves the phases or phase pairs associated with the disabled power supplies unloaded.
Dimensions and Weights This subsection provides information about the dimensions and weights for modular cabinets and enclosures installed in a modular cabinet and covers these topics: • • • • • • “Plan View of the 42U Modular Cabinet” “Service Clearances for the Modular Cabinets” “Unit Sizes” “42U Modular Cabinet Physical Specifications” (page 48) “Enclosure Dimensions” (page 48) “Modular Cabinet and Enclosure Weights With Worksheet ” (page 49) Plan View of the 42U Modular Cabinet Service Clearances for
Enclosure Type Height (U) Maintenance switch (Ethernet) 1 R12000/3 UPS 6 Extended runtime module 3 Rack-mounted system console 2 42U Modular Cabinet Physical Specifications Item Height Width Depth Weight in. cm in. cm in. cm Modular cabinet 78.7 199.9 24.0 60.96 46.7 118.6 Rack 78.5 199.4 23.62 60.0 42.5 108.0 Front door 78.5 199.4 23.5 59.7 3.2 8.1 Left-rear door 78.5 199.4 11.0 27.9 1.0 2.5 Right-rear door 78.5 199.4 12.0 30.5 1.0 2.
Modular Cabinet and Enclosure Weights With Worksheet The total weight of each modular cabinet is the sum the weights of the cabinet plus each enclosure installed in it.
Environmental Specifications This subsection provides information about environmental specifications and covers these topics: • • • • • • “Heat Dissipation Specifications and Worksheet” “Operating Temperature, Humidity, and Altitude” “Nonoperating Temperature, Humidity, and Altitude” (page 51) “Cooling Airflow Direction” (page 51) “Typical Acoustic Noise Emissions” (page 51) “Tested Electrostatic Immunity” (page 51) Heat Dissipation Specifications and Worksheet Enclosure Type Unit Heat (BTU/hour with sin
1 2 Operating and recommended ranges refer to the ambient air temperature and humidity measured 19.7 in. (50 cm) from the front of the air intake cooling vents. For each 1000 feet (305 m) increase in altitude above 10,000 feet (up to a maximum of 15,000 feet), subtract 1.5× F (0.83× C) from the upper limit of the operating and recommended temperature ranges.
• One c7000 enclosure with 8 NonStop Server Blades • Two IP or Storage CLIMs • Two SAS disk enclosures • One IOAM enclosure • Two Fibre channel disk modules • One rack-mounted system console with keyboard/monitor units • One maintenance switch • One 42U high cabinet For a total thermal load for a system with multiple cabinets, add the heat outputs for all the cabinets in the system.
4 System Configuration Guidelines This chapter provides configuration guidelines for a NonStop BladeSystem and includes these main topics: • • • “Internal ServerNet Interconnect Cabling” “ServerNet Fabric and Supported Connections” (page 54) “NonStop BladeSystem Port Connections” (page 56) NonStop BladeSystems use a flexible modular architecture.
Connection Fiber Type Connectors Maximum Length Product ID Storage CLIM N.A. enclosure (SAS HBA) to SAS disk enclosure SFF-8470 to SFF-8088 6 m M8905nn SAS disk enclosure to N.A. SAS disk enclosure SFF-8088 to SFF-8088 6 m M8906nn Although a considerable cable length can exist between the modular enclosures in the system, HP recommends that cable length between each of the enclosures as short as possible.
ServerNet Fabric Cross-Link Connections A pair of small form-factor pluggable (SFPs) with standard LC-Duplex connectors are provided to allow for the ServerNet fabric cross-link connection. Connections are made to ports 9 and 10 (labeled X1 and X2) on the c7000 enclosure ServerNet switch. Interconnections Between c7000 Enclosures A single c7000 enclosure can contain eight NonStop Server Blades. Two c7000 enclosures are interconnected to create a 16 processor system.
Figure 4-2 ServerNet Switch High I/O Supported Connections Connections to IOAM Enclosures The NonStop BladeSystem supports connections to an IOAM Enclosure. The IOAM Enclosure requires 4-way Servernet links. If you want 4 IOAMs in the first enclosure, only the ServerNet High I/O Switch provides these number of connections, which are available on quad optic ports 4, 5, 6, and 7 (labelled EA, EB, EC, and ED) as illustrated in Figure 4-2.
Fibre Channel Ports to Fibre Tape Devices Fibre Channel tape devices can be directly connected to the Fibre Channel ports on a Storage CLIM or an FCSA in an IOAM enclosure. With a Fibre Channel tape drive connected to the system, you can use the BACKUP and RESTORE utilities to save data to and restore data from tape. SAS Ports to SAS Disk Enclosures SAS disk enclosures can be connected directly to the two HBA SAS ports on a Storage CLIM with this exception: Daisy-chain configurations are not supported.
SAS disk enclosures connect to Storage CLIMs via SAS cables. For details on cable types, see “Cable Types, Connectors, Lengths, and Product IDs” (page 93). Factory-Default Disk Volume Locations for SAS Disk Devices This illustration shows where the factory-default locations for the primary and mirror system disk volumes reside in separate disk enclosures: Configuration Restrictions for Storage CLIMs The maximum number of logical unit numbers (LUNs) for each CLIM, including SAS disks, ESS and tapes is 512.
Figure 4-3 Two Storage CLIMs, Two SAS Disk Enclosure Configuration This table lists the Storage CLIM, LUN, and bay identification for the factory-default system disk locations in the configuration of two Storage CLIMs and two SAS disk enclosures. In this case, $SYSTEM, $DSMSCM, $AUDIT, and OSS are configured as mirrored SAS disk volumes: Disk Volume Name Primary and Mirror-Backup CLIM Backup and Mirror CLIM $SYSTEM 100.2.5.3.1 100.2.5.3.3 $DSMSCM 100.2.5.3.1 100.2.5.3.3 $AUDIT 100.2.5.3.1 100.2.
Figure 4-4 Two Storage CLIMs, Four SAS Disk Enclosure Configuration This table lists the Storage CLIM, LUN, and bay identification for the factory-default system disk locations in the configuration of two Storage CLIMs and four SAS disk enclosures.
This illustration shows an FCSA with indicators and ports: This illustration shows the locations of the hardware in the Fibre Channel disk module as well as the Fibre Channel port connectors at the back of the enclosure: Fibre Channel disk modules connect to Fibre Channel ServerNet adapters (FCSAs) via Fiber Channel arbitrated loop (FC-AL) cables.
FCSA location and cable connections vary according to the various controller and Fibre Channel disk module combinations. Configurations for Fibre Channel Devices Storage subsystems in NonStop S-series systems used a fixed hardware layout. Each enclosure can have up to four controllers for storage devices and up to 16 internal disk drives. The controllers and disk drives always have a fixed logical location with standardized location IDs of group-module-slot.
• • • • • • • • • FC-AL port B1 is the outbound port to another Fibre Channel disk module In a daisy-chain configuration, the ID expander harness determines the enclosure number. Enclosure 1 is always at the bottom of the chain. FCSAs can be installed in slots 1 through 5 in an IOAM. G4SAs can be installed in slots 1 through 5 in an IOAM.
NOTE: Although it is not a requirement for fault tolerance to house the primary and mirror disk drives in separate FCDMs. the example configurations show FCDMs housing only primary or mirror drives, mainly for simplicity in keeping track of the physical locations of the drives.
This table lists the FCSA group-module-slot-port (GMSP) and disk group-module-shelf-bay (GMSB) identification for the factory-default system disk locations in the configuration of four FCSAs, four Fibre Channel disk modules, and one IOAM enclosure: Disk Volume Name FCSA GMSP Disk GMSB1 $SYSTEM (primary 1) 110.2.1.1 and 110.3.1.1 110.211.101 $DSMSCM (primary 1) 110.2.1.1 and 110.3.1.1 110.211.102 $AUDIT (primary 1) 110.2.1.1 and 110.3.1.1 110.211.103 $OSS (primary 1) 110.2.1.1 and 110.3.1.
This table list the FCSA group-module-slot-port (GMSP) and disk group-module-shelf-bay (GMSB) identification for the factory-default system disk locations in the configuration of two FCSAs, two Fibre Channel disk modules, and two IOAM enclosures: Disk Volume Name FCSA GMSP Disk GMSB1 $SYSTEM (primary 1) 110.2.1.1 and 111.2.1.1 110.211.101 $DSMSCM (primary 1) 110.2.1.1 and 111.2.1.1 110.211.102 $AUDIT (primary 1) 110.2.1.1 and 111.2.1.1 110.211.103 $OSS (primary 1) 110.2.1.1 and 111.2.1.1 110.
This table lists the FCSA group-module-slot-port (GMSP) and disk group-module-shelf-bay (GMSB) identification for the factory-default system disk locations in the configuration of four FCSAs, four Fibre Channel disk modules, and two IOAM enclosures: Disk Volume Name FCSA GMSP Disk GMSB* $SYSTEM (primary) 110.2.1.1 and 111.2.1.1 110.211.101 $DSMSCM (primary) 110.2.1.1 and 111.2.1.1 110.211.102 $AUDIT (primary) 110.2.1.1 and 111.2.1.1 110.211.103 $OSS (primary) 110.2.1.1 and 111.2.1.1 110.211.
Daisy-Chained Disks Recommended Daisy-Chained Disks Not Recommended Requirements for Daisy-Chain1 FCSA for each Fibre Channel loop is installed in a different IOAM module for fault tolerance. Two Fibre Channel disk modules minimum, with four Fibre Channel disk modules maximum per daisy chain. 1 See “Fibre Channel Devices” (page 60).
Disk Volume Name FCSA GMSP Disk GMSB* $OSS 110.2.1.1 and 110.3.1.1 110.211.104 * For an illustration of the factory-default slot locations for a Fibre Channel disk module, see “Factory-Default Disk Volume Locations for FCDMs” (page 61).
Disk Volume Name FCSA GMSP Disk GMSB $AUDIT (mirror 1) 110.2.2.1 and 110.3.2.1 110.221.110 $OSS (mirror 1) 110.2.2.1 and 110.3.2.1 110.221.
This illustration shows the Ethernet ports and ServerNet fabric connections on an IP CLIM with the IP CLIM B configuration: Both the IP and Storage CLIMs use the Cluster I/O Protocols (CIP) subsystem. For more information about managing your CLIMs using the CIP subsystem, see the Cluster I/O Protocols Configuration and Management Manual.
Table 4-1 Default User Names and Passwords To change this password, see...
1. From the NonStop host system, enter the climcmd command for password: >climcmd clim-name, ip-address, or host-name passwd It will ask for password two times. For example: $SYSTEM STARTUP 3> climcmd c1002531 passwd comForte SSH client version T9999H06_11Feb2008_comForte_SSH_0078 Enter new UNIX password: hpnonstop Retype new UNIX password: hpnonstop passwd: password updated successfully Termination Info: 0 2. Change the maintenace interface (eth0) password for each CLIM.
Preconfigured default resource names are: Type of Object 74 Example Description CLuster I/O Module (CLIM) Cgroup module slot fiber C1002532 CLIM that has an X1 attachment point of fiber on the ServerNet switch port located in group 100, module 2, slot 5, port 3, and fiber 2 SAS disk volume $SASnumber $SAS20 Twentieth SAS disk volume in the system ESS disk volume $ESSnumber $ESS20 Twentieth ESS disk drive in the system Fiber Channel disk drive $FCnumber $FC10 Tenth Fibre Channel disk drive
Type of Object Naming Convention Example Description TFTP process Automatically created by WANMGR None None WANBOOT process Automatically created by WANMGR None None SWAN adapter Snumber S19 Nineteenth SWAN adapter in the system Possible Values of Disk and Tape LUNs The possible values of disk and tape LUN numbers depend on the type of the resource. • For a SAS disk, the LUN number is calculated as base LUN + offset. base LUN is the base LUN number for the SAS enclosure.
5 Hardware Configuration in Modular Cabinets This chapter shows locations of hardware components within the 42U modular cabinet for a NonStop BladeSystem. A number of physical configurations are possible because of the flexibility inherent to the NonStop Multicore Architecture and ServerNet network. NOTE: Hardware configuration drawings in this chapter represent the physical arrangement of the modular enclosures but do not show PDUs.
Enclosure or Component Height (U) Required Cabinet (Rack) Location Notes Cabinet stabilizer N/A Bottom front exterior of cabinet Required when you have less than four cabinets bayed together. Cabinet stabilizer is not required when cabinet is bolted to its adjacent cabinet. c7000 enclosure 10U • Must be installed at U9 There is a limit of one when there is no UPS installed c7000 enclosure • Must be installed at U11 per cabinet. when there is a UPS and ERM IP CLIM 2U Any available 2U space.
Figure 5-1 42U Configuration These options can be installed in locations marked Configurable Space in the configuration drawings: • • • Maintenance switch: 1U required, preferably at the top of the cabinet when there is no UPS or the bottom of the cabinet when a UPS is present. Console: 2U required, with recommended installation at cabinet offset U20 when there is no UPS or U21 when a UPS is present.
• • • 80 A second c7000 enclosure is needed for additional NonStop Server Blades or other components. Additional SAS disk enclosures and FCDMs are needed for storage, but space doesn't exist in the cabinet. Space for optional components exceeds the capacity of the cabinet.
6 Maintenance and Support Connectivity Local monitoring and maintenance of the NonStop BladeSystem occurs over the dedicated service LAN. The dedicated service LAN provides connectivity between the system console and the maintenance infrastructure in the system hardware. Remote support is provided by OSM, which runs on the system console and communicates over the HP Instant Support Enterprise Edition infrastructure or an alternative remote access solution.
• • • • • • • One connection for each system console running OSM One connection to each of the two Onboard Administrators (OAs) in each c7000 enclosure One connection to each of the two Interconnect Ethernet switches in each c7000 enclosure One connection to the maintenance interface (eth0) for each IP and Storage CLIM.
Fault-Tolerant LAN Configuration HP recommends that you use a fault-tolerant LAN configuration.
Figure 6-2 Example of a Fault-Tolerant LAN Configuration With Two Maintenance Switches IP Addresses NonStop BladeSystems require Internet protocol (IP) addresses for these components that are connected to the dedicated service LAN: • • • • • • 84 c7000 enclosure ServerNet switches IOAM enclosure ServerNet switch boards Maintenance switches System consoles OSM Service Connection UPS (optional) Maintenance and Support Connectivity
NOTE: Factory-default IP addresses for G4SAs are in the LAN Configuration and Management Manual. IP addresses for SWAN concentrators are in the WAN Subsystem Configuration and Management Manual. These components have default IP addresses that are preconfigured at the factory. You can change these preconfigured IP addresses to addresses appropriate for your LAN environment: Component Location Default IP Address Primary system console (rack-mounted N/A or stand-alone) 192.168.36.
Component 86 Maintenance and Support Connectivity Location Default IP Address CLIM at 100.2.5.7.2 192.168.38.72 CLIM at 100.2.5.7.3 192.168.38.73 CLIM at 100.2.5.7.4 192.168.38.74 CLIM at 100.2.5.8.1 192.168.38.81 CLIM at 100.2.5.8.2 192.168.38.82 CLIM at 100.2.5.8.3 192.168.38.83 CLIM at 100.2.5.8.4 192.168.38.84 CLIM at 101.2.5.3.1 192.168.38.31 CLIM at 101.2.5.3.2 192.168.38.32 CLIM at 101.2.5.3.3 192.168.38.33 CLIM at 101.2.5.3.4 192.168.38.34 CLIM at 101.2.5.4.1 192.168.38.
Component Location Default IP Address IOAM enclosure (ServerNet switch boards) 110.2.14 192.168.36.222 110.3.14 192.168.36.223 111.2.14 192.168.36.224 111.3.14 192.168.36.225 112.2.14 192.168.36.226 112.3.14 192.168.36.227 113.2.14 192.168.36.228 113.3.14 192.168.36.229 114.2.14 192.168.36.230 114.3.14 192.168.36.231 115.2.14 192.168.36.232 115.3.14 192.168.36.233 Rack 01 192.168.36.31 Rack 02 192.168.36.32 Rack 03 192.168.36.33 Rack 04 192.168.36.34 Rack 05 192.168.36.
Component Location Default IP Address Backup system console starting IP address 192.168.32.1 Backup system console ending IP address 192.168.32.254 Backup system console subnet mask 255.255.0.0 TCP/IP processes for OSM Service Connection: $ZTCP0 192.168.36.10 255.255.0.0 subnet mask $ZTCP1 192.168.36.11 255.255.0.0 subnet mask Ethernet Cables Ethernet connections for a dedicated service LAN require Category 5 unshielded twisted-pair (UTP) cables. For supported cables, see Appendix A (page 93).
NOTE: For a fault-tolerant dedicated service LAN, two G4SAs are required, with each G4SA connected to a separate maintenance switch. These G4SA can reside in modules 2 and 3 of the same IOAM enclosure or in module 2 of one IOAM enclosure and module 3 of a second IOAM enclosure. When the G4SA provides connection to the dedicated service LAN, use the slower 10/100 Mbps PIF A rather than one of the high-speed 1000 Mbps Ethernet ports of PIF C or D.
System consoles communicate with NonStop BladeSystems over a dedicated service local area network (LAN) or a secure operations LAN. A dedicated service LAN is required for use of OSM Low-Level Link and Notification Director functionality, which includes configuring primary and backup dial-out points (referred to as the primary and backup system consoles, respectively). HP recommends that you also configure the backup dedicated service LAN with a backup system console.
NOTE: Do not perform the next two bulleted items if your backup system console is shipped with a new NonStop BladeSystem. In this case, HP has already configured these items for you. • • Change the preconfigured DHCP configuration of the backup system console before you add it to the LAN. Change the preconfigured IP address of the backup system console before you add it to the LAN.
A Cables Cable Types, Connectors, Lengths, and Product IDs Available cables and their lengths are: Cable Type Connectors Length (meters) Length (feet) Product ID MMF LC-LC .24 .79 N.A. MMF MTP-LC 2.5 8 M8941-02 10 33 M8941-10 15 49 M8941-15 30 98 M8941-30 50 164 M8941-50 1.
NOTE: ServerNet cluster connections on NonStop BladeSystems follow the ServerNet cluster and cable length rules and restrictions.
B Operations and Management Using OSM Applications OSM client-based components are installed on new system console shipments and also delivered by an OSM installer on the HP NonStop System Console (NSC) Installer DVD image. The NSC DVD image also delivers all other client software required for managing and servicing NonStop servers. For installation instructions, see the NonStop System Console Installer Guide.
If the HP R12000/3 UPS is installed, it is connected to the system’s dedicated service LAN via the maintenance switch where OSM monitors the power state of either AC on or AC off. For OSM to provide AC power fail support, an HP R12000/3 UPS must be installed, connected to the system's dedicated service LAN via the maintenance switch and configured as described in the NonStop BladeSystems Hardware Installation Manual.
AC Power-Fail States These states occur when a power failure occurs and an optional HP model R12000/3 UPS is installed in each cabinet within the system: System State Description NSK_RUNNING NonStop operating system is running normally. RIDE_THRU OSM has detected a power failure and begins timing the outage. AC power returning terminates RIDE_THRU and puts the operating system back into an NSK_RUNNING state.
C Default Startup Characteristics Each NonStop BladeSystem ships with these default startup characteristics: • $SYSTEM disks residing in either SAS disk enclosures or FCDM enclosures: SAS Disk Enclosures — Systems with only two to three Storage CLIMs and two SAS disk enclosures with the disks in these locations: CLIM X1 Location — Path Group Primary 100 Backup Mirror SAS Disk Enclosure Module Slot Enclosure Bay 2 5 1 1 100 2 5 3 3 100 2 5 3 3 Mirror-Backup 100 2 5 2 1 System
— Backup 111 2 1 1 1 1 Mirror 111 2 1 2 1 1 Mirror-Backup 110 2 1 2 1 1 Systems with one IOAM enclosure, two FCDMs, and four FCSAs with the disks in these locations: IOAM — FCSA Fibre Channel Disk Module Path Group Module Slot SAC Shelf Bay Primary 110 2 1 1 1 1 Backup 110 3 1 1 1 1 Mirror 110 3 2 2 1 1 Mirror-Backup 110 2 2 2 1 1 Systems with two IOAM enclosures, two FCDMs, and four FCSAs with the disks in these locations: IOAM FCSA Fibre Channel
Load Path Description Source Disk Destination Processor ServerNet Fabric 11 Backup $SYSTEM-P 1 X 12 Backup $SYSTEM-P 1 Y 13 Mirror $SYSTEM-M 1 X 14 Mirror $SYSTEM-M 1 Y 15 Mirror-Backup $SYSTEM-M 1 X 16 Mirror-Backup $SYSTEM-M 1 Y The command interpreter input file (CIIN) is automatically invoked after the first processor is loaded. The CIIN file shipped with new systems contains the TACL RELOAD * command, which loads the remaining processors.
Index Symbols $SYSTEM disk locations, 99 A AC current calculations, 51 AC Input Module, 37 AC power 208 V AC 3-phase delta 24A RMS, 44 400 V AC 3-phase delta 16A RMS, 44 enclosure input specifications, 45 input, 44 power-fail monitoring, 95 power-fail states, 97 AC power feed, 42, 44 bottom of cabinet, 43 top of cabinet, 43 Administrator passwords, changing, 71 Air conditioning, 33 Air filters, 34 B Blanking panels, 51 Branch circuit, 44 C c7000 enclosure connections between c7000s, 55 features, 18 LEDs,
Electrostatic immunity tested, 51 Emergency power off (EPO) switches HP R12000/3 UPS, 31 NonStop BladeSystems, 31 Empty slots (see Blanking panels) Enclosure combinations, 17 dimensions, 48 height in U, 47 location, 77 maximum number, 77 power loading, 46 weight, 49 Enterprise Storage System (ESS), 22 LUN, 75 Environmental monitoring unit, 20 EPO switches, 31 ERM, 21 Example system 8-processor, 16 Example, IOAM and disk drive enclosure, 63 Extended runtime module (ERM) (see ERM) F Factory-installed hardwar
N Naming conventions, 73 NB50000c BladeSystem characteristics, 15 Noise emissions, 51 NonStop BladeSystem characteristics, 15 components, 17 management tools, 23 overview, 15 phase load balancing, 45 power feed setup, 38 NonStop Multicore Architecture (NSMA) overview, 16 NonStop Server Blade, 25 overview, 19 NSMA (see NonStop multiprocessor architecture) O Onboard Administrator password, 72 Operating system load paths, 99 Operational space, 35 OSM, 90, 95 description of, 24 OSM Certificate Tool, 95 OSM Con
nonoperating temperature, humidity, altitude, 51 operating temperature, humidity, altitude, 50 weight, 49 Startup characteristics, default, 99 Storage CLIM HBA slots, 19 location in cabinet, 78 overview, 19 Storage CLIM, illustration of ports and HBAs, 57 SWAN concentrator restriction, 88 System console configurations, 90 description, 81 location in cabinet, 78 overview, 21 System disk location, 99 T Tape drives, 23 Terminal Emulator File Converter, 95 Terminology, 25 Tools CIP Subsystem, 24 Integrated Lig
