HP BladeSystem c-Class Site Planning Guide Part Number 443250-002 January 2009 (Second Edition)
© Copyright 2007, 2009 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Contents Introduction .................................................................................................................................. 6 About this document .................................................................................................................................. 6 Related documentation............................................................................................................................... 6 General site preparation guidelines ...............
Rack placement and arrangement for proper airflow.......................................................................... 27 Rack tie-down option kit ................................................................................................................. 28 Power requirements and considerations......................................................................................... 29 Power requirements ............................................................................................
Formulas ................................................................................................................................................ 66 Technical support........................................................................................................................ 67 Before you contact HP.............................................................................................................................. 67 HP contact information .......................................
Introduction About this document This document helps facilities and IT staff plan for the receipt and installation of HP BladeSystem c-Class products in a dedicated computer facility. The document is structured as follows: • General site preparation guidelines (on page 7) This section provides an overview of general site requirements to prepare your computer room facility to accept HP BladeSystem hardware.
General site preparation guidelines ASHRAE guidelines for site planning The American Society of Heating, Refrigerating and Air-Conditioning Engineers has published a common set of guidelines for equipment manufacturers and data center designers to standardize on the following issues relating to a data center site: • Operating environments for classes of equipment • Equipment placement for optimum reliability and airflow • Tests of performance and the operational health of the data center • Equipment
data center. HP Services professionals recommend changes to optimize climatic conditions and reclaim capacity, postponing or even eliminating the need for costly mechanical upgrades. Choose from three service levels to meet your specific requirements. • HP Datacenter Site Planning Service—Obtain a comprehensive site-preparation audit to help you successfully integrate new equipment into your facility.
• Ensure that all ceiling tiles are in place. • Ensure a minimum of 457 mm (18 in) or local code minimum clearance, whichever is larger, from the top of the rack to the fire sprinkler heads. Cooling requirements Air conditioning equipment requirements and recommendations are described in the following sections.
• Direct-expansion refrigerant-based unit with remote air-cooled condensers • Direct-expansion refrigerant-based unit with glycol cold condensers An increasing number of in-row cooling solutions as well as water-cooled cabinets are available. Basic air distribution systems A basic air distribution system includes supply air and return air. An air distribution system should be zoned to deliver an adequate amount of supply air to the cooling air intake vents of the racks.
Air conditioning ducts Use separate computer room air conditioning duct work. If it is not separate from the rest of the building, it might be difficult to control cooling and air pressure levels. Duct work seals are important for maintaining a balanced air conditioning system and high static air pressure. Adequate cooling capacity means little if the direction and rate of air flow cannot be controlled because of poor duct sealing.
Floor loading The computer room floor must be able to support the total weight of the installed components as well as the weight of the individual racks as they are moved into position. Floor loading is usually not an issue in nonraised floor installations. The information presented in this section is directed toward raised floor installations. An appropriate floor system consultant should verify any floor system under consideration for installation.
Computer room safety Inside the computer room, fire protection and adequate lighting (for equipment servicing) are important safety considerations. Federal and local safety codes that govern equipment installations.
Lighting requirements for equipment servicing Adequate lighting and utility outlets in a computer room reduce the possibility of accidents and improve efficiency during equipment servicing. The minimum recommended illumination level is 756 lm/m2 (70 foot candles) when the light level is measured at 762 mm (30 in) above the floor. Occupancy-controlled lighting, with manual override switches for use during extended occupancy periods or for servicing, is more efficient and less costly.
Environmental requirements Environmental elements The following environmental elements can affect HP BladeSystem c-Class product installation. Humidity level Maintaining proper humidity levels in the computer room is essential for reliable equipment performance. Humidity levels outside the recommended range of 25 to 45 percent, especially if these levels are sustained, lead to equipment damage and result in equipment malfunction through several mechanisms.
Smaller particles can pass through some filters, and over time, cause problems in mechanical parts. Selection of the appropriate filter media and maintaining the air conditioning system at a high static air pressure level can prevent small dust particles from entering the computer room.
Electrostatic discharge prevention Static charges (voltage levels) occur when objects are separated or rubbed together. The voltage level of a static charge is determined by the following factors: • Types of materials • Relative humidity • Rate of change or separation Follow these precautions to minimize possible ESD-induced failures in the computer room: • Maintain recommended humidity level and airflow rates in the computer room.
Recommended operating environment To help ensure continued safe and reliable equipment operation, install or position the rack in a well ventilated, climate-controlled environment. Air inlet temperature to the rack should be between 20 to 25ºC under normal operating conditions in the data center, per ASHRAE standard TG9 HDEC. The following table shows product technical requirements based on customer environments.
Airflow requirements HP rack-mountable products typically draw in cool air through the front and exhaust warm air out through the rear of the rack. The front door of the rack must be ventilated adequately to enable ambient room air to enter the rack with as little restriction as possible. Likewise, the rear door must offer as little restriction as possible to the warm air escaping from the rack. The free area of a door determines the amount of airflow that can pass through the doors.
• At least 762 mm (30 in) of clearance is needed in the rear of the rack to provide access to components. • At least 380 mm (15 in) of clearance is needed around a power supply to facilitate servicing. For more information, see "Working space for component access (on page 14)". Delivery space requirements There should be enough clearance to move equipment safely from the receiving area to the computer room. Permanent obstructions, such as pillars or narrow doorways, can cause equipment damage.
WARNING: When configuring a solution, make sure that the floor loading specifications are followed. Failure to do so can result in physical injury or damage to the equipment and the facility. 10000 and 10000 G2 Series Rack footprint (600 mm [24 in] wide) 10000 Series Rack footprint (800 mm [31.5 in] wide) Floor plan grid A floor plan grid is used to plan the location of equipment in the computer room.
HP BladeSystem enclosure environmental specifications Specification Value Temperature range* Operating 10°C to 35°C (50°F to 95°F) Non-operating -30°C to 60°C (-22°F to 140°F) Wet bulb temperature Operating 28ºC (82.4ºF) Non-operating 38.7ºC (101.7ºF) Relative humidity (noncondensing)** Operating 20% to 80% Non-operating 5% to 95% * All temperature ratings shown are for sea level. An altitude derating of 1°C per 304.8 m (1.8°F per 1000 ft) to 3048 m (10,000 ft) is applicable.
Footprint for a 600 mm rack configuration with an extension and standard stabilizer kit installed (1001.5 mm wide x 1390.0 mm deep): Footprint for a 600 mm rack configuration with an extension and heavy duty stabilizer kit installed (1001.5 mm wide x 1414.7 mm deep): Front door clearance When racks are bayed together, the design of the front door limits the extent to which the rack door on the right can open.
• 90º access with one door closed • 120º access with both doors open Front door clearance for 10000 Series Racks configured with 24-in baying brackets is: • 102º access with one door closed Environmental requirements 24
• 120º access with both doors open Front door clearance for 10000 G2 Series Racks configured with 600 mm baying brackets is: • 95º access with one door closed • 118º access with both doors open Front door clearance for 10000 G2 Series Racks configured with 24 in baying brackets is: Environmental requirements 25
• 108º access with one door closed • 118º access with both doors open Best practices for deployment in rows Baying kits are used to physically connect adjacent racks to create a row of two or more units. Racks that are bayed together with a baying kit are more stable and reduce the potential tipping of the rack. If racks are secured together with baying kits, the side feet installed on each end of the row of racks are considered optional.
Rack placement and arrangement for proper airflow Racks must be placed and arranged properly in the data center to provide sufficient airflow and clearance for access to the rack. In the front of the rack, a clearance of 1219 mm (48 in) is required. This requirement applies to individual rack installations as well as when aligning rack rows so that the front doors are facing each other. In the rear of the rack, a clearance of 762 mm (30 in) is required to provide space for servicing the rack.
• Rear door: The clearance between the rear of the enclosure and the rear rack door must be a minimum of 175 mm (6.9 in) to accommodate system cabling. • Side: The clearance between the installed rack component and the side panels of the rack must be a minimum of 70 mm (2.75 in). • Width: 483 mm (19 in) • Depth: Maximum clearance between front and rear RETMA rails is 864 mm (34 in). Minimum clearance for round-hole racks is 627 mm (24.7 in). Minimum clearance for square-hole racks is 635 mm (25 in).
Power requirements and considerations Power requirements When planning power distribution requirements, observe the following: • The power load must be balanced between available AC supply branch circuits. • The AC current load attached to a branch circuit must not exceed 80 percent of that branch circuit current rating. • If a UPS system is used, when the peak load reaches 90 percent of the non-redundant UPS system capacity, no new loads can be installed until the UPS system capacity is increased.
Power consumption Power consumption can be divided into two broad categories: • Marked electrical amperage, which is listed on the required safety and regulatory labels, generally represents the maximum current draw that the marked device could achieve. Safety and regulatory labels on computer equipment list the ratings for maximum power consumption conditions.
• Use power sizing tools to calculate the infrastructure required as configured and allow some flexibility for growth. HP provides power sizing tools for all its current industry standard servers. These calculators can be found at the following locations: o For ML and DL products, on the HP website (http://h30099.www3.hp.com/configurator/powercalcs.asp) o For BladeSystem products, on the HP website (http://www.hp.
Power quality Most HP products are designed to operate over a wide range of voltages and frequencies. The products are tested and shown to comply with certain EMC Specifications. However, damage can occur if these ranges are exceeded. Severe electrical disturbances can exceed the design specifications of the equipment.
Connect each PDU to a dedicated (unshared) branch circuit that is rated for the continuous measured load of all the equipment connected to it. The total power load for a PDU should not exceed 80 percent of the branch circuit rating. If a PDU is not used, connect each piece of equipment within the rack to a dedicated branch circuit. For additional information, see the HP website http://www.hp.com/og/powercapping.
• N+N design: N power supplies can be provided where N/2 power supplies are capable of sustaining the associated equipment's power demand. For the c7000 enclosure, this quantity is typically a 2+2 or 3+3 power supply configuration. • N+1 design: Typically four power supplies are provided, requiring at least three to handle the equipment's power demand. If one fails, the other three remain on line with enough capacity to meet the power demand.
Raceway systems (electrical conduits) (LAHJ) Raceways (electrical conduits) form part of the protective ground path for personnel and equipment. Raceways protect the wiring from accidental damage and also provide a heatsink for the wires.
• For UPS products and PDUs that have permanently attached AC power cords or are directly wired to the building power, the total combined leakage current should not exceed 5 percent of the total input current required for the connected products. • For UPS products and PDUs that have detachable AC power cords, the total combined leakage current should not exceed 3.5 mA per PDU or UPS.
measured above 3.0 V might be hazardous to personnel or cause equipment performance issues and must be corrected before placing the equipment in service. Cabinet performance grounding (high frequency ground) Some safety power distribution wires are too long and too inductive to provide adequate high-frequency return paths. Signal interconnects between system cabinets might need high-frequency ground return paths in addition to the safety or power distribution system 50-60Hz grounding system.
• Add a grounding grid made of copper strips mounted to the subfloor. The strips should be 0.8 mm (0.032 in) thick and a minimum of 76 mm (3.0 in) wide. Connect each pedestal to four strips using 6-mm (0.25-in) bolts tightened to the manufacturer’s torque recommendation. Equipment grounding implementation details Connect all HP equipment cabinets to the site ground grid as follows: 1. Attach one end of each ground strap to the applicable cabinet ground lug. 2.
Wiring connections must be properly torqued. Many equipment manufacturers specify the proper connection torque values for their hardware. Ground connections must only be made on a conductive, nonpainted surface. When equipment vibration is present, lock washers must be used on all connections to prevent connection hardware from working loose. Data communications cables Power transformers create high-energy fields in the form of EMI. Heavy foot traffic can create ESD that can damage electronic components.
• HP BladeSystem c3000 Enclosure • HP BladeSystem c3000 Tower Enclosure Power requirements and considerations 40
• HP BladeSystem c7000 Enclosure To cable the enclosure using a single-phase AC configuration: 1. Connect the AC power cables to the power connectors on the rear of the enclosure corresponding to the power supply that was populated on the front of the enclosure. 2. Connect the AC power cables to the AC power source or to an installed PDU. 3. Locate the power retention bracket that came with the enclosure. 4. Verify that the power cord retention tabs are on the correct side.
7. Slide the power cord retention bracket until the bracket touches the enclosure. 8. Insert the power cord retention tabs into the slots on the enclosure until they snap into place. 9. Slide each snap clamp over the end of each power cord overmold, and then squeeze each snap clamp closed. 10. Set the AC circuit breakers for the enclosure to On.
PDU installation The PDU can be installed in either a 1U or a 0U configuration. For specific details on installing the PDU in the rack, see the installation instructions that came with the PDU For technical specifications on HP Modular and Monitored PDUs, see the HP website (http://h71028.www7.hp.com/ERC/downloads/4AA0-0689ENW.pdf). IMPORTANT: The three-phase c7000 enclosure cannot be connected to rack-based singlephase PDUs.
Enclosure/switch Power supply PDU Load segment Port 2 = uppermost 1 = bottommost Switch A Single Right extension bar — Top - 1 Enclosure C PS6 Left L1B 1 Enclosure C PS5 Left L3B 1 Enclosure C PS4 Left L3A 2 Enclosure C PS3 Right L2A 2 Enclosure C PS2 Right L1A 2 Enclosure C PS1 Right L3A 2 Enclosure B PS6 Left L1B 1 Enclosure B PS5 Left L3B 1 Enclosure B PS4 Left L2B 1 Enclosure B PS3 Right L1B 1 Enclosure B PS2 Right L3B 1 Enclosure B PS1
• N+N redundant, 5kVA enclosure configuration with 24A single-phase PDU HP BladeSystem c7000 Enclosure three-phase AC configuration To cable the enclosure using a three-phase AC configuration: 1. The AC power cables are already attached to the enclosure. 2. Connect the AC power cables to the AC power source. 3. Turn on the AC circuit breakers that power the power cables installed in the enclosure.
When first initialized, the Onboard Administrator programs the mezzanine cards on the server blades during discovery. After the mezzanine cards are programmed, powering up the enclosure takes only 1 to 2 minutes. The enclosure and the Insight Display now have power. Configure the enclosure using the Insight Display.
HP BladeSystem c3000 Enclosure DC configuation HP BladeSystem c3000 Enclosure HP BladeSystem c3000 Tower Enclosure Power supply specifications Single-phase HP 2250W Power Supply specification Specification Value Power cord IEC-320 C19-C20 1.
Specification Value Rated input voltage 100 VAC to 124 VAC 200 VAC to 240 VAC Rated input frequency 50 Hz to 60 Hz Rated input current per power supply (maximum) 11.7 A at 100 VAC 10.6 A at 110 VAC 10.1 A at 115 VAC 9.7 A at 120 VAC 13.1 A at 200 VAC 12.6 A at 208 VAC 11.
Specification Value Rated input voltage 200 VAC to 220 VAC line-to-line 3-phase Delta Rated input frequency 50 Hz to 60 Hz Rated input power per power cord (maximum) 7836VA Three-phase HP 2400W High Efficiency Power Supply specification (North America/Japan) Specification Value Power cords (2) NEMA L15-30p 2.44 m (10 ft) Max input current per line cord 24.0A at 200 VAC 23.
Three-phase HP 2400W Power Supply specification (International) Specification Value Power cords (2) IEC-309 200/346-V to 240/415-V, 5-pin, 16-A 2.44 m (10 ft) Max input current per line cord 12.6 A at 220 VAC 11.
Hardware specifications and requirements Enclosure specifications The HP ProLiant c-Class enclosure specifications are provided for site planning purposes. For the latest specfications, see the HP website (http://www.hp.com/go/bladesystem/documentation). HP BladeSystem c7000 Enclosure specifications Specification Value Product dimensions Height 442.0 mm (17.4 in) Depth 813.0 mm (32.0 in) Width 447.0 mm (17.6 in) Shipping dimensions Height 759.00 mm (29.88 in) Depth 1013.00 mm (39.
Specification Value Height 584.00 mm (23.00 in) Depth 1013.00 mm (39.88 in) Width 607.00 mm (23.88 in) Standard enclosure weight * Unboxed 65.80 kg (145.00 lb) Shipping 88.50 kg (195.00 lb) Maximum enclosure weight Unboxed 136.00 kg (300.00 lb) Shipping 158.80 kg (350.00 lb) * Includes two power supplies, four fans, and one Onboard Administrator. HP 10000 G2 rack specifications For a current list of all rack specifications, see the Best Practices document on the HP website (http://www.hp.
• Front door: The clearance from face of rack to inside of the front door must be a minimum of 77 mm (3 in). • Rear door: The clearance between the rear of the enclosure and the rear rack door must be a minimum of 175 mm (6.9 in) to accommodate system cabling. • Side: The clearance between the installed rack component and the side panels of the rack must be a minimum of 70 mm (2.75 in). • Width: 483 mm (19 in) • Depth: Maximum clearance between front and rear RETMA rails is 864 mm (34 in).
Configuration scenarios Example configurations The following configuration examples were calculated using the HP Blade Power Sizer Tool. This tool is designed for facilities planning purposes only. Values obtained from the tool are based on worst case loads. Whenever possible, actual measurements are recommended. Measurements should be made with the intended configuration, application loading, and ambient environment.
• HP ProLiant BL465c Server Blades (16) o 2.
Power credentials Idle 100% utilization Circuit sizing Total airflow (CMM) 7.652 10.203 15.019 Estimating power and cooling Power consumed by a c-Class BladeSystem solution is converted to heat, which is expressed in British thermal units per hour (BTU/h). You can calculate the heat load for a system by using the following equation: Heat Load = Power (Watts) x 3.413 BTU/h. In the preceding equation, 1 W equals 3.413 BTU/h.
Component Quantity Watts BTUs Total c7000 enclosure (configured) Other rack options Option A Option B Total power Estimating total weight You might need to determine the total weight of custom configurations if any of the following considerations apply: • Variations in flooring support when moving the solution during installation • Trucking equipment limits • Raised floor installation (calculating load limits and reinforcement) • Secondary or tertiary floor installation Determine the weight a
Preparing for installation Warning, caution, and important messages WARNING: To reduce the risk of personal injury or damage to equipment, heed all warnings and cautions throughout the installation instructions. WARNING: To reduce the risk of personal injury or damage to the equipment, be sure that: • The leveling jacks are extended to the floor. • The full weight of the rack rests on the leveling jacks. • The stabilizing feet are attached to the rack if it is a single-rack installation.
WARNING: Before installing an enclosure in the rack, be sure that all hot-plug power supplies, server blades, and interconnects are removed from the enclosure. Blanks can be left in the enclosure. WARNING: Be sure to install enclosures starting from the bottom of the rack and work your way up the rack. These symbols, on power supplies or systems, indicate that the equipment is supplied by multiple sources of power.
Additional rack considerations Consider the following additional specifications and components, with regard to your specific rack configuration: • Power—If a UPS is installed, do not exceed its output rating. Be sure to review the installation instructions provided with each component for important cautions and warnings. • PDUs—Install PDUs before installing other components. • Height—The height of the rack and of rack-mountable components is measured in U increments, where U = 4.5 cm (1.75 in).
WARNING: To reduce the risk of personal injury or damage to the equipment, always load the heaviest item first from the bottom of the rack up. This makes the rack bottom-heavy and helps prevent the rack from becoming unstable. Refer to Configuration Factors. WARNING: To reduce the risk of personal injury or damage to the equipment, be sure that: • The leveling feet are extended to the floor. • The full weight of the rack rests on the leveling feet.
Sample installation schedule The following schedule lists the sequence of events for a typical system installation. For situations that prevent following this type of schedule, consider using a milestone schedule.
1. Is there a completed floor plan? 2. Is there adequate space for maintenance needs? Minimum recommended clearances, front and rear: 914 mm (36 in). 3. Is access to the site or computer room restricted? 4. Is the computer room structurally complete? 5. Is a raised floor installed and in good condition? 6. Is the raised floor adequate for equipment loading? 7. Are there channels or cutouts for cable routing? 8. Is there a remote console telephone line available with an RJ-11 jack? 9.
28. Can cooling be maintained between 20ºC and 55ºC (up to 5000 ft)? Derate 1º C/1000 ft above 5000 ft and up to 10,000 ft. 29. Can temperature changes be held to 10ºC/h with tape media? Can temperature changes be held to 20ºC/h without tape media? 30. Can humidity levels be maintained at 40% to 60% at 35ºC noncondensing? 31. Are air conditioning filters installed and clean? Storage 32. Are cabinets available for tape and disc media? 33. Is shelving available for documentation? Training 34.
Elevator Capacity (kg or lb): Depth: Height: Width: Stairs Number of flights: Width: Preparing for installation 65
Conversion factors and formulas Conversion factors The conversion factors provided here are intended to help in data calculation for systems that do not conform to the specific configurations listed in this guide. Listed below are the conversion factors used in this document, as well as additional conversion factors that can be helpful in determining those factors required for site planning. • • Refrigeration o 1 watt = 0.86 kcal/h o 1 watt = 3.412 BTU/h o 1 watt = 2.
Technical support Before you contact HP Be sure to have the following information available before you call HP: • Technical support registration number (if applicable) • Product serial number • Product model name and number • Product identification number • Applicable error messages • Add-on boards or hardware • Third-party hardware or software • Operating system type and revision level HP contact information For the name of the nearest HP authorized reseller: • See the Contact HP worldwi
Acronyms and abbreviations ASHRAE American Society of Heating, Refrigerating and Air-Conditioning Engineers CPRA ceiling plenum return air DRA ducted return air EMI electromagnetic interference EMT electrical metallic tubing ESD electrostatic discharge LAHJ local authority has jurisdiction PDU power distribution unit RFI radio frequency interference RMS root-mean-square SRG signal reference grid TMRA recommended ambient operating temperature Acronyms and abbreviations 68
UPS uninterruptible power system Acronyms and abbreviations 69
Glossary apparent power A value of power for AC circuits that is calculated as the product of RMS current times RMS voltage, without taking the power factor into account. ASHRAE Standard 52-76 Industry standard for air filtration efficiency set forth by the American Society of Heating, Refrigerating, and Air-Conditioning Engineers, Inc. average floor load The load computed by dividing total equipment weight by the area of its footprint. This value is expressed in kg/m2 (lb/ft2).
KVA The abbreviation for kilovolt-amperes. (1000 x 1 volt-amperes). live load The load that the floor system can safely support. Expressed in kg/m2 (lb/ft2). maximum input current The operating current of the product equal to the maximum load divided by the minimum input voltage. RMS Root-mean-square (RMS) refers to the most common mathematical method of defining the effective voltage current of an AC wave.
Index A AC power configurations 39 acoustic noise specification 17 air conditioning ducts 11 air conditioning equipment requirements, basic 9 air conditioning system guidelines 9 air conditioning system specifications 10 air conditioning system types 9 air distribution systems, basic 10 airflow requirements 19, 58 ASHRAE guidelines 7 authorized reseller 67 average floor loading 12 B blanking panels 19 building distribution 35 C cabinet performance grounding 37 cables 39 cabling requirements 11 cautions 58
L requirements, space 58 line voltage 34 S M safety considerations 58 safety, computer room 13 single-phase AC configuration 39 site planning assistance from HP 7 site planning considerations 8, 62 space requirements 19 space requirements, delivery 20 space requirements, operational 20 specifications 47, 50, 51 support 67 main building electrcial ground 36 maintenance precautions 13 metallic particular contamination 16 N non-redundant power 34 O Onboard Administrator 45 operating environment, recomm