Sun Netra™ CP3220 Blade Server User’s Guide Sun Microsystems, Inc. www.sun.com Part No. 820-1982-12 January 2010, Revision 01 Submit comments about this document at: http://www.sun.
Copyright © 2010 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. This distribution may include materials developed by third parties. Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in the U.S. and in other countries, exclusively licensed through X/Open Company, Ltd.
Contents Preface 1. xv Introduction 1–1 1.1 Overview 1.2 Features 1.3 Physical Description 1.4 1–2 1–2 1.3.1 Front Panel Components 1.3.2 Blade Server Diagram 1–3 1–6 System Configurations 1–7 1.4.1 AMC Modules 1–7 1.4.2 Advanced Rear Transition Module 1.5 Hot-Swap Support 1.6 System Components 1.7 1–3 1–8 1–12 1–12 1.6.1 Required Hardware Components 1–12 1.6.2 Optional Hardware Components 1–13 1.6.3 Software Components Technical Support and Warranty 1.7.
2. Hardware Installation and Service 2.1 2.2 Safety and Tool Requirements Equipment and Operator Safety 2.1.2 Materials and Tools Required Installing the Blade Server 2.2.2 2.2.3 2–3 2–3 2.2.1.1 Check Power, Thermal, Environmental, and Space Requirements 2–4 2.2.1.2 Local Network IP Addresses and Host Names Worksheet 2–5 2.2.1.3 Installation Procedure Summary Configuring the Hardware 2–6 2–6 2.2.2.1 Verify Chassis Fan Tray Upgrade 2–7 2.2.2.2 Installing Optional Components 2–7 2.
2.3.4 Powering On the System 2.3.5 Automatic Power-Off Events 2.3.6 Servicing DIMMs 2–18 2–19 2.3.6.1 DIMM Requirements 2–19 2.3.6.2 Installing a DDR2 DIMM 2.3.6.3 Removing a DDR2 DIMM 2–21 2–22 2.3.7 Installing the Optional Compact Flash Card 2.3.8 Installing Optional AMC Cards 2.3.9 Adding or Replacing a TOD Clock Battery 2.3.10 Changing Jumper Settings 2.3.11 2–24 2–26 2–29 2–29 2.3.10.1 Clearing the CMOS Setting Using Jumper 1 2.3.10.
4. Configuring and Using BIOS Firmware 4.1 About BIOS Settings 5. vi 4–2 4.1.1 Navigating BIOS Screens 4.1.2 BIOS Considerations 4.1.3 4–1 4–2 4–2 4.1.2.1 BIOS Option ROMs on the Sun Netra CP3220 Blade Server 4–2 4.1.2.2 AMD PowerNow! Feature Enabled by Default Description of the BIOS Screens 4–3 4.2 Changing the Configuration of a BIOS Menu Item 4–4 4.3 Setting the Boot Device Using BIOS Setup Screens 4–5 4.4 Changing the BIOS Continuous Boot Setting 4.
5.5 5.4.5 Broadcom 5715C Gigabit Ethernet 5.4.6 Sun Dual 10-Gbit Ethernet/Quad 1-Gbit RGMII Network Interface Chip (Sun 10 GbE Multithreaded Networking ASIC) 5–7 I/O Components 5–7 5.5.1 AMC Slots 5.5.2 EIDE/ATA for Compact Flash 5.5.3 SAS/SATA A. Physical Characteristics 5–7 A–1 Form Factor A.2 Power and Thermal Metrics A–2 A–2 A.2.1 Processor Metrics A.2.2 PICMG Board Cooling Requirements A.2.3 PICMG ARTM Cooling Requirements Connectors and Pinouts A.3.
viii Sun Netra CP3220 Blade Server User’s Guide • January 2010
Figures FIGURE 1-1 Sun Netra CP3220 Dual-Core Blade Server (Front View) 1–4 FIGURE 1-2 Sun Netra CP3220 Quad-Core Blade Server (Front View) 1–5 FIGURE 1-3 Sun Netra CP3220 Blade Server (Component Side View) 1–6 FIGURE 1-4 Sun Netra CP3220 Blade Server in Shelf Enclosure FIGURE 1-5 Sun Netra CP32x0 SAS Storage Advanced Rear Transition Module, Dual HD FIGURE 1-6 Sun Netra CP3220 Blade Server, Backplane, and Relationship to ARTM FIGURE 1-7 Sun Netra CP3220 Blade Server Barcode Labeling FIGURE
FIGURE 4-1 BIOS Main Menu FIGURE 4-2 Boot Settings Menu FIGURE 4-3 Boot Device Priority Menu FIGURE 4-4 Security Settings Menu FIGURE 4-5 Change Password Menu FIGURE 5-1 Block Diagram FIGURE 5-2 AMD Opteron Processors Block Diagram FIGURE A-1 Ethernet RJ-45 Connector FIGURE A-2 Front Panel USB Connector FIGURE A-3 Front Panel Serial RJ-45 Connector FIGURE A-4 Power Distribution Connector (Zone 1) P10 FIGURE A-5 Zone 2 Connector A–9 FIGURE A-6 Zone 3 Connector A–11 FIGURE B-1 BIO
FIGURE B-18 Boot Device Priority Menu B–11 FIGURE B-19 Boot Hard Disk Drive Priority Menu FIGURE B-20 Security Settings Menu FIGURE B-21 Change Password Settings Menu FIGURE B-22 Chipset Main Menu FIGURE B-23 NorthBridge Chipset Configuration Menu FIGURE B-24 NorthBridge Chipset Memory Configuration Menu FIGURE B-25 NorthBridge Chipset ECC Configuration Menu FIGURE B-26 NorthBridge Chipset DRAM Configuration Menu FIGURE B-27 SouthBridge Chipset Configuration Menu FIGURE B-28 Hyper Tran
xii Sun Netra CP3220 Blade Server User’s Guide • January 2010
Tables TABLE 1-1 I/O Configurations 1–11 TABLE 2-1 Local Area Network Information TABLE 2-2 Netinstall Boot Device Table TABLE 2-3 Extra MAC Addresses for Virtual LAN Configuration TABLE 2-4 Pin Functions on Jumper 1 TABLE 4-1 BIOS Setup Screens Summary TABLE 4-2 POST Options 4–15 TABLE A-1 Airflow Requirements A–3 TABLE A-2 ARTM Pressure Drop A–3 TABLE A-3 Ethernet Port Connector Pin Assignments TABLE A-4 USB Port Pin Assignments TABLE A-5 Serial Port Mini DIN 8-pin Connector Pin
xiv Sun Netra CP3220 Blade Server User’s Guide • January 2010
Preface The Sun Netra CP3220 Blade Server User’s Guide describes the hardware specifications, function, and physical properties of the Sun Netra™ CP3220 blade server. It also provides detailed information on the system firmware. The Sun Netra CP3220 Blade Server User’s Guide is written for system integration engineers, field applications and service engineers, and others involved in the integration of this blade server into systems.
Using UNIX Commands This document might not contain information about basic UNIX® commands and procedures such as shutting down the system, booting the system, and configuring devices. Refer to the following for this information: ■ Software documentation that you received with your system ■ Solaris™ Operating System documentation, which is at: http://docs.sun.
Typographic Conventions Typeface* Meaning Examples AaBbCc123 The names of commands, files, and directories; on-screen computer output Edit your.login file. Use ls -a to list all files. % You have mail. AaBbCc123 What you type, when contrasted with on-screen computer output % su Password: AaBbCc123 Book titles, new words or terms, words to be emphasized. Replace command-line variables with real names or values. Read Chapter 6 in the User’s Guide. These are called class options.
Documentation, Support, and Training Sun Function URL Documentation http://docs.sun.com/documentation Support http://www.sun.com/support/ Training http://www.sun.com/training/ Third-Party Web Sites Sun is not responsible for the availability of third-party web sites mentioned in this document. Sun does not endorse and is not responsible or liable for any content, advertising, products, or other materials that are available on or through such sites or resources.
CHAPTER 1 Introduction This chapter provides an overview of the features, configurations, and system requirements of the Sun Netra CP3220 blade server. This chapter contains the following topics: ■ Section 1.1, “Overview” on page 1-2 ■ Section 1.2, “Features” on page 1-2 ■ Section 1.3, “Physical Description” on page 1-3 ■ Section 1.4, “System Configurations” on page 1-7 ■ Section 1.5, “Hot-Swap Support” on page 1-12 ■ Section 1.6, “System Components” on page 1-12 ■ Section 1.
1.1 Overview The Sun Netra CP3220 blade server is a high-performance, single-board computer based on an AMD Opteron X64 processor. The blade server is designed for high availability in a switched network computing environment. This blade server is compliant with Advanced Telecommunications Computing Architecture (ATCA) specifications (PICMG 3.0 and PICMG 3.1). It can achieve greater performance levels than previously supported CompactPCI® (cPCI) standards-based products targeted for Telco markets.
■ E-IDE master to support one Compact Flash socket supporting up to 16-Gbyte user flash (accessible when blade is removed from chassis) ■ Management support using on-board IPM controller (Renesas H8) that provides a dual IPMB bus and IPMI redundant channels ■ Rear I/O expansion provided to an optional RTM, compatible with AdvancedRTM shared architecture RTMs ■ SAS/SATA connectivity from RTM to each AMC slot (local MCP-55 SATA ports are not used) ■ Supports AdvancedRTM Shared Architecture Zone 3 con
FIGURE 1-1 Sun Netra CP3220 Dual-Core Blade Server (Front View) RESET Figure Legend 1-4 1 Locking screws 6 Reset button 2 Latches 7 10/100/1000 Ethernet management port 3 Out-of-service (OOS) LED 8 Serial port 4 OK LED 9 USB ports 5 AMC card slots Sun Netra CP3220 Blade Server User’s Guide • January 2010
FIGURE 1-2 Sun Netra CP3220 Quad-Core Blade Server (Front View) Figure Legend 1 Locking screws 6 Reset button 2 Latches 7 10/100/1000 Ethernet management port 3 Out-of-service (OOS) LED 8 Serial port 4 OK LED 9 USB ports 5 AMC card slots Chapter 1 Introduction 1-5
1.3.
1.4 System Configurations Sun Netra CP3220 blade servers can be installed into an ATCA shelf (chassis), as shown in FIGURE 1-4. The blade servers can be deployed in various electrical configurations to suit user requirements. For example, the blade server can be configured to boot from a network as a diskless client with either a front panel or advanced rear transition module (ARTM) network connection.
1.4.2 Advanced Rear Transition Module You can install an optional Sun Netra CP32x0 Advanced Rear Transition Module (ARTM) (FIGURE 1-5) into the rear of the ATCA shelf, opposite the Sun Netra CP3220 blade server (FIGURE 1-6).
Figure Legend 1 Serial port 2 10/100/1000 MBASE-T management port 3 External SAS port (secondary) 4 External SAS port (primary) 5 Hard disk drives 6 RTM Alignment pin 7 Zone 3 connectors 8 OK LED 9 Out-of-service (OOS) LED 10 Blue Hot Swap LED Note – Use only serial cables that are less than 10 meters in length. FIGURE 1-6 shows the physical relationship between the Sun Netra CP3220 blade server, the ARTM, and the backplane in a typical ATCA system.
FIGURE 1-6 Sun Netra CP3220 Blade Server, Backplane, and Relationship to ARTM Sun Netra CP32x0 ARTM (installed from the rear) Sun Netra CP3220 blade server (installed from the front) ATCA backplane Note – When using the Sun Netra CP32x0 ARTM with the Sun Netra CP3220 blade server, use shielded cables of less than 10 meters in length for serial I/O ports. Caution – You must use shielded cables for all ports to satisfy EMI compliance standards.
10/100/1000BASE-T per second Ethernet RJ-45 port from the host to the rear of the system. This port can be used to accomplish, optionally, a network boot as a diskless client. The other configurations require IHV hardware.
1.5 Hot-Swap Support In general, the hot-swap process includes the orderly connection of the hardware and software. The process uses hardware connection control to connect the hardware in an orderly sequence. The process includes the use of pins of different lengths to accomplish signal sequencing to protect the hardware and avoid corrupting the system interface. For further details on hot-swap standards, see the ATCA hot-swap specification.
Caution – You can damage the Sun Netra CP3220 blade server components if you install the blade server in a chassis that does not provide sufficient cooling. For more information, see Section 2.2.1.1, “Check Power, Thermal, Environmental, and Space Requirements” on page 2-4. Note – Use only shielded serial cables that are less than 10 meters in length. 1.6.
1.7 Technical Support and Warranty Should you have any technical questions or support issues that are not addressed in the Sun Netra CP3220 blade server documentation set or on the technical support web site, contact your local Sun Services representative. This hardware carries a one-year return-to-depot warranty. For customers in the U.S. or Canada, please call 1-800-USA-4SUN (1-800-872-4786).
FIGURE 1-7 Sun Netra CP3220 Blade Server Barcode Labeling Part number label Serial number label Chapter 1 Introduction 1-15
1-16 Sun Netra CP3220 Blade Server User’s Guide • January 2010
CHAPTER 2 Hardware Installation and Service This chapter describes the Sun Netra CP3220 blade server hardware installation and service procedures. This chapter contains the following topics: ■ Section 2.1, “Safety and Tool Requirements” on page 2-2 ■ Section 2.2, “Installing the Blade Server” on page 2-3 ■ Section 2.
2.1 Safety and Tool Requirements 2.1.1 Equipment and Operator Safety Refer to the Important Safety Information for Sun Hardware Systems (816-7190) for general safety information. Read the following safety statements that are specific to the Sun Netra CP3220 blade server carefully before you install or remove any part of the system.
The grounded mat or the chassis must be connected to a facility ground to prevent a floating ground. 2.1.2 ■ Keep blade servers in the antistatic bags until they are needed. ■ Remove a blade server from its antistatic bag only when wearing a properly connected ground strap. ■ Place blade servers that are out of their antistatic bags on an antistatic mat if one is available and the mat is grounded to a facility electrical service ground.
4. Verify that local area network (LAN) preparations are completed (see Section 2.2.1.2, “Local Network IP Addresses and Host Names Worksheet” on page 2-5). 5. Ensure that the host names and their network IP addresses are allocated and registered at the site. Record this information in TABLE 2-1. 2.2.1.
2.2.1.2 Local Network IP Addresses and Host Names Worksheet Collect the information listed in TABLE 2-1 to connect hosts to the LAN. Ask your network administrator for help, if necessary. This information is not needed for a stand-alone installation.
2.2.1.3 Installation Procedure Summary This section summarizes the high-level procedures that are required to install the Sun Netra CP3220 blade server. Ensure that you are familiar with the information in Section 2.2.2, “Configuring the Hardware” on page 2-6 through the end of Chapter 2 before installing the blade server. The process to set up and configure a Sun Netra CP3220 blade server in a system includes the following procedures: 1. Configure the blade server’s physical hardware.
2.2.2.1 Verify Chassis Fan Tray Upgrade Caution – The Sun Netra CT 900 server fan tray upgrade kit (594-4953) must be installed in the chassis before the Sun Netra CP3220 blade server is installed. This fan tray upgrade is required to provide adequate cooling and prevent the system from overheating or shutting down due to an over temperature condition that can occur with the older fan trays.
2.2.2.3 Configuring the Advanced Rear Transition Module Hardware If you are using a Sun Netra CP32x0 Advanced Rear Transition Module (ARTM), refer to the appropriate documentation. See Section , “Related Documentation” on page -xvii. You can also see Section A.3, “Connectors and Pinouts” on page A-4 for detailed connector pin assignments for the Sun Netra CP3220 blade server. 2.2.
FIGURE 2-1 Installing the Sun Netra CP32x0 ARTM Chapter 2 Hardware Installation and Service 2-9
▼ To Install an ARTM 1. Verify that you have taken the necessary antistatic precautions. See Section 2.1.1, “Equipment and Operator Safety” on page 2-2. 2. From the rear of the system, choose an appropriate slot for the ARTM. The ARTM must be installed, inline, behind a compatible Sun Netra blade server (Sun Netra CP3220 blade server or Sun Netra CP3260 blade server).
FIGURE 2-2 Injector/Ejector Latch and Locking Screw on the ARTM 6. Carefully align the edges of the ARTM with the card guides in the appropriate slot. Look into the enclosure to verify correct alignment of the rails in the guides. 7. Keep the ARTM aligned in the guides, and slide the ARTM in until the injector/ejector latches engage the card cage. 8. Push the ARTM into the backplane connectors, and close the latch. 9. Tighten the locking screws to ensure that the module is secured into the ATCA shelf.
10. Install the Sun Netra CP3220 blade server into the front of the ATCA shelf in the corresponding slot. See Section 2.2.3.2, “Installing the Blade Server Into the Shelf” on page 2-12 for instructions. 2.2.3.2 Installing the Blade Server Into the Shelf Note – You can install the Sun Netra CP3220 blade server in any available slot in the ATCA shelf except for slots 7 and 8. 1. If you have installed an ARTM, go to the front of the system and locate the same slot number where you installed the ARTM. 2.
2.2.4 Connecting External I/O Cables Front panel ports are typically used for maintenance and troubleshooting purposes in installed and running systems. External I/O cables are connected to the Sun Netra CP3220 blade server or to the Sun Netra CP32x0 ARTM. To connect each of these following cables: ■ For Ethernet connections, Category 5e or better network cable is required.
FIGURE 2-3 Serial Port on the Sun Netra CP3220 Blade Server RESET Serial port 3.
■ A telnet utility (Connect to the proper port on a Network Terminal Server to which the Sun Netra CP3220 is connected.) ■ Another suitable serial communications program on the system console For example, if you are using a UNIX system as the system console, at the UNIX prompt in a command tool or shell tool, or serial port A, type: # tip -9600 /dev/ttya 2.2.4.2 Connecting Cables to the System Console Not Running the Solaris OS 1.
Netinstall Boot Device Table (Continued) TABLE 2-2 MAC Address Solaris Device Hardware Device 0:3:ba.xx.xx.xn+5 nxge1 (Sun 10 GbE Multithreaded Networking ASIC 10 GB) Extended Fabric 1 0:3:ba.xx.xx.xn+6 nxge2 (Sun 10 GbE Multithreaded Networking ASIC 1 GB) AMC and RTM 0:3:ba.xx.xx.xn+7 nxge3 (Sun 10 GbE Multithreaded Networking ASIC 1 GB) AMC and RTM Connects to...
2.3 Service Procedures 2.3.1 Hot-Swapping the Sun Netra CP3220 Blade Server You can remove the Sun Netra CP3220 blade server without powering off the entire chassis by performing these steps. 1. Power off the blade server. See Section 2.3.2, “Powering Off the Sun Netra CP3220 Blade Server” on page 2-17. 2. Remove the blade server. See Section 2.3.3, “Removing the Sun Netra CP3220 Blade Server” on page 2-18. 2.3.2 Powering Off the Sun Netra CP3220 Blade Server 1. Shut down the operating system.
2.3.3 Removing the Sun Netra CP3220 Blade Server 1. Power off the Sun Netra CP3220 blade server. Use the instructions in Section 2.3.2, “Powering Off the Sun Netra CP3220 Blade Server” on page 2-17. 2. If installed, remove all cables from the front of the Sun Netra CP3220 blade server. 3. Loosen the locking screws to release the blade server from the ATCA shelf. 4.
2.3.6 Servicing DIMMs 2.3.6.1 DIMM Requirements The Sun Netra CP3220 blade server supports a total of eight DIMMs and the maximum memory capacity of 32 Gbytes (using four 4-Gbyte DIMMs).
FIGURE 2-4 Locating DIMM Slots B A B A Pair 0 B A B A Pair 2 Pair 1 Pair 3 Populate DIMMs in matching pairs, starting with Pair 0, then adding Pair 1, Pair 2, and Pair 3 as needed.
2.3.6.2 Installing a DDR2 DIMM The following procedure provides a general guide for installing additional memory. However, for specific directions on installing DIMMs on the Sun Netra CP3220 blade server, refer to the documentation that shipped with the DIMMs. 1. Access the blade server by performing one of the following procedures: ■ If the Sun Netra CP3220 blade server is installed in an ATCA shelf, remove the blade server from the shelf as explained in Section 2.3.
FIGURE 2-5 Installing a DIMM 6. Press the top edge of the DIMM toward the blade server until the retainer clips click into place in the notches on the DIMM sides (FIGURE 2-5). The small metal retainer clips on each side of the DIMM slot are spring-loaded, and they should click into place in the notches on the sides of the DIMM. 2.3.6.
If an ESD mat is not available, you can place the blade server on the antistatic envelope in which it was packaged. Caution – Do not place blade servers on top of an antistatic bag unless the outside of the bag also has antistatic protective properties. 2. Take antistatic precautions: Attach and electrically ground the wrist strap. Caution – Always wear a grounded antistatic wrist strap when handling DIMMs. 3.
2.3.7 Installing the Optional Compact Flash Card An IDE Compact Flash card can be installed on the Sun Netra CP3220 blade server. The Compact Flash card is not hot-swappable, and there is no access to the Compact Flash card once the Sun Netra CP3220 is installed in an ATCA shelf. 1. Access the blade server by performing one of the following procedures: ■ If the Sun Netra CP3220 blade server is installed in an ATCA shelf, remove the blade server from the shelf as explained in Section 2.3.
FIGURE 2-7 Compact Flash Location Note – Sun Compact Flash cards have a life time of 2,000,000 write/erase cycles. Users are responsible for ensuring that the operating system and applications do not exceed this limitation.
2.3.8 Installing Optional AMC Cards An Advanced Mezzanine card (AMC) is a card or module that provides additional functionality to the Sun Netra CP3220 blade server. The blade server contains two AMC slots in which you can install an optional AMC device. An AMC device can be installed and removed via a cutout in the front panel while the Sun Netra CP3220 blade server is installed in the chassis.
FIGURE 2-8 Removing an AMC Filler Panel 4. Retrieve the AMC module from its shipping kit and place it on an antistatic surface. 5. Insert the AMC module through the cutout and into the AMC slot FIGURE 2-9.
FIGURE 2-9 Installing an AMC Card Caution – Do not use excessive force when installing the AMC module into the slot. You might damage the AMC connector on the Sun Netra CP3220 blade server, causing permanent damage to the AMC module or the blade server. If the AMC module does not seat properly when you apply even pressure, remove the AMC module and carefully reinstall it. 6. Carefully insert the AMC card into the AMC slot, ensuring that the edge of the card is installed into the card guides on both edges.
7. Press on the front face of the AMC card until the card is fully seated into the AMC connector. 8. Press the black ejector in, toward the AMC card, to activate the card. 9. Refer to the AMC module documentation for software and cabling installation instructions. 2.3.9 Adding or Replacing a TOD Clock Battery The optional TOD battery must be type CR1632, with a minimum of 4ma abnormal charging current rating (for example; a Renata CR1632).
FIGURE 2-10 Jumper 1 in the Run Position AMC slot B1 Jumper 1 Pin 1 Pin 2 Pin 3 TABLE 2-4 provides information on the pin functions on jumper 1.
To reset the jumper and return the CMOS settings to the default settings, perform the following steps: 1. Remove the jumper housing from the run position (P1/P2) and move it to the reset position (P2/P3). FIGURE 2-11 Jumper 1 in the Reset Position AMC slot B1 Jumper 1 Zone 3 Zone 3 connectors Pin 1 Pin 2 Pin 3 2. Wait at least one second for the CMOS settings to reset and then move the jumper housing back to the run position. 3. Reinstall the blade server. Use the procedure in Section 2.2.3.
2.3.10.2 Changing the OOS LED Color The color of the Out-of-service (OOS) LED can be set to red or amber by moving jumper 2 to the appropriate position. Amber is the default color for the OOS LED. To change the Jumper 2 position to red: 1. Remove the jumper housing from the default (amber) position (P2/P3) and move it to the red position (P1/P2). FIGURE 2-12 Jumper 2 in the Red Position AMC slot B1 Pin 1 Pin 2 Pin 3 Zone 3 Zone 3 connectors Jumper 2 2. Reinstall the blade server.
Users can change the default behavior of the out-of-service (OOS) LED through the IPMC by using an LED1 control bit. This bit is available only on the Sun Netra CP3220 blade server. You can use the set and get IPMC control byte IPMI commands, which are the same commands used to control the Green OK LED, to change the default OOS LED behavior to the following: ■ IPMC will not light up OOS LED on POST or any other failure.
▼ Viewing OOS LED Settings ● At the clia CLI, enter the Get IPMI Control Bits command.
▼ Setting OOS LED Behavior Note – You must always perform a read, modify, and write to change any of the bits in the control byte. ● At the clia CLI, enter the Set IPMI Control Bits command. Command NetFn Opcode Set IPMI Control Bits 0x2E 0xE9 Data Bytes Type Byte Data Field Request Data 1 00 2 00 3 2A 4 Control byte: Bit 0 = LED 2 (Green LED) control bit. • 1 = IPMC controls green LED. • 0 = IPMC does not control green LED. Bit 1 = OOS LED1 (Amber/Red LED) control bit.
2.3.12 Resetting the Sun Netra CP3220 Blade Server Caution – Do not operate the ATCA shelf without all fans, component heatsinks, air baffles, and covers installed. Severe damage to components can occur if the ATCA shelf is operated without adequate cooling mechanisms. 1. Use a spudger tool or other stylus to press and release the recessed Reset button on the front of the Sun Netra CP3220 blade server (FIGURE 2-13). 2. Confirm the progress of the reset by monitoring the BIOS POST messages.
CHAPTER 3 Software Configuration This chapter provides procedures and information about configuring the software. This chapter contains the following topics: ■ Section 3.1, “Operating Systems” on page 3-2 ■ Section 3.2, “Software Updates” on page 3-2 ■ Section 3.3, “SunVTS Software” on page 3-3 ■ Section 3.4, “Configuring Sun Netra CP3220 For 1GbE or 10GbE Switches” on page 3-4 ■ Section 3.
3.1 Operating Systems The Sun Netra CP3220 blade server has been tested for compatibility with the following operating systems: ■ WindRiver Linux version 3.1 ■ Solaris 10 OS, Release S10U4 and subsequent versions that may be tested for compatibility with the Sun Netra CP3220 blade server. See the Sun Netra CP3220 Blade Server Product Notes (820-1980) for information on Sun Netra patches.
3.3 SunVTS Software Note – The Sun Validation Test Suite (SunVTS software) runs on the Solaris OS only. There are similar test suites available for the Linux operating systems. The SunVTS software is a comprehensive software suite that tests and validates the Sun Netra CP3220 blade server by verifying the configuration and function of most hardware controllers and devices on the blade server.
3.4 Configuring Sun Netra CP3220 For 1GbE or 10GbE Switches The extended fabric on the Sun Netra CP3220 blade server is capable of operating at either 1 Gbps or 10 Gbps. The Sun Netra CP3220 can be used in the Sun Netra CT 900 server with either the Sun Netra CP3240 10-GbE switch or the Sun Netra CP3140 1-GbE switch. Therefore it is important that the driver configuration file be modified accordingly. The network interface driver configuration file, nxge.
3.5 Configuring Alternate OOS LED Behavior Administrators and service technicians can change the default behavior of the out-of-service (OOS) LED through the IPMC by using an LED1 control bit. This bit is available only on the Sun Netra CP3220 blade server. Use the set and get IPMC control byte IPMI commands, which are the same commands used to control the Green OK LED, to change the default OOS LED behavior to the following: ■ IPMC will not light up OOS LED on POST or any other failure.
▼ Displaying Configuration of OOS LED Behavior Use the following command to display the current configuration of OOS LED behavior. Command NetFn Opcode Get IPMC Control Bits 0x2E 0xE8 Data Bytes Type Byte Data Field Request Data 1 00 2 00 3 2A 1 Completion Code: [00] OK [C1] Command not supported [CC] Invalid data in request (Refer to IPMI specification for more completion codes) 2 00 3 00 4 2A 5 IPMC control bit: • Bit 0 : Green LED control bit. • Bit 1 : LED1 control bit.
▼ Setting Configuration of OOS LED Behavior Use the following command to set the configuration of OOS LED behavior. Command NetFn Opcode Set IPMI Control Bits 0xE9 0xE9 Data Bytes Type Byte Data Field Request Data 1 00 2 00 3 2A 4 Control byte. Bit 0 = LED 2 (Green LED) control bit: • 1 = IPMC controls green LED. • 0 = IPMC does not control green LED. Bit 1 = LED1 (Amber/Red LED) control bit. • 1 = IPMC controls LED1 for default behavior. • 0 = IPMC does not control LED1.
3-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010
CHAPTER 4 Configuring and Using BIOS Firmware This chapter describes how to use the BIOS (Basic Input Output System) to configure the blade server. This chapter contains the following topics: ■ Section 4.1, “About BIOS Settings” on page 4-2 ■ Section 4.2, “Changing the Configuration of a BIOS Menu Item” on page 4-4 ■ Section 4.3, “Setting the Boot Device Using BIOS Setup Screens” on page 4-5 ■ Section 4.5, “Setting Supervisor and User Passwords” on page 4-9 ■ Section 4.
4.1 About BIOS Settings This section describes how to view and modify the BIOS settings. The BIOS has a Setup utility stored in the BIOS flash memory. The Setup utility reports system information and can be used to configure the BIOS settings. The configured data is provided with context-sensitive help and is stored in the system's battery-backed CMOS RAM. If the configuration stored in the CMOS RAM is invalid, the BIOS settings will default to the original state specified at the factory. 4.1.
4.1.2.2 AMD PowerNow! Feature Enabled by Default The AMD PowerNow! feature, which is accessed from the BIOS Setup utility Advanced menu, is enabled by default on the Sun Netra CP3220 blade server. Some problems have been observed when using this feature on certain operating systems. If you want to disable this feature, first refer to the Sun Netra CP3220 Blade Server Product Notes (820-1980) for any outstanding known issues for your operating system. 4.1.
4.2 Changing the Configuration of a BIOS Menu Item You can change the BIOS configuration by using a terminal (or terminal emulator connected to a computer) through the serial console port on the front of the Sun Netra CP3220 blade server. Note – Using the ANSI terminal emulation mode provides the best viewing of the BIOS screens. 1. To change the system’s parameters, enter the BIOS Setup utility by pressing the F2 key while the system is performing the power-on self-test (POST).
4.3 Setting the Boot Device Using BIOS Setup Screens Before beginning this procedure, ensure that you have installed the serial cable as described in Section 2.2.4, “Connecting External I/O Cables” on page 2-13. Note – See Section 4.1.3, “Description of the BIOS Screens” on page 4-3 for descriptions of the first-level BIOS menu screens. See Appendix B for a BIOS menu tree and illustrations of the first-level and second-level BIOS screens. 1.
FIGURE 4-1 BIOS Main Menu 5. Using the arrow keys, move across the top of the screen to the Boot menu and press the Enter key. The Boot Settings menu is displayed (FIGURE 4-2).
FIGURE 4-2 Boot Settings Menu 6. Move down the list, select the Boot Device Priority option, and press Enter. The Boot Device Priority menu is displayed (FIGURE 4-3).
FIGURE 4-3 Boot Device Priority Menu 7. Select the NVIDIA Boot Agent device as the 1st Boot Device. 8. Disable all unneeded boot devices in the menu. 9. Use the arrow keys to move to the Exit menu, and press Enter. The confirmation dialog box is displayed. 10. Press Enter to select Ok. The BIOS boots the selected device. The operating system on the selected boot device loads. 11. Configure the operating system by providing a locale, system name, IP address, and other information.
4.4 Changing the BIOS Continuous Boot Setting Traditionally, the BIOS of a PC would go through the list of bootable devices and try to boot up the OS. If all devices failed to boot, BIOS would print a message to inform the user and wait for user intervention. In the ATCA environment, there is typically no one watching the console screen when a blade is booting. Therefore. it is preferred for the BIOS to retry and walk through the boot list continuously.
FIGURE 4-4 Security Settings Menu FIGURE 4-5 Change Password Menu 4-10 Sun Netra CP3220 Blade Server User’s Guide • January 2010
3. Move down the list, select the Change Supervisor Password or Change User Password option, and press Enter. The Change Password menu is displayed (FIGURE 4-5). 4. Type a password, then press Enter. 5. Use the arrow keys to move to the Exit Menu. 6. Select OK to confirm the changes you made. 4.6 Resetting the System Time and System Date 1. Enter the BIOS Setup utility by pressing the F2 key while the system is performing the power-on self-test (POST). 2.
4.7 Updating the BIOS When they become necessary, updated BIOS images will be available as patches on the following web site: http://sunsolve.sun.com/ Use the Solaris BIOS Update Utility or the Linux BIOS Update Utility to implement the updates. For more information, see the Sun Netra CT 900 Server Product Notes (819-1180). 4.8 Secondary BIOS Image The Sun Netra CP3220 blade server provides dual 1-Mbyte BIOS chips that support redundant BIOS images for increased reliability.
For example: # clia sendcmd 96 2e 81 00 00 2a 01 <----- Setting the boot page to 1 Pigeon Point Shelf Manager Command Line Interpreter Completion code: 0x0 (0) Response data: 00 00 2A <----- successful completion code <----- no data returned 3. To boot the blade server from the Shelf Manager, type: # clia activate board n Note – Once the blade server is booted, reset the blade server to use the primary BIOS image (page 0). 4.
4.11 Power-On Self-Test The system provides a rudimentary power-on self-test (POST) that runs each time the blade server boots to check the basic devices required for the system to operate. The progress of the self-test is indicated by a series of POST codes. These codes appear at the bottom right corner of the system’s VGA screen (once the self-test has progressed far enough to initialize the video monitor). You can configure the level of POST testing and some POST display features through the BIOS menus.
4. On the Boot Settings Configuration screen (FIGURE B-17), you can enable or disable the options shown in TABLE 4-2 TABLE 4-2 POST Options Option Description Quick Boot This option is disabled by default. If you enable Quick Boot, the BIOS skips certain tests while booting, such as the extensive memory test. This decreases the time it takes for the system to boot. Quiet Boot This option is disabled by default. If you enable this, the Sun Microsystems logo is displayed instead of POST codes.
4-16 Sun Netra CP3220 Blade Server User’s Guide • January 2010
CHAPTER 5 Hardware Architecture This chapter provides information about the hardware architecture. This chapter contains the following topics: ■ Section 5.1, “Block Diagram” on page 5-2 ■ Section 5.2, “The AMD Opteron Processor” on page 5-3 ■ Section 5.3, “Memory” on page 5-4 ■ Section 5.4, “Networking and I/O” on page 5-5 ■ Section 5.
5.
5.2 The AMD Opteron Processor AMD Opteron processors with Direct Connect Architecture include several new features, including seamless quad-core upgradability and DDR2 memory. AMD Opteron processors with DDR2 memory feature a common core architecture that is consistent across 1-way, 2-way, and 8-way systems. Features of the second generation 2.
FIGURE 5-2 5.3 AMD Opteron Processors Block Diagram Memory The Sun Netra CP3220 blade server supports 1-Gbyte, 2-Gbyte, and 4-Gbyte registered DDR2-667 memory, for up to 32 Gbytes memory total. When four DIMM slots or less are populated, the DIMM clock rate will be set to the max clock rate of up to 333 Mhz. When six or eight DIMMs slots are populated, the DIMM clock rate will be set to a max clock rate of up to 267 Mhz. The AMD Opteron’s processor’s memory controller works in 144-bit mode ECC operation.
5.4 Networking and I/O Networking and I/O are provided by the following chips and interconnects: 5.4.
5.4.2 PCI Express Bus PCI Express 1.0 (PCIe) is a high-speed, point-to-point dual simplex chip interconnect. It is the latest extension of the PCI bus. PCI e operates at 2.5 GHz and supports land widths of x1, x2, x4, x8, x16, and x32. Additional features include: 5.4.3 ■ Serial point-to-point interconnect between two devices ■ Each lane supports two differential signal pairs, one pair for each data direction ■ 2.
5.4.6 Sun Dual 10-Gbit Ethernet/Quad 1-Gbit RGMII Network Interface Chip (Sun 10 GbE Multithreaded Networking ASIC) The Sun Netra CP3220 blade server is equipped with one Sun Dual 10-Gbit Ethernet/Quad 1-Gbit RGMII Network Interface chip that is specifically designed to support multicore and multithreaded processor with minimum CPU load while maximizing network I/O thoughput.
5.5.2 EIDE/ATA for Compact Flash EIDE is an enhanced IDE controller, implemented through the nVidia MCP55 chip. The Sun Netra CP3220 blade server contains one on-board 50-pin Type II Compact Flash connector, for use with an optional compact flash card. The location of the compact flash connector allows access to this component only when the blade server is removed from the ATCA chassis. 5.5.
APPENDIX A Physical Characteristics Specifications for the Sun Netra CP3220 blade server are provided in the following sections: ■ Section A.1, “Form Factor” on page A-2 ■ Section A.2, “Power and Thermal Metrics” on page A-2 ■ Section A.
A.1 Form Factor The Sun Netra CP3220 blade server is a standard 8-rack unit (8U) factor, single-slot wide. It complies with the board mechanical dimensions that are required by the PICMG 3.0 R1.0 specification: A.2 ■ 322.25 mm x 280 mm (12.7 inches x 11.0 inches) ■ 30.48 mm (1.2 inch) front panel Power and Thermal Metrics The heatsink was designed specifically for the Sun Netra CP3220 blade server and is mechanically mounted to the blade server.
A.2.2 PICMG Board Cooling Requirements TABLE A-1 provides the blade server board cooling requirements. No alarms are triggered at any of the listed temperatures for the given airflow. TABLE A-1 Airflow Requirements m3/min Watts CFM Power Level 25˚C 28˚C 40˚C 55˚C 25˚C 28˚C 40˚C 55˚C 140 0.045 0.045 0.91 0.91 16 16 32 32 205 0.045 0.045 0.91 0.91 16 16 32 32 210 0.045 0.045 0.91 0.91 16 16 32 32 A.2.
A.3 Connectors and Pinouts A.3.1 Front Panel Connectors The front panel has the following connectors, see FIGURE 1-1: A.3.1.1 ■ One 10/100/1000BASE-T Ethernet port (RJ-45) ■ One serial port (RJ-45) ■ Two USB ports Ethernet Port The Ethernet connector is an RJ-45 connector. The controller autonegotiates to either 10 BASE-T, 100 BASE-T, or 1000 BASE-T. FIGURE A-1 shows the Ethernet port connector.
TABLE A-3 A.3.1.2 Ethernet Port Connector Pin Assignments (Continued) Pin Signal Name Pin Signal Name 2 DA- 6 DB- 3 DB+ 7 DD+ 4 DC+ 8 DD- USB Ports FIGURE A-2 shows the connector pin assignments for both of the front panel USB ports. FIGURE A-2 1 Front Panel USB Connector 4 TABLE A-5 lists the USB port connector pin assignments.
A.3.1.3 Serial Port FIGURE A-3 shows the connector pin assignments for the front panel serial port. TABLE A-5 lists the serial port connector pin assignments. FIGURE A-3 Front Panel Serial RJ-45 Connector 12345678 TABLE A-5 A.3.2 Serial Port Mini DIN 8-pin Connector Pinouts Pin Signal Name Pin Signal Name 1 RTS 5 GND 2 DTR 6 RXD 3 TXD 7 DSR 4 GND 8 CTS AMC Connectors Two 170-pin connectors make up the AMC card connections.
■ Two -48 VDC power feeds (four signals each; eight signals total) ■ Two IPMB ports (two signals each; four signals total) ■ Geographic address (eight signals) The analog test and ring voltage pins are left unconnected. FIGURE A-4 shows the pin assignments. FIGURE A-4 Power Distribution Connector (Zone 1) P10 1 13 17 21 25 28 30 27 26 4 16 20 33 32 29 31 34 24 TABLE A-6 lists the power distribution connector pin assignments.
TABLE A-6 A-8 Power Distribution Connector Pin Assignments (Continued) Pin Number Name Description 13 SCL_A IPMB Clock, Port A 14 SDA_A IPMB Data, Port A 15 SCL_B IPMB Clock, Port B 16 SDA_B IPMB Data, Port B 17 MT1_TIP Metallic Test #1 Tip 18 MT1_TIP Metallic Test #2 Tip 19 -RING_A Ringing Generator A Negative Ringing 20 -RING_B Ringing Generator B Negative Ringing 21 MT1_RING Metallic Test #1 Ringing 22 MT2_RING Metallic Test #2 Ringing 23 -RING_A Ringing Generator AR
A.3.4 Data Transport Connector (Zone 2) The data transport connector consists of two 120-pin HM-Zd connectors, labeled P20 and P23, with 40 differential pairs each. These are called the Zone 2 connectors.
TABLE A-7 Zone 2 Connector Pin Assignments J23/P23 Connector Pairs Row No.
TABLE A-8 shows the J31 connector pin assignments, used for AMC I/O signals.
TABLE A-9 shows the J32 connector pin assignments, which are used for infrastructure signals.
APPENDIX B BIOS Screens This appendix provides examples of the first-level and second-level screens from the BIOS menu. To enter the BIOS menu, press the F2 key during the POST portion of the boot process. FIGURE B-1 shows the BIOS menu tree. FIGURE B-2 through FIGURE B-29 show the screens within the BIOS menu tree.
FIGURE B-1 Main BIOS Menu Tree Advanced PCI/PnP Boot Security Chipset CPU Configuration Clear NVRAM Boot Settings Change Supervisor Password NorthBridge Chipset IDE Configuration Plug & Play OS Boot Settings Configuration Change User Password SouthBridge Chipset PCI Latency Timer Boot Device Priority Super IO Configuration ACPI Configuration Event Log Configuration MPS Configuration PCI Express Configuration HyperTransport Boot Sector Virus Protection Configuration Allocate IRQ to PCI
FIGURE B-2 BIOS Main Menu FIGURE B-3 Advanced Configuration Menu Appendix B BIOS Screens B-3
FIGURE B-4 CPU Configuration Menu FIGURE B-5 IDE Configuration Menu B-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010
FIGURE B-6 Super IO Configuration Menu FIGURE B-7 ACPI Settings Menu Appendix B BIOS Screens B-5
FIGURE B-8 Event Logging Details Menu FIGURE B-9 MPS Configuration Menu B-6 Sun Netra CP3220 Blade Server User’s Guide • January 2010
FIGURE B-10 PCI Express Configuration Menu FIGURE B-11 SMBIOS Configuration Menu Appendix B BIOS Screens B-7
FIGURE B-12 Remote Access Configuration Menu FIGURE B-13 USB Configuration Menu B-8 Sun Netra CP3220 Blade Server User’s Guide • January 2010
FIGURE B-14 Advanced PCI/PnP Settings Menu FIGURE B-15 Advanced PCI/PnP Settings Menu Continued Appendix B BIOS Screens B-9
FIGURE B-16 Boot Settings Menu FIGURE B-17 Boot Settings Configuration Menu B-10 Sun Netra CP3220 Blade Server User’s Guide • January 2010
FIGURE B-18 Boot Device Priority Menu FIGURE B-19 Boot Hard Disk Drive Priority Menu Appendix B BIOS Screens B-11
FIGURE B-20 Security Settings Menu FIGURE B-21 Change Password Settings Menu B-12 Sun Netra CP3220 Blade Server User’s Guide • January 2010
FIGURE B-22 Chipset Main Menu FIGURE B-23 NorthBridge Chipset Configuration Menu Appendix B BIOS Screens B-13
FIGURE B-24 NorthBridge Chipset Memory Configuration Menu FIGURE B-25 NorthBridge Chipset ECC Configuration Menu B-14 Sun Netra CP3220 Blade Server User’s Guide • January 2010
FIGURE B-26 NorthBridge Chipset DRAM Configuration Menu FIGURE B-27 SouthBridge Chipset Configuration Menu Appendix B BIOS Screens B-15
FIGURE B-28 Hyper Transport Configuration Menu FIGURE B-29 Exit Options Menu B-16 Sun Netra CP3220 Blade Server User’s Guide • January 2010
Appendix B BIOS Screens B-17
Index A Advanced PCI/PnP Settings menu, B-9 Airflow Requirements, A-3 AMC connectors, A-6 AMC devices additional I/O, 1-7 installing, 2-26 AMC.
contacting support, 1-14 CPU Configuration menu, B-4 resetting, 2-29 M D data transport connector, A-9 DDR-2 DIMM.
hardware, 1-13 safety, 2-2 software, 1-13 revision number, locating, 1-14 RJ-45 Ethernet, A-4 RTM Pressure Drop, A-3 S Security Settings menu, B-12 serial number, locating, 1-14 port, A-6 SMBIOS Configuration menu, B-7 software OS support, 3-2 SunVTS, 3-3 software requirements, 1-13 Southbridge chipset menu, B-14, B-15 Sun Services, 1-14, 3-2 SunVTS software, -xv, 3-3 Super IO Configuration menu, B-5 Supervisor Password menu, B-12 support, contacting, 1-14 switches, configuring for 1GbE or 10GbE, 3-4 U US
Index-4 Sun Netra CP3220 Blade Server User’s Guide • January 2010
