Cisco UCS C240 Server Installation and Service Guide Covers Server Generation M3 November 14, 2013 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
CONTENTS Preface v Related Documentation Organization Audience v vi Documentation Feedback Conventions v vi vi Obtaining Documentation and Submitting a Service Request CHAPTER 1 Overview 1-1 External Features Overview 1-1 Summary of Server Features 1-5 CHAPTER 2 Installing the Server xi 2-1 Unpacking and Inspecting the Server 2-2 Preparing for Server Installation 2-3 Installation Guidelines 2-3 Rack Requirements 2-4 Equipment Requirements 2-4 Slide Rail Adjustment Range 2-4 Installing th
Contents Using the Clear CMOS Header J2065 CHAPTER 3 Maintaining the Server 2-20 3-1 Server Monitoring and Management Tools 3-1 Cisco Integrated Management Interface (CIMC) Server Configuration Utility 3-1 3-1 Status LEDs and Buttons 3-2 Front Panel LEDs 3-2 Rear Panel LEDs and Buttons 3-4 Internal Diagnostic LEDs 3-6 Preparing for Server Component Installation 3-7 Required Equipment 3-7 Shutting Down and Powering Off the Server 3-7 Removing and Replacing the Server Top Cover 3-8 Replaceable Compon
Contents Special Considerations for Cisco UCS Fusion ioDrive2 Storage Accelerator Cards RAID Controller Card Cable Routing 3-44 Installing Multiple PCIe Cards and Resolving Limited Resources 3-45 Installing an NVIDIA GRID or Tesla GPU Card 3-47 Overview of Software Requirements 3-47 Configuration Rules 3-47 How to Determine Your Server Version 3-49 Installation Procedures 3-50 Installing the GPU Card in Version 01 Servers 3-50 Installing the GPU Card in Version 02 Servers 3-55 Installing Drivers to Support
Contents APPENDIX RAID Controller Considerations C C-1 Supported RAID Controllers and Required Cables LSI Nytro MegaRAID 8110-4i Considerations Mixing Drive Types in RAID Groups Battery Backup Units C-2 C-4 C-4 C-5 Factory-Default Option ROM Settings RAID Controller Migration C-6 C-7 Embedded MegaRAID Controller C-8 Notes on Supported Embedded MegaRAID Levels C-9 Installing a SCU Upgrade ROM Module For Embedded RAID SAS Support C-10 Installing a Software RAID Key Module for Embedded RAID 5 Supp
Preface This preface describes the audience, organization, and conventions of the Cisco UCS C240 Server Installation and Service Guide. It also provides information about how to obtain related documentation.
Preface Audience This guide is for experienced network administrators who configure and maintain Cisco servers. Documentation Feedback To provide technical feedback on this document, or to report an error or omission, please send your comments to ucs-docfeedback@external.cisco.com. We appreciate your feedback. Conventions This document uses the following conventions for notes, cautions, and safety warnings. Notes and cautions contain important information that you should know.
Preface Varoitus TÄRKEITÄ TURVALLISUUSOHJEITA Tämä varoitusmerkki merkitsee vaaraa. Tilanne voi aiheuttaa ruumiillisia vammoja. Ennen kuin käsittelet laitteistoa, huomioi sähköpiirien käsittelemiseen liittyvät riskit ja tutustu onnettomuuksien yleisiin ehkäisytapoihin. Turvallisuusvaroitusten käännökset löytyvät laitteen mukana toimitettujen käännettyjen turvallisuusvaroitusten joukosta varoitusten lopussa näkyvien lausuntonumeroiden avulla.
Preface Aviso INSTRUÇÕES IMPORTANTES DE SEGURANÇA Este símbolo de aviso significa perigo. Você está em uma situação que poderá ser causadora de lesões corporais. Antes de iniciar a utilização de qualquer equipamento, tenha conhecimento dos perigos envolvidos no manuseio de circuitos elétricos e familiarize-se com as práticas habituais de prevenção de acidentes.
Preface Aviso INSTRUÇÕES IMPORTANTES DE SEGURANÇA Este símbolo de aviso significa perigo. Você se encontra em uma situação em que há risco de lesões corporais. Antes de trabalhar com qualquer equipamento, esteja ciente dos riscos que envolvem os circuitos elétricos e familiarize-se com as práticas padrão de prevenção de acidentes. Use o número da declaração fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham o dispositivo.
Preface Cisco UCS C240 Server Installation and Service Guide x OL-25761-01
Preface Obtaining Documentation and Submitting a Service Request For information on obtaining documentation, submitting a service request, and gathering additional information, see the monthly What’s New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation, at: http://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.
Preface Cisco UCS C240 Server Installation and Service Guide xii OL-25761-01
CH A P T E R 1 Overview This chapter provides an overview of the Cisco UCS C240 server features. External Features Overview, page 1-1 Summary of Server Features, page 1-5 External Features Overview The figures in this chapter show an overview of external server features. (Internal server features are illustrated in Figure 3-5 on page 3-9.
Chapter 1 Overview Figure 1-1 shows the front panel features of the small form-factor drives version of the server. This version of the server can be ordered with either a 16-drive backplane or a 24-drive backplane with an expander. When the 16-drive backplane is installed, only the first 16 drive bays are used.
Chapter 1 Overview Figure 1-2 shows the front panel features of the Large Form-Factor drives version of the server. This version of the server has a 12-drive backplane with an expander. Figure 1-2 Cisco UCS C240 Server (Large Form-Factor Drives) Front Panel Features 1 2 HDD 1 HDD 2 HDD 3 HDD 4 HDD 5 HDD 6 HDD 7 HDD 8 HDD 9 HDD 10 HDD 11 4 5 6 HDD 12 8 10 9 331825 3 7 1 KVM connector 6 (used with KVM cable that provides two USB 2.
Chapter 1 Overview Figure 1-3 shows the rear panel features of the server (identical for all versions of the server). Figure 1-3 Cisco UCS C240 Server Rear Panel Features 1 2 3 PCIe 1 PCIe 5 PCIe 2 PCIe 4 PCIe 3 PSU2 4 5 6 7 8 9 10 11 331826 PSU1 1 Power supplies (two) 7 1-Gb Ethernet dedicated management port 2 PCIe slot on riser 2: PCIe 5—full-height, 3/4-length, x16 lane) 8 USB 2.
Chapter 1 Overview Summary of Server Features Table 1-1 lists a summary of server features. . Table 1-1 Cisco UCS C240 Server Features Chassis Two rack-unit (2RU) chassis. Processors Two Intel Xeon E5-2600 Series processors. Memory The server provides 24 DIMM1 sockets on the motherboard. This provides a possible total of up to 768 GB of industry-standard DDR32 memory. Multi-bit error protection This server supports multi-bit error protection.
Chapter 1 Table 1-1 Storage Overview Cisco UCS C240 Server Features (continued) Drives are installed into front-panel drive bays that provide hot-pluggable access. The server is orderable in three different versions, each with one of three different front panel/backplane configurations: • Cisco UCS C240 (small form-factor (SFF) drives, with 24-drive backplane and expander). Holds up to twenty-four 2.5-inch hard drives or solid state drives.
CH A P T E R 2 Installing the Server This chapter describes how to install the server, and it includes the following sections: Note Warning • Unpacking and Inspecting the Server, page 2-2 • Preparing for Server Installation, page 2-3 • Installing the Server In a Rack, page 2-5 • Initial Server Setup, page 2-10 • System BIOS and CIMC Firmware, page 2-14 • Updating the BIOS and CIMC Firmware, page 2-14 • Service Headers and Jumpers, page 2-16 Before you install, operate, or service a server
Chapter 2 Installing the Server Unpacking and Inspecting the Server Unpacking and Inspecting the Server Caution When handling internal server components, wear an ESD strap and handle modules by the carrier edges only. Tip Keep the shipping container in case the server requires shipping in the future. Note The chassis is thoroughly inspected before shipment. If any damage occurred during transportation or any items are missing, contact your customer service representative immediately.
Chapter 2 Installing the Server Preparing for Server Installation Preparing for Server Installation This section provides information about preparing for server installation, and it includes the following topics: • Installation Guidelines, page 2-3 • Rack Requirements, page 2-4 • Equipment Requirements, page 2-4 • Slide Rail Adjustment Range, page 2-4 Installation Guidelines Warning To prevent the system from overheating, do not operate it in an area that exceeds the maximum recommended ambient t
Chapter 2 Installing the Server Preparing for Server Installation When you are installing a server, use the following guidelines: • Plan your site configuration and prepare the site before installing the server. See the Cisco UCS Site Preparation Guide for the recommended site planning tasks. • Ensure that there is adequate space around the server to allow for servicing the server and for adequate airflow. The airflow in this server is from front to back.
Chapter 2 Installing the Server Installing the Server In a Rack Installing the Server In a Rack This section contains the following sections: • Installing the Slide Rails, page 2-5 • Installing the Cable Management Arm (Optional), page 2-8 • Reversing the Cable Management Arm (Optional), page 2-9 Installing the Slide Rails Warning To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable.
Chapter 2 Installing the Server Installing the Server In a Rack Figure 2-2 Attaching a Slide-Rail Assembly 1 2 3 4 6 Step 2 Caution 330499 5 6 1 Front-right rack post 4 Length-adjustment bracket 2 Rear-right rack post 5 Mounting pegs (two on each end of assembly) 3 Slide-rail assembly 6 Locking clips (one on each end of assembly) c. Attach the second slide-rail assembly to the opposite side of the rack.
Chapter 2 Installing the Server Installing the Server In a Rack Figure 2-3 Inserting the Server Into the Slide Rails 3 4 330534 2 1 Step 3 1 Inner rail on server 3 Slide rail assembly on rack post 2 Slide rail locking clip 4 Right-front rack post Optional–If you want to install the cable management arm, continue with Installing the Cable Management Arm (Optional), page 2-8.
Chapter 2 Installing the Server Installing the Server In a Rack Installing the Cable Management Arm (Optional) To install the cable management arm (CMA) to the rear of the slide rails, use the following procedure. Note The CMA is reversible right-to-left. However when reversing, you must remove and reposition the CMA attachment tabs for correct installation. To reverse the CMA, see Reversing the Cable Management Arm (Optional), page 2-9 before installation.
Chapter 2 Installing the Server Installing the Server In a Rack Reversing the Cable Management Arm (Optional) The CMA is shipped assembled for installation to the rear of the right-hand slide rails (when facing the rear of the server). The CMA is reversible so that you can mount it to the rear of either the right or left slide rails. However, you must remove and reposition the CMA tabs so that the hinges open correctly.
Chapter 2 Installing the Server Initial Server Setup Initial Server Setup This section includes the following topics: • Connecting and Powering On the Server (Standalone Mode), page 2-10 • NIC Modes and NIC Redundancy Settings, page 2-13 Connecting and Powering On the Server (Standalone Mode) Note This section describes how to power on the server, assign an IP address, and connect to server management when using the server in standalone mode.
Chapter 2 Installing the Server Initial Server Setup Step 3 Set NIC mode, NIC redundancy, and choose whether to enable DHCP or set static network settings: a. Press the Power button to boot the server. Watch for the prompt to press F8. b. During bootup, press F8 when prompted to open the BIOS CIMC Configuration Utility. c.
Chapter 2 Installing the Server Initial Server Setup Note If you chose to enable DHCP, the dynamically assigned IP and MAC addresses are displayed on the console screen during bootup. Step 4 Connect to the CIMC for server management. Connect Ethernet cables from your LAN to the server by using the ports that you selected by your NIC Mode setting in Step 3. The Active-active and Active-passive NIC redundancy settings require you to connect to two ports.
Chapter 2 Installing the Server Initial Server Setup NIC Modes and NIC Redundancy Settings This server has the following NIC mode settings that you can choose from: • Shared LOM EXT (default)—This is shared LOM extended mode. This is the factory-default setting, along with Active-active NIC redundancy and DHCP-enabled. With this mode, the shared LOM and Cisco Card interfaces are both enabled. In this mode, DHCP replies are returned to both the shared LOM ports and the Cisco card ports.
Chapter 2 Installing the Server System BIOS and CIMC Firmware System BIOS and CIMC Firmware This section includes information about the system BIOS and it includes the following sections: • Updating the BIOS and CIMC Firmware, page 2-14 • Accessing the System BIOS, page 2-15 Updating the BIOS and CIMC Firmware Caution When you upgrade the BIOS firmware, you must also upgrade the CIMC firmware to the same version or the server will not boot.
Chapter 2 Installing the Server System BIOS and CIMC Firmware Accessing the System BIOS To change the BIOS settings for your server, follow these steps. Detailed instructions are also printed on the BIOS screens. Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup. Note The version and build of the current BIOS are displayed on the Main page of the utility. Step 2 Use the arrow keys to select the BIOS menu page.
Chapter 2 Installing the Server Service Headers and Jumpers Service Headers and Jumpers This section includes the following topics: • Header Locations on the Motherboard, page 2-16 • Using the BIOS Recovery Header J2068, page 2-17 • Using the Clear CMOS Header J2065, page 2-20 Header Locations on the Motherboard See Figure 2-6. The block of headers is shown in red. The individual headers are shown in the magnified view. The pin numbering is the same for all headers in the block.
Chapter 2 Installing the Server Service Headers and Jumpers Using the BIOS Recovery Header J2068 Depending on which stage the BIOS becomes corrupted, you might see different behavior. • If the BIOS BootBlock is corrupted, you might see the system get stuck on the following message: Initializing and configuring memory/hardware • If it is a non-BootBlock corruption, the following message is displayed: ****BIOS FLASH IMAGE CORRUPTED**** Flash a valid BIOS capsule file using CIMC WebGUI or CLI interface.
Chapter 2 Installing the Server Service Headers and Jumpers Note During the BIOS update, the CIMC will shut down the server and the screen will be blank for about 10 minutes. Do not unplug the power cords during this update. The CIMC will power on the server after the update is complete.
Chapter 2 Installing the Server Service Headers and Jumpers Procedure 2: Use Recovery Jumper and recovery.cap File See Figure 2-6 for the location of the J2068 header. Step 1 Download the BIOS update package and extract it to a temporary location. Step 2 Copy the contents of the extracted recovery folder to the root directory a USB thumb drive. The recovery folder contains the recovery.cap file that is required in this procedure. The recovery.
Chapter 2 Installing the Server Service Headers and Jumpers Using the Clear CMOS Header J2065 See Figure 2-6 for the location of this header. You can jumper this header to clear the server’s CMOS settings in the case of a system hang. For example, if the server hangs because of incorrect settings and does not boot, use this jumper to invalidate the settings and reboot with defaults. Caution Clearing the CMOS removes any customized settings and might result in data loss.
CH A P T E R 3 Maintaining the Server This chapter describes how to diagnose server system problems using LEDs.
Chapter 3 Maintaining the Server Status LEDs and Buttons Status LEDs and Buttons This section describes the location and meaning of LEDs and buttons and includes the following topics • Front Panel LEDs, page 3-2 • Rear Panel LEDs and Buttons, page 3-4 • Internal Diagnostic LEDs, page 3-6 Front Panel LEDs Figure 3-1 shows the front panel LEDs. Table 3-1 defines the LED states.
Chapter 3 Maintaining the Server Status LEDs and Buttons Table 3-1 Front Panel LEDs, Definitions of States (continued) LED Name Power supply status Temperature status Fan status System status State • Green—All power supplies are operating normally. • Amber, steady—One or more power supplies are in a degraded operational state. • Amber, blinking—One or more power supplies are in a critical fault state. • Green—The server is operating at normal temperature.
Chapter 3 Maintaining the Server Status LEDs and Buttons Rear Panel LEDs and Buttons Figure 3-2 shows the rear panel LEDs and buttons. Table 3-2 defines the LED states.
Chapter 3 Maintaining the Server Status LEDs and Buttons Table 3-2 Rear Panel LEDs, Definitions of States (continued) LED Name 1-Gb Ethernet dedicated management link status 1-Gb Ethernet link speed 1-Gb Ethernet link status Identification State • Off—No link is present. • Green—Link is active. • Green, blinking—Traffic is present on the active link. • Off—link speed is 10 Mbps. • Amber—link speed is 100 Mbps. • Green—link speed is 1 Gbps. • Off—No link is present.
Chapter 3 Maintaining the Server Status LEDs and Buttons Internal Diagnostic LEDs The server is equipped with a SuperCap voltage source that can activate internal component fault LEDs up to one half-hour after AC power is removed. The server has internal fault LEDs for fan modules and DIMMs. To use these LEDs to identify a failed component, press the front or rear Identification button (see Figure 3-1 or Figure 3-2) with AC power removed. An LED lights amber to indicate a failed component.
Chapter 3 Maintaining the Server Preparing for Server Component Installation Preparing for Server Component Installation This section describes how to prepare for component installation, and it includes the following topics: • Required Equipment, page 3-7 • Shutting Down and Powering Off the Server, page 3-7 • Removing and Replacing the Server Top Cover, page 3-8 • Replaceable Component Locations, page 3-9 • Serial Number Location, page 3-10 • Color-Coded Touch Points, page 3-10 Required Equip
Chapter 3 Maintaining the Server Preparing for Server Component Installation Removing and Replacing the Server Top Cover To remove or replace the top cover of the server, follow these steps: Tip Step 1 Step 2 You do not have to remove the cover to replace hard drives or power supplies. Remove the top cover (see Figure 3-4). a. Loosen the captive thumbscrew that secures the rear edge of the cover to the chassis. b. Press the release button. c.
Chapter 3 Maintaining the Server Preparing for Server Component Installation Replaceable Component Locations This section shows the locations of the components that are discussed in this chapter. The view in Figure 3-5 is from the top down with the top cover and air baffles removed.
Chapter 3 Maintaining the Server Preparing for Server Component Installation Serial Number Location The serial number for the server is printed on a label on the top of the server, near the front. Color-Coded Touch Points This server has color-coded touch points that indicate thumbscrews and latches on replaceable and hot-swappable components. • Hot-swappable components have green plastic touch points. This includes the internal cooling fans and the power supplies.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Installing or Replacing Server Components Warning Blank faceplates and cover panels serve three important functions: they prevent exposure to hazardous voltages and currents inside the chassis; they contain electromagnetic interference (EMI) that might disrupt other equipment; and they direct the flow of cooling air through the chassis.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing Hard Drives or Solid State Drives This section includes the following information: • Drive Population Guidelines, page 3-12 • Drive Replacement Procedure, page 3-13 Drive Population Guidelines The server is orderable in three different versions, each with one of three different front panel/backplane configurations: • Cisco UCS C240 (small form-factor (SFF) drives, with 24-drive backplane and expander).
Chapter 3 Maintaining the Server Installing or Replacing Server Components Observe these drive population guidelines for optimal performance: • Note Note When populating drives, add drives in the lowest numbered bays first (populate HDD1 to HDD24). Sixteen-drive backplane option: If your SFF drives server has the 16-drive backplane installed, only the first 16 drive bays are used, with population order HDD1 to HDD16. Keep blanking trays in the empty eight bays to ensure optimal air flow and cooling.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing Hard Drives HDD 24 HDD 23 HDD 22 HDD 21 HDD 20 HDD 19 HDD 18 HDD 17 HDD 16 HDD 15 HDD 14 HDD 12 2 HDD 11 HDD 10 HDD 9 HDD 8 HDD 7 HDD 6 HDD 5 HDD 4 HDD 3 HDD 2 HDD 1 1 HDD 13 Figure 3-8 3 3 331836 3 3 1 Release button 2 Ejector lever 3 Drive tray securing screws (4) – Cisco UCS C240 Server Installation and Service Guide 3-14 OL-25761-01
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing a Drive Backplane Note The Small Form-Factor (24-drive or 16-drive) and Large Form-Factor (12-drive) backplanes and their corresponding chassis drive bays are factory-configurable options. When replacing a backplane, you must replace it with the same version of the backplane. To install or replace a drive backplane, follow these steps: Note Step 1 Caution The 16-drive backplane option does not use a SAS expander.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Step 9 Step 10 Remove the SAS expander card from the backplane assembly: a. Use a #2 Phillips-head screwdriver to remove the two screws that secure the SAS expander to the backplane assembly steel tray (see Figure 3-10). b. Pull the SAS expander from the sockets on the drive backplane and then set the SAS expander aside on an antistatic mat. Install the SAS expander card to the new backplane assembly: a.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-9 Replacing the Drive Backplane 4 SAS1 Riser 1 FAN1 SAS2 2 SAS1 FAN2 CPU1 SAS1 SAS2 SAS2 FAN3 1 Riser 2 FAN4 FAN5 CPU2 331837 FAN6 3 1 Backplane assembly captive thumbscrews (two) 3 Location of motherboard connector BACKPLANE POWER 1 2 SAS expander cable connectors 4 Fan tray blue-plastic locking levers Cisco UCS C240 Server Installation and Service Guide OL-25761-01z 3-17
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing a SAS Expander The SAS expander is a card that plugs directly into the drive backplane. See Appendix C, “RAID Controller Considerations” for more information about supported RAID controllers. Note The SAS expander is required for the SFF 24-drive option and the LFF 12-drive option. The SFF 16-drive option does not use the SAS expander.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Step 7 Replace the fan tray. a. With the blue-plastic lever at each end of the fan tray in the upright and open position, set the fan tray in place in the chassis. Use the chassis guides at each end of the fan tray to keep the fan tray level and straight. b. Rotate each blue-plastic lever down to the locked position. Stop when the levers click and lock. Step 8 Replace the top cover.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing Fan Modules The six hot-pluggable fan modules in the server are numbered as follows when you are facing the front of the server. Figure 3-11 FAN 1 Tip Fan Module Numbering FAN 2 FAN 3 FAN 4 FAN 5 FAN 6 There is a fault LED on the top of each fan module that lights amber if the fan module fails. To operate these LEDs from the SuperCap power source, remove AC power cords and then press the Identification button.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-12 Replacing Fan Modules 1 2 3 SAS1 Riser 1 FAN1 SAS2 SAS1 FAN2 CPU1 SAS1 SAS2 SAS2 FAN3 Riser 2 FAN4 FAN5 CPU2 331848 FAN6 1 Finger latches on each fan module 2 Fan module fault LED on each fan module 3 Connector on underside of fan module Cisco UCS C240 Server Installation and Service Guide OL-25761-01z 3-21
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing the Motherboard RTC Battery Warning There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions. [Statement 1015] The real-time clock (RTC) battery retains system settings when the server is disconnected from power.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-13 Replacing the Motherboard RTC Battery 2 SAS1 Riser 1 FAN1 SAS2 SAS2 SAS1 FAN2 CPU1 SAS1 SAS2 1 FAN3 Riser 2 FAN4 FAN5 CPU2 331839 FAN6 1 RTC battery holder on motherboard (under fan tray) 2 Fan tray blue-plastic locking levers Cisco UCS C240 Server Installation and Service Guide OL-25761-01z 3-23
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing DIMMs This section includes the following topics: • Memory Performance Guidelines and Population Rules, page 3-24 • DIMM Replacement Procedure, page 3-27 Caution DIMMs and their sockets are fragile and must be handled with care to avoid damage during installation. Caution Cisco does not support 3rd-party DIMMs. Using non-Cisco DIMMs in the server might result in system problems or damage to the motherboard.
Chapter 3 Maintaining the Server Installing or Replacing Server Components DIMM Slot Numbering Figure 3-14 shows the numbering of the DIMM slots. Figure 3-14 CPUs and DIMM Slots on Motherboard C1 C2 C3 D1 D2 D3 CPU 1 Front of Server B3 B2 B1 A3 A2 A1 G1 G2 G3 H1 H2 H3 F3 F2 F1 E3 E2 E1 331840 CPU 2 DIMM Population Rules Observe the following guidelines when installing or replacing DIMMs: • Each CPU supports four memory channels. – CPU1 supports channels A, B, C, and D.
Chapter 3 Maintaining the Server Installing or Replacing Server Components • Any DIMM installed in a DIMM socket for which the CPU is absent is not recognized. In a single-CPU configuration, populate the channels for CPU1 only. • Although 1600 MHz DIMMs can be run in Power Saving Mode (low-voltage 1.35 V operation), 1600 MHz operation is supported only when the DDR mode is set to Performance Mode (see “Enabling Low-Voltage DIMM Operation.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Memory Mirroring When memory mirroring is enabled, the memory subsystem simultaneously writes identical data to two channels. If a memory read from one of the channels returns incorrect data due to an uncorrectable memory error, the system automatically retrieves the data from the other channel.
Chapter 3 Maintaining the Server Installing or Replacing Server Components b. Caution Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance. If you cannot safely view and access the component, remove the server from the rack. c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on page 3-8. d.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing CPUs and Heatsinks This section contains the following topics: • Special Information For Upgrades to Intel E5-2600 v2 Series CPUs, page 3-29 • CPU Configuration Rules, page 3-29 • CPU Replacement Procedure, page 3-30 • Additional CPU-Related Parts To Order With RMA Replacement Motherboards, page 3-35 Special Information For Upgrades to Intel E5-2600 v2 Series CPUs Caution You must upgrade your server firmware to
Chapter 3 Maintaining the Server Installing or Replacing Server Components CPU Replacement Procedure Caution CPUs and their motherboard sockets are fragile and must be handled with care to avoid damaging pins during installation. The CPUs must be installed with heatsinks and their thermal pads to ensure proper cooling. Failure to install a CPU correctly might result in damage to the server.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-15 CPU Heatsink and Socket 2 1 332093 3 Step 2 1 CPU retaining latch, 2 CPU retaining latch, 3 Hinged CPU cover plate – Remove a protective cap or an old CPU from the socket (if present): • If you are removing an old CPU, skip to Step 3. • If you are installing a new CPU to a socket that was shipped empty, the socket has a protective cap that is intended to prevent bent contact pins.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-17 Removing or Inserting a CPU 2 1 Step 4 Arrow on tool 2 331370 1 Registration mark on CPU socket Insert the new CPU into the Pick-and-Place tool: a. Remove the new CPU from the packaging and place it on the pedestal that is included in the kit. Align the registration mark on the corner of the CPU with the arrow on the corner of the pedestal (see Figure 3-18). b.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-18 CPU and Pick-and-Place Tool on Pedestal 1 1 1 Step 5 Note Caution – Install a new CPU: a. Step 6 Arrow marks for alignment 333566 1 Set the Pick-and-Place tool with CPU over the empty CPU socket on the motherboard. Align the arrow on the top of the tool with the registration mark (small triangle) that is stamped on the metal of the CPU socket, as shown in Figure 3-17. b.
Chapter 3 Maintaining the Server Installing or Replacing Server Components c. Apply thermal grease from an included syringe to the top of the CPU. Apply about 2 cubic centimeters of grease (about half the syringe contents) to the top of the CPU in the pattern that is shown in Figure 3-19. Note CPU spares come with two syringes of thermal grease; one with a blue cap and one with a red cap. The syringe with the red cap is UCS-CPU-GREASE2=, which is used with this server.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Additional CPU-Related Parts To Order With RMA Replacement Motherboards When a return material authorization (RMA) of the motherboard or CPU is done on a Cisco UCS C-series server, there are additional parts that might not be included with the CPU or motherboard spare bill of materials (BOM). The TAC engineer might need to add the additional parts to the RMA to help ensure a successful replacement.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing a Mezzanine Card The server has a dedicated socket on the motherboard for a mezzanine-style RAID controller card. Note See RAID Controller Considerations, page C-1 for more information about supported cards and cabling. To install or replace a mezzanine card, follow these steps: Step 1 Caution Remove the mezzanine card that you are replacing (see Figure 3-20): a.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-20 Replacing the Mezzanine Card (Shown With PCIe Riser 2 Removed) 1 331849 2 1 Mezzanine card connector on motherboard 2 Mezzanine card securing screws (two) Cisco UCS C240 Server Installation and Service Guide OL-25761-01z 3-37
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing a PCIe Riser Note The older PCIe risers UCSC-PCIE-RL-C240= and UCSC-PCIE-RR-C240= are compatible only with the older version V01 chassis, and have been obsoleted. These parts have been replaced by a new single item (UCSC-GPUKIT1-C240=), which contains left and right risers along with additional hardware to facilitate installation of NVIDIA GPU cards.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Step 2 Install a new PCIe riser: a. If you removed a card from the old PCIe riser, install the card to the new riser (see Replacing a PCIe Card, page 3-40). b. Position the PCIe riser over its socket on the motherboard and over its alignment slots in the chassis (see Figure 3-22). c. Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with the socket on the motherboard. d.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Replacing a PCIe Card Caution Cisco supports all PCIe cards qualified and sold by Cisco. PCIe cards not qualified or sold by Cisco are the responsibility of the customer. Although Cisco will always stand behind and support the C-Series rack-mount servers, customers using standard, off-the-shelf, third-party cards must go to the third-party card vendor for support if any issue with that particular third-party card occurs.
Chapter 3 Maintaining the Server Installing or Replacing Server Components 3. Network Communications Services Interface protocol 4. Slot 2 can operate when the server is in standby power mode. 5. Slot 4 is not available in single-CPU configurations. 6. Slot 5 is not available in single-CPU configurations. Replacing a PCIe Card Note For the list of supported PCIe adapters and other components, see the Technical Specifications Sheet at http://www.cisco.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Step 2 Install a PCIe card: a. Align the new PCIe card with the empty socket on the PCIe riser. b. Push down evenly on both ends of the card until it is fully seated in the socket. Ensure that the card rear panel tab sits flat against the PCIe riser rear panel opening. c. Close the hinged card retainer over the rear panel tab of the card and push in on the retainer until its clip clicks into place to secure the card. d.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Special Considerations for Cisco UCS Virtual Interface Cards Table 3-8 describes the requirements for the supported Cisco UCS virtual interface cards (VICs).
Chapter 3 Maintaining the Server Installing or Replacing Server Components Special Considerations for Cisco UCS Fusion ioDrive2 Storage Accelerator Cards Table 3-9 describes the requirements for the supported Cisco UCS Fusion ioDrive2 cards. Table 3-9 Cisco UCS C240 Requirements for Fusion ioDrive2 Cards Slots That Support Cards 1 Minimum CIMC Card Height Firmware (rear-panel tab) 4 PCIE 1 PCIE 2 PCIE 3 PCIE 52 1.5(2) Full height 5 All 1.5(2) Half height3 5 All 1.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Installing Multiple PCIe Cards and Resolving Limited Resources When a large number of PCIe add-on cards are installed in the server, the system may run out of the following resources required for PCIe devices: • Option ROM memory space • 16-bit I/O space The topics in this section provide guidelines for resolving the issues related to these limited resources.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Resolving Insufficient 16-Bit I/O Space The system has only 64 KB of legacy 16-bit I/O resources available. This 64 KB of I/O space is divided between the CPUs in the system because the PCIe controller is integrated into the CPUs.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Installing an NVIDIA GRID or Tesla GPU Card This section contains the following topics: • Overview of Software Requirements, page 3-47 • Configuration Rules, page 3-47 • How to Determine Your Server Version, page 3-49 • Installing the GPU Card in Version 01 Servers, page 3-50 • Installing the GPU Card in Version 02 Servers, page 3-55 • Installing Drivers to Support the NVIDIA GPU Cards, page 3-59 Overview of Software Re
Chapter 3 Maintaining the Server Installing or Replacing Server Components General NVIDIA GPU Card Configuration Rules Caution When using NVIDIA GRID GPU cards, the operating temperature range is 32° to 95°F (0° to 35°C). Caution When using dual NVIDIA GPU cards, you must preserve at least 10mm of space between servers to ensure adequate airflow and cooling. The only exception is for NVIDIA GRID K1 GPU cards, which do not require this 10mm gap.
Chapter 3 Maintaining the Server Installing or Replacing Server Components How to Determine Your Server Version The version of your server can be seen in the version ID on the PID/VID label. The PID/VID label is on the top of the server (see Figure 3-25). • A version ID with “V01” designates version 01 of the server. • A version ID with “V02” designates version 02 of the server.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Installation Procedures Use one of the following two procedures, depending on your server version: • If you have a version 01 server, use the procedure in Installing the GPU Card in Version 01 Servers, page 3-50. You are required to upgrade the server with a GPU upgrade kit before you can install the GPU card. • If you have a version 02 server, use the procedure in Installing the GPU Card in Version 02 Servers, page 3-55.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Installation Procedure Summary of procedure steps: 1. Prepare the server for component installation. 2. Replace the chassis mid-brace. 3. Connect the 8-to-8 pin power cable adapter and the power cable to the motherboard. 4. Install the GPU card into the new replacement riser. 5. Install the new replacement riser into the chassis. 6. Connect the power cable to the GPU card.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-27 Removing the Chassis Mid-Brace and PCIe Risers 1 2 SAS1 Riser 1 FAN1 SAS2 SAS1 FAN2 CPU1 SAS1 SAS2 SAS2 FAN3 FAN5 3 Riser 2 FAN4 CPU2 336561 FAN6 1 Step 3 1 Chassis mid-brace finger-latch 2 PCIe riser 1 finger holes 3 PCIe riser 2 finger holes Connect the 8-to-8 pin power cable adapter to the motherboard connector GPU PWR (see Figure 3-28).
Chapter 3 Maintaining the Server Installing or Replacing Server Components Note Do not connect the power cable to the GPU card at this point. Figure 3-29 Cabling Diagram, Single- and Dual-GPU Card Examples GPU GPU GPU 3 4 336123 2 1 Note Step 5 1 Motherboard connector GPU PWR 3 Straight GPU power cable for single GPU 2 8-to-8 pin cable adapter 4 Y GPU power cable for dual GPUs See Configuration Rules, page 3-47 before you install the GPU cards to the risers.
Chapter 3 Maintaining the Server Installing or Replacing Server Components c. Close the hinged card retainer, then the long-card retainer over the end of the card. Figure 3-31 PCIe Riser (Slot 5 on PCIe Riser 2 Shown) 2 3 336576 1 Step 6 1 Long-card retainer 2 Card socket When a GPU card is in slot 2, slot 1 is blocked and unavailable for use. Install the new PCIe risers: a. Note b. Install any other PCIe cards that you want to install into the new risers.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Note The power connector on the NVIDIA GRID K1 GPU card has only 6 pins, but the power cable has an 8-pin connector. Plug the 8-pin cable connector into the 6-pin connector on the card, aligning the clip and keying features for the correct fit. Pins 4 and 8 on the cable connector do not engage with the connector on the card. Note The NVIDIA GRID K2 GPU card has a 6-pin power connector and an 8-pin connector.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Note The option ROM must be enabled in the BIOS Setup Utility for the slot in which you are installing the GPU card or it will not be recognized by the system. Figure 3-32 Rear Panel, Showing PCIe Risers and PCIe Slots 1 2 PCIe 1 PCIe 2 PCIe 4 PCIe 3 PSU1 PSU2 1 PCIe riser 1 slots (Slots 1, 2, 3) a. Open the riser’s hinged card retainer and the long-card retainer (see Figure 3-33). b.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Note b. If you are installing a Cisco UCS Virtual Interface Card (VIC), see the slot restrictions in Special Considerations for Cisco UCS Virtual Interface Cards, page 3-43. Install riser 2 first. Position the PCIe riser over its socket on the motherboard and over its alignment slots in the chassis (see Figure 3-34).
Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3-34 GPU Motherboard Connector and PCIe Riser Alignment Slots SAS1 Riser 1 FAN1 SAS2 1 SAS1 CPU1 SAS1 SAS2 SAS2 FAN2 FAN3 2 Riser 2 FAN4 FAN5 CPU2 3 331842 FAN6 1 PCIe riser 1 alignment slot location 2 PCIe riser 2 alignment slot locations (three) Figure 3-35 3 Motherboard connector GPU PWR Cabling Diagram, Single- and Dual-GPU Card Examples GPU GPU GPU 2 3 1 Motherboard connector GPU PWR 2
Chapter 3 Maintaining the Server Installing or Replacing Server Components Installing Drivers to Support the NVIDIA GPU Cards After you install the hardware, you must update to the correct level of server BIOS and then install NVIDIA drivers and other software. • 1. Update the C240 M3 Server BIOS, page 3-59 • 2. Update the NVIDIA Drivers, page 3-59 1. Update the C240 M3 Server BIOS Table 3-13 lists the minimum server firmware versions for the GPU cards.
Chapter 3 Maintaining the Server Installing or Replacing Server Components Step 2 Create a virtual machine in your hypervisor. Refer to your hypervisor documentation for instructions. Step 3 Install the NVIDIA drivers to the virtual machine. Download the drivers from http://www.nvidia.com/Download/index.aspx. Step 4 Restart the server. Step 5 Check that the virtual machine is able to recognize the NVIDIA card. In Windows, use the Device Manager and look under Display Adapters.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Replacing a Cisco Flexible Flash Card This section includes the following topics: • Overview of the Pre-Installed Cisco Flexible Flash Card, page 3-61 • Enabling a Cisco Flexible Flash Virtual Drive, page 3-62 • Booting a Cisco Flexible Flash Virtual Drive, page 3-62 • Monitoring and Managing a Cisco Flexible Flash Card, page 3-63 • Synchronizing RAID After Installing a Second Cisco FlexFlash Drive, page 3-63 • Cisco Flexibl
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Enabling a Cisco Flexible Flash Virtual Drive Each of the VDs on the pre-installed Cisco Flexible Flash card can be separately enabled or hidden from the host. The default as shipped from the factory is for all VDs to be hidden. To enable VDs and expose them to the host, follow these steps: Step 1 Log in to CIMC interface for the server, using the IP address of the server.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Booting the Hypervisor VD You can boot the hypervisor (HV) VD with a more permanent boot selection. (To change the boot order one time, use the procedure in Booting the Cisco SCU and Cisco HUU Software VDs, page 3-62. To permanently set the boot order for an HV VD, use the following steps: Step 1 Boot the server and watch for the prompt to press F2 to open the BIOS Setup utility.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Cisco Flexible Flash Card Replacement Procedure To install or replace a Cisco Flexible Flash card, follow these steps: Step 1 Caution Step 2 Remove the card that you are replacing. See Figure 3-36: a. Power off the server as described in the “Shutting Down and Powering Off the Server” section on page 3-7. b. Slide the server out the front of the rack far enough so that you can remove the top cover.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Replacing the LSI RAID Battery Backup Unit or SuperCap Power Module This server supports installation of two RAID battery backup units (BBUs) or SuperCap Power Modules (SCPMs). The units mount to clips on the removable air baffle (see Figure 3-37). Note If you are replacing a BBU on an older card, order the iBBU09 battery backup unit (UCS-RAID-BBU=). The newer SuperCap power module is not compatible with older, non-CacheVault cards.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Figure 3-37 Replacing a BBU or SCPM RAID Backup Unit 331851 1 1 RAID backup unit mounting points on removable air baffle Cisco UCS C240 Server Installation and Service Guide 3-66 OL-25761-01
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Installing a Trusted Platform Module The trusted platform module (TPM) is a small circuit board that attaches to a motherboard socket. The socket location is on the motherboard, underneath PCIe riser 1 (see Figure 3-38). Note For security purposes, the TPM is installed with a one-way screw. It cannot be removed with a standard screwdriver.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card f. Step 4 Press F10 to save your settings and reboot the server. Verify that the TPM is now enabled. a. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup. b. Log into the BIOS Setup utility with your BIOS Administrator password. c. Select the Advanced tab. d. Select Trusted Computing to open the TPM Security Device Configuration screen. e. Verify that TPM SUPPORT is Enabled.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Step 1 Verify that a TPM is now installed and enabled in the server: a. Either attach a VGA monitor and USB keyboard to the server, or log in remotely to the CIMC interface of the server and open a virtual KVM console window. b. Reboot the server. c. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup. d. Log in to the BIOS Setup utility with your BIOS Administrator password. Note Step 2 e.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Replacing a SCU Upgrade ROM Module To remove and replace a module, use the following procedure. Step 1 Caution Prepare the server for component installation: a. Power off the server as described in Shutting Down and Powering Off the Server, page 3-7. b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Replacing a Software RAID Key Module To remove and replace a software RAID key module, use the following procedure. Step 1 Caution Prepare the server for component installation: a. Power off the server as described in Shutting Down and Powering Off the Server, page 3-7. b. Slide the server out the front of the rack far enough so that you can remove the top cover.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Replacing Power Supplies The server can have one or two power supplies. When two power supplies are installed they are redundant as 1+1. • See Power Specifications, page A-2 for more information about the power supplies. • See Rear Panel LEDs and Buttons, page 3-4 for information about the power supply LEDs. • See Wiring a DC Power Supply, page 3-73 for information about wiring a DC power supply.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Figure 3-41 Removing and Replacing Power Supplies PCIe 1 PCIe 5 PCIe 4 PCIe 2 PCIe 3 PSU2 1 1 331845 PSU1 2 Power supply handle 2 Power supply release lever Wiring a DC Power Supply Warning A readily accessible two-poled disconnect device must be incorporated in the fixed wiring. Statement 1022 Warning This product requires short-circuit (overcurrent) protection, to be provided as part of the building installation.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Use the following procedure to connect wires to the DC power supply connector: Caution Before beginning this wiring procedure, turn off the DC power source from your facility’s circuit breaker to avoid electric shock hazard. Step 1 Turn off the DC power source from your facility’s circuit breaker to avoid electric shock hazard. Step 2 Remove the DC power connector block from the power supply.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Enabling or Disabling the Internal USB Port The factory default is for all USB ports on the server to be enabled. However, the internal USB port can be enabled or disabled in the server BIOS. To enable or disable the internal USB port, follow these steps: Step 1 Enter the BIOS Setup utility by pressing the F2 key when prompted during bootup. Step 2 Navigate to the Advanced tab. Step 3 On the Advanced tab, select USB Configuration.
Chapter 3 Maintaining the Server Replacing a Cisco Flexible Flash Card Cisco UCS C240 Server Installation and Service Guide 3-76 OL-25761-01
A P P E N D I X A Server Specifications This appendix lists the technical specifications for the server and includes the following sections: • Physical Specifications, page A-1 • Power Specifications, page A-2 • Environmental Specifications, page A-4 Physical Specifications Table A-1 lists the physical specifications for the server. Table A-1 Physical Specifications Description Specification Height 3.4 in. (8.70 cm) Width (including slam-latches) 17.5 in. (44.55 cm) Depth 28.0 in. (71.
Appendix A Server Specifications Power Specifications Power Specifications The power specifications for the two power supply options are listed in the following sections: • 650 W AC Power Supply, page A-2 • 1200 W AC Power Supply, page A-2 • 930W DC Power Supply, page A-3 You can get more specific power information for your exact server configuration by using the Cisco UCS Power Calculator: http://www.cisco.
Appendix A Server Specifications Power Specifications 930W DC Power Supply Table A-4 lists the specifications for each 930 W DC power supply (Cisco part number UCSC-PSU-930WDC).
Appendix A Server Specifications Environmental Specifications Environmental Specifications Table A-5 lists the environmental specifications for the server. Table A-5 Environmental Specifications Description Specification Temperature, operating: 41 to 104°F (5 to 40°C) Derate the maximum temperature by 1°C per every 305 meters of altitude above sea level.
A P P E N D I X B Power Cord Specifications This appendix provides supported power cable specifications. Supported Power Cords and Plugs Each power supply has a separate power cord. Standard power cords or jumper power cords are available for connection to the server. The jumper power cords, for use in racks, are available as an optional alternative to the standard power cords. Note Only the approved power cords or jumper power cords provided with the server are supported.
Appendix B Power Cord Specifications Supported Power Cords and Plugs Table B-1 Supported Power Cords for the Server (continued) Length Description Feet Meters Power Cord Reference Illustration CAB-9K10A-IT Power Cord, 250 VAC 10 A CEI 23-16 Plug Italy 8.2 2.5 Figure B-7 CAB-9K10A-SW Power Cord, 250 VAC 10 A MP232 Plug Switzerland 8.2 2.5 Figure B-8 CAB-9K10A-UK Power Cord, 250 VAC 10 A BS1363 Plug (13 A fuse) United Kingdom 8.2 2.
Appendix B Power Cord Specifications Supported Power Cords and Plugs AC Power Cord Illustrations This section includes the AC power cord illustrations. See Figure B-1 through Figure B-15. Figure B-1 SFS-250V-10A-AR 2500 mm Cordset rating: 10 A, 250/500 V MAX Length: 8.2 ft Plug: EL 219 (IRAM 2073) Figure B-2 186571 Connector: EL 701 (IEC60320/C13) CAB-9K10A-AU Connector: EL 701C (IEC 60320/C15) Plug: EL 206 A.S.
Appendix B Power Cord Specifications Supported Power Cords and Plugs CAB-9K10A-EU Plug: M2511 Cordset rating: 10A/16 A, 250 V Length: 8 ft 2 in. (2.
Appendix B Power Cord Specifications Supported Power Cords and Plugs Figure B-7 CAB-9K10A-IT Cordset rating: 10 A, 250 V Length: 8 ft 2 in. (2.5 m) Connector C15M (EN60320/C15 ) 186575 Plug: I/3G (CEI 23-16) Figure B-8 CAB-9K10A-SW Cordset rating: 10 A, 250 V Length: 8 ft. 2 in (2.
Appendix B Power Cord Specifications Supported Power Cords and Plugs Figure B-10 CAB-AC-250V/13A Connector: EL 701 (IEC60320/C13) Plug: EL312MoldedTwistlock (NEMA L6-20) CAB-N5K6A-NA Plug: NEMA 6-15P Cordset rating: 10 A, 250 V Length: 8.2 ft Connector: IEC60320/C13 Figure B-12 186570 Figure B-11 186568 Cordset rating 13A, 250V (6.6 feet) (79±2m) CAB-9K12A-NA Plug: NEMA 5-15P Connector: IEC60320/C15 192260 Cordset rating 13A, 125V (8.2 feet) (2.
Appendix B Power Cord Specifications Supported Power Cords and Plugs Figure B-13 CAB-C13-CBN, Jumper Power Cord (0.68 m) Connector: HS10S Plug: SS10A Figure B-14 186569 Cordset rating 10A, 250V (686mm) CAB-C13-C14-2M, Jumper Power Cord (2 m) Connector: HS10S Plug: SS10A Figure B-15 336014 Cordset rating 10A, 250V (2.0 m) CAB-C13-C14-AC, Jumper Power Cord (3 m) Plug: SS10A Connector: HS10S 336013 Cordset rating 10A, 250V (3.
Appendix B Power Cord Specifications Supported Power Cords and Plugs Cisco UCS C22 Server Installation and Service Guide B-8 OL-26646-01
A P P E N D I X C RAID Controller Considerations This appendix contains the following sections: • Supported RAID Controllers and Required Cables, page C-2 • LSI Nytro MegaRAID 8110-4i Considerations, page C-4 • Mixing Drive Types in RAID Groups, page C-4 • Battery Backup Units, page C-5 • Factory-Default Option ROM Settings, page C-6 • RAID Controller Migration, page C-7 • Embedded MegaRAID Controller, page C-8 • RAID Controller Cabling, page C-20 • Restoring RAID Configuration After Repl
Appendix C RAID Controller Considerations Supported RAID Controllers and Required Cables Supported RAID Controllers and Required Cables This server supports the RAID controller options, cable requirements, and RAID backup units shown in Table C-1. Caution Table C-1 Do not mix controller types in the server. Do not use the embedded MegaRAID controller and a hardware RAID controller card at the same time. This is not supported and could result in data loss.
Appendix C RAID Controller Considerations Supported RAID Controllers and Required Cables Table C-1 Cisco UCS C240 RAID Options (continued) Controller Style LSI MegaRAID SAS 9266CV-8i PCIe Maximum Drives • SFF/expander: RAID SCPM1 Levels SCPM 24 internal • 0, 1, 5, 6, 10, 50, 60 LFF/expander: Required Cables • (kit pair UCSC-CABLE6) • 12 internal • 24 drives, SFF/expander: 12 drives, LFF/expander: (kit pair UCSC-CABLE4) SFF/no expander: • 8 internal or 16 internal with dual controllers
Appendix C RAID Controller Considerations LSI Nytro MegaRAID 8110-4i Considerations LSI Nytro MegaRAID 8110-4i Considerations Note the following restrictions regarding support of the LSI Nytro MegaRAID 8110-4i card in this server: • This card is not supported with the SFF 16-drive direct-connect backplane version of the server. • This card is supported only in slot 3 of the server. • This card is supported only with the Red Hat Enterprise Linux 6.3 OS.
Appendix C RAID Controller Considerations Battery Backup Units Battery Backup Units This server supports installation of up to two RAID battery backup units (BBUs) or SuperCap power modules (SCPMs). The units mount to clips on the removable air baffle (see Figure 3-37). Note The iBBU09 battery backup unit (BBU) has been phased out by Cisco and replaced with the SuperCap power module (SCPM). If you are replacing a BBU, order the SCPM for the replacement (UCS-RAID-CV-SC=).
Appendix C RAID Controller Considerations Factory-Default Option ROM Settings Factory-Default Option ROM Settings Table C-3 describes the option ROM (OPROM) settings for card slots that are made at the factory for various configurations. The version of server and the number of CPUs affect the OPROM settings. Note If an option is listed as “not allowed” in Table C-3, that is because it is not supported in the particular configuration described in that table row.
Appendix C RAID Controller Considerations RAID Controller Migration 6. You cannot use the embedded SW RAID and HW RAID (mezzanine or PCIe card) at the same time. 7. Control of all 16 drives requires 2 PCIe-style RAID controllers. RAID Controller Migration This server supports hardware RAID (mezzanine and PCIe controller cards) and embedded software RAID. See Table C-4 for which migrations are allowed and a summary of migration steps.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Embedded MegaRAID Controller Note VMware ESX/ESXi or any other virtualized environments are not supported for use with the embedded MegaRAID controller. Hypervisors such as Hyper-V, Xen, or KVM are also not supported for use with the embedded MegaRAID controller. Note The embedded RAID option is available only with the SFF 16-drive backplane. It does not operate through an expander.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller • Enabling the Embedded RAID Controller in the BIOS, page C-11 • Disabling the Embedded RAID Controller in the BIOS, page C-12 • Launching the LSI Embedded RAID Configuration Utility, page C-12 • Installing LSI MegaSR Drivers For Windows and Linux, page C-12 Notes on Supported Embedded MegaRAID Levels The following RAID levels are supported by the embedded MegaRAID controller.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Installing a SCU Upgrade ROM Module For Embedded RAID SAS Support The SCU Upgrade ROM module contains a chip on a small circuit board. This module attaches to a motherboard header. This chip upgrades the standard four-drive SATA support to add SAS support for up to eight drives.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Installing a Software RAID Key Module for Embedded RAID 5 Support The software RAID key module contains a chip on a small circuit board. This module attaches to a motherboard header. This chip upgrades SAS support to add RAID 5 support (RAID 0, 1, 5, and 10 for up to eight drives). Note You must have the SCU upgrade ROM module installed before you can use this module.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Disabling the Embedded RAID Controller in the BIOS Caution Data migration from SW RAID to HW RAID is not supported and could result in data loss. Migrations from SW RAID to HW RAID are supported only before there is data on the drives, or the case in which there are no drives in the server.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Downloading the LSI MegaSR Drivers The MegaSR drivers are included in the C-series driver ISO for your server and OS. Download the drivers from Cisco.com: Step 1 Find the drivers ISO file download for your server online and download it to a temporary location on your workstation: a. See the following URL: http://www.cisco.com/cisco/software/navigator.html b. Click Unified Computing and Servers in the middle column. c.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller d. Step 4 Step 5 Copy the expanded folder to a USB thumb drive. Start the Windows driver installation using one of the following methods: • To install from local media: Connect an external USB DVD drive to the server and then insert the first Windows install disc into the drive. Skip to Step 6. • To install from remote ISO: Log in to the server’s CIMC interface and continue with the next step.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Linux Driver Installation This section explains the steps to install the embedded MegaRAID device driver in a Red Hat Enterprise Linux installation or a SuSE Linux Enterprise Server installation.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Step 5 Open the DOS Command Prompt and navigate to the directory where raw write.exe is located. Step 6 Type the following command to create the installation diskette: raw write Step 7 Press Enter. You are prompted to enter the name of the boot image file. Step 8 Type the following: dud.img Step 9 Press Enter. You are prompted for the target diskette.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Installing the Red Hat Linux Driver For the specific supported OS versions, see the Hardware and Software Interoperability Matrix for your server release. This section describes the fresh installation of the Red Hat Enterprise Linux device driver on systems with the embedded MegaRAID stack. Step 1 Create a RAID drive group using the LSI SWRAID Configuration utility before you install this driver for the OS.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Note Step 10 The noprobe values depend on the number of drives. For example, to install RHEL 5.7 on a RAID 5 configuration with three drives, enter: Linux dd blacklist=isci blacklist=ahci noprobe=ata1 noprobe=ata2 noprobe=ata3 Press Enter. The prompt asks whether you have a driver disk. Step 11 Use the arrow key to select Yes, and then press Enter.
Appendix C RAID Controller Considerations Embedded MegaRAID Controller Step 5 • To install from local media: Connect an external USB DVD drive to the server and then insert the first RHEL install disc into the drive. Skip to Step 6. • To install from remote ISO: Log in to the server’s CIMC interface and continue with the next step. Launch a Virtual KVM console window and select the Virtual Media tab. a. Click Add Image and browse to select your remote RHEL installation ISO file. b.
Appendix C RAID Controller Considerations RAID Controller Cabling RAID Controller Cabling This section includes the following topics: • Cable Routing, page C-20 • Cisco UCS C240 Server Cabling Instructions, page C-21 Cable Routing The RAID controller connectors in this server are shown in Figure C-2. The red line indicates the recommended cable routing path from the backplane to the possible controller locations.
Appendix C RAID Controller Considerations RAID Controller Cabling Cisco UCS C240 Server Cabling Instructions This section contains the following topics: • Backplane and Expander Options, page C-21 • SFF 24-Drive Backplane With Expander Cabling, page C-21 • SFF 16-Drive Backplane, No Expander, page C-22 • LFF 12-Drive Backplane With Expander, page C-23 Backplane and Expander Options The server is orderable in three different versions, each with one of three different front panel/backplane configura
Appendix C RAID Controller Considerations RAID Controller Cabling PCIe-Style Card This option can control up to 24 drives. The required UCSC-CABLE6 cable kit has two cables. Cable 1 controls drives 1–12 and cable 2 controls drives 13–24. 1. Connect cable 1 from connector SAS1 on the card to the SAS1 connector on the expander. 2. Connect cable 2 from connector SAS2 on the card to the SAS2 connector on the expander.
Appendix C RAID Controller Considerations RAID Controller Cabling LFF 12-Drive Backplane With Expander Mezzanine-Style Card This option can control up to 12 drives. The required UCSC-CABLE4 cable kit has two cables. Cable 1 controls drives 1–6 and cable 2 controls drives 7–12. 1. Connect cable 1 from connector SAS1 on the card to the SAS1 connector on the expander. 2. Connect cable 2 from connector SAS2 on the card to the SAS2 connector on the expander.
Appendix C RAID Controller Considerations Restoring RAID Configuration After Replacing a RAID Controller Restoring RAID Configuration After Replacing a RAID Controller When you replace a RAID controller, the RAID configuration that is stored in the controller is lost. Use the following procedure to restore your RAID configuration to your new RAID controller. Step 1 Replace your RAID controller. See Replacing a PCIe Card, page 3-40.
Appendix C RAID Controller Considerations For More Information • LSI SAS2 Integrated RAID Solution User Guide (for LSI SAS 2008) http://www.cisco.com/en/US/docs/unified_computing/ucs/3rd-party/lsi/irsas/userguide/LSI_IR_SAS_UG.
Appendix C RAID Controller Considerations For More Information Cisco UCS C240 Server Installation and Service Guide C-26 OL-25761-01
A P P E N D I X D Installation for Cisco UCS Integration The Cisco UCS integration instructions have been moved to the integration guides found here: Cisco UCS C-Series Server Integration with UCS Manager Guides Refer to the guide that is for the version of Cisco UCS Manager that you are using.
Appendix D Installation for Cisco UCS Integration Cisco UCS C240 Server Installation and Service Guide D-2 OL-25761-01