Cisco MDS 9124e Fabric Switch for HP c-Class BladeSystem user guide Part number: AA-RWEBA-TE Second edition: September 2007
Legal and notice information © Copyright 2007 Hewlett-Packard Development Company, L.P © Copyright 2007 Cisco Systems Inc. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Contents About this guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 Intended audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Related documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Contacting HP Technical Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . HP contact information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3 Managing the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Management features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Maintaining the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Installing dust covers in empty ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Supported SFPs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Supported HBAs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Contents
About this guide This guide provides information about setting up and configuring the Cisco MDS 9124e Fabric Switch for HP c-Class BladeSystem. Throughout this guide the short product name is used, Cisco MDS 9124e Switch.
• In the United States, for contact options see the Contact HP United States web page: http://welcome.hp.com/country/us/en/contact_us.html • Call 1-800-HP-INVENT (1-800-474-6836). This service is available 24 hours a day, 7 days a week. For continuous quality improvement, calls may be recorded or monitored. • If you have purchased a Care Pack (service upgrade), call 1-800-633-3600. For more information about Care Packs, refer to the HP web site: http://www.hp.
IMPORTANT: Provides clarifying information or specific instructions. NOTE: Provides additional information. TIP: Provides helpful hints and shortcuts. Subscription service HP strongly recommends that customers register online using the Subscriber’s choice web site: http://www.hp.com/go/e-updates.
About This Guide
1 Overview The Cisco MDS 9124e Fabric Switch for HP c-Class BladeSystem (referred to hereafter as the Cisco MDS 9124e Fabric Switch) is a Fibre Channel (FC) switch that supports link speeds of up to 4 Gb. The Cisco MDS 9124e Fabric Switch can operate in a fabric containing multiple switches or as the only switch in a fabric.
• • • • • • • • Heterogeneous support for mixed storage fabrics Power supplied and controlled by the BladeSystem enclosure Identification to HP chassis management via HP specified SEEPROMs Hot-swap capability Compatible with redundant and dual redundant switch configurations in c-Class BladeSystem Hot code activation Real-time clock SFP port monitoring Component identification Figure 1 and Table 2 identify the physical components of the Cisco MDS 9124e Fabric Switch.
Port side of the Switch Figure 2 and Table 3 identify Cisco MDS 9124e Fabric Switch external ports (ports EXT 1 through EXT 4 and ports EXT 5 through EXT 8).
Switch licensing The Cisco MDS 9124e Fabric Switch integrates one of two license options that complement existing HP product lines. Models and their specific licenses are described next: • Cisco MDS 9124e Fabric Switch for HP c-Class BladeSystem, base, integrating 12 active ports (8 internal and 4 external) and two preinstalled short wavelength SFPs. Software components includes Cisco Fabric Manager and Cisco Device Manager.
Optional hardware kits Table 4 lists optional hardware kits that support the switch. For additional options, go to the HP web site: http://www.hp.
Overview
2 Setup This chapter provides the following information: • • • • • • Shipping carton contents Installation and safety considerations Installing the switch Setting the IP address Configuring the switch Recovering the admin password Shipping carton contents The Cisco MDS 9124e Fabric Switch for HP c-Class BladeSystem kit shipping carton contains three items, identified in Figure 3 and Table 5: • Cisco MDS 9124e Fabric Switch for HP c-Class BladeSystem installation instructions • Small bag containing black,
Table 5 Cisco MDS 9124e Fabric Switch components Item Description 2 Dust covers for empty SFP ports 3 Cisco MDS 9124e Fabric Switch for HP c-Class BladeSystem installation guide Installation and safety considerations The Cisco MDS 9124e Fabric Switch installs in the I/O bays in the rear of the HP c-Class BladeSystem enclosure. Refer to the HP BladeSystem c7000 Enclosure setup and installation guide for specific enclosure requirements.
1. Locate the appropriate interconnect bay in the rear of the enclosure per the HP BladeSystem c7000 Enclosure setup and installation guide provided with your enclosure. 2. Remove the slot cover, if installed. IMPORTANT: Populate all enclosure I/O bays with the appropriate component; for example a switch, Pass-Thru, or one of the blank panels provided with the enclosure. CAUTION: Properly ground yourself before handling the switch. 3. Press the handle latch to release the installation handle.
4 EXT 5 EXT 5 EXT 8 EXT 7 EXT 8 Cisco MDS 9124 181737 e Figure 5 Installing the Cisco MDS 9124e Fabric Switch into an interconnect bay 6. Press the installation handle into the latch to lock the switch in place. OA power verification As defined earlier, the HP BladeSystem Onboard Administrator (OA) is the enclosure management tool that manages the devices contained within the enclosure.
Checking LEDs See Figure 6 to locate power-on LEDs. 1 EXT 1 EXT 2 EXT 3 EXT 4 181738 ! : 2 Figure 6 Verifying power-on LEDs Verify that the LEDs match the indicators described in Table 7. Table 7 Power-on LEDs Item Description Indicators 1 UID LED - used to help user locate a specific Off Health ID LED Steady green light 2 module in the BladeSystem for replacement, etc.
• In a UNIX environment, type: tip /dev/ttyb –9600 5. Log into the OA. 6. Identify the interconnect bay number where the switch is installed. 7. Type the following at the command line: OA> connect interconnect x Where x is the interconnect bay number where the switch is installed. If you are using the switch for the first time, the switch setup utility starts automatically. If this is not the first time the switch has been used, enter the setup command at the system prompt. 8.
Configuring the Switch The Cisco MDS 9124e Fabric Switch must be configured to ensure correct operation within a network and fabric. For instructions about configuring the switch to operate in a fabric containing switches from other vendors, refer to the HP StorageWorks SAN Design reference guide: http://h18000.www1.hp.com/products/storageworks/san/documentation.html For more information about the CLI, refer to the Cisco MDS 9000 Family CLI Configuration Guide.
Setting the date and time Date and time are used for logging events. Cisco MDS 9124e Fabric Switch operation does not depend on the date and time. A switch with an incorrect date and time value will function properly. To set the date and time using the CLI: 1. If you have not already done so, connect to the switch and log in as admin. 2.
Modifying the FC domain ID (optional) If desired, you can modify the domain ID. If the Cisco MDS 9124e Fabric Switch is not powered on until after it is connected to the fabric and the default FC domain ID is already in use, the domain ID for the new switch is automatically reset to a unique value. If the switch is connected to the fabric after is has been powered on and the default domain ID is already in use, the fabric segments.
Verifying the configuration Use the show interface and show module commands to verify switch configuration. The following shows how to enter the show interface command: switch# show interface ext1 The following shows how to enter the show module command: switch# show module Backing up the configuration Use the copy running-config startup-config command to back up switch configuration.
10.Enter a new admin password. switch(boot)(config)# admin-password switch(boot)(config)# exit switch(boot)# 11. View the system image in bootflash. switch(boot)# dir bootflash: For example: m9100-s2ek9-mz.3.1.3a.bin 12. Load the system image. switch(boot)# load bootflash:system_image For example: load bootflash:m9100-s2ek9-mz.3.1.3a.bin 13. Verify that you now see the Cisco MDS 9124e Switch login prompt, switch login#. 14.
Set Up
3 Managing the Switch This chapter provides the following information: • • • • • • • Management features Maintaining the switch Replacing the switch Powering on and off Interpreting LED activity POST and boot specifications Interpreting POST results Management features The management tools built into the Cisco MDS 9124e Switch (listed in Table 8) can be used to monitor fabric topology, port status, physical status, and other information used for performance analysis and system debugging.
The gateway address of the first switch should be set to whatever the gateway address is for the subnet on which the first switch resides. See Table 9. Table 9 Connecting via a management station Management station First switch Second switch Third switch Ethernet 192.168.1.09 192.168.1.10 204.1.1.11 204.1.1.12 FCIP 192.168.65.09 192.168.65.10 192.168.65.11 192.168.65.12 Gateway 192.168.1.10 192.168.1.10 192.168.1.
scale: 3/8" = 1" EX EX EX EX T T 6 T T CO 8 CIS 7 Cis co MD S 91 24 e 5 1 20 19 18 2 181867 17 Figure 7 Installing an SFP Table 10 SFP components Item Description 1 Bail 2 SFP 3. Insert the SFP into the port until you hear a click. 4. Close the bail. Replacing the Switch In some cases, you may need to replace a Cisco MDS 9124e Switch. To replace a Cisco MDS 9124e switch in the HP BladeSystem c-Class enclosure: 1. Create a backup of the existing configuration file.
7. Create an admin password when prompted by the switch. 8. Continue with the setup configuration and enter the appropriate information that matches the Cisco MDS 9124e Switch that you removed. 9. Install the same Cisco MDS SAN-OS release as was installed on the Cisco MDS 9124e Switch that was removed. Refer to the Cisco MDS 9000 Family Fabric Manager Configuration Guide and the Cisco MDS 9000 Family CLI Configuration Guide for installation instructions. 10.
Interpreting LED activity You can monitor switch activity and status by checking the switch LEDs. There are three possible LED states: no light, a steady light, or a flashing light. The steady lights and flashing lights can be green or amber. The LEDs flash any of these colors during boot, POST, or other diagnostic tests. This is normal and does not indicate a problem unless the LEDs do not indicate a healthy state after all boot processes and diagnostic tests are complete.
LED patterns Table 12 summarizes LED color and meaning. Table 12 Port link status LED patterns LED color Status of Hardware Solid green Link is up. Steady flashing green Link is up (beacon used to identify port). Flashing green Link is up (traffic on port). Solid amber Link is disabled by software. Flashing amber A fault condition exists. Off No link.
Boot Boot completes in approximately three minutes if POST is run.
Managing the Switch
A Regulatory compliance and safety Regulatory compliance Federal Communications Commission notice for Class A equipment This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment.
Regulatory compliance identification numbers For the purpose of regulatory compliance certifications and identification, your product has been assigned a unique Regulatory Model Number. The RMN can be found on the product nameplate label, along with all required approval markings and information. When requesting compliance information for this product, always refer to this RMN. The Regulatory Model Number should not be confused with the marketing name or model number of the product.
Figure 9 Class 1 laser product label This optional label indicates that the product is classified as a CLASS 1 LASER PRODUCT. This label may appear on the laser device installed in your product. International notices and statements Canadian notice (avis Canadien) Class A equipment This Class A Digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations.
BSMI notice Japanese notice Korean notices 40 Regulatory compliance and safety
Safety Battery replacement notice Your switch is equipped with a lithium manganese dioxide, a vanadium pentoxide, or an alkaline internal battery or battery pack. There is a danger of explosion and risk of personal injury if the battery is incorrectly replaced or mistreated. Replacement is to be done by an HP authorized service provider using the HP spare part designated for this product. For more information about battery replacement or proper disposal, contact an HP authorized service provider.
Japanese power cord statement Waste Electrical and Electronic Equipment directive English notice Dutch notice Verwijdering van afgedankte apparatuur door privé-gebruikers in de Europese Unie Dit symbool op het product of de verpakking geeft aan dat dit product niet mag worden gedeponeerd bij het normale huishoudelijke afval. U bent zelf verantwoordelijk voor het inleveren van uw afgedankte apparatuur bij een inzamelingspunt voor het recyclen van oude elektrische en elektronische apparatuur.
Czechoslovakian notice Estonian notice Seadmet e jäätmete kõrvaldamine eramajapidamistes Euroo pa Liidus See tootel või selle pakendil olev sümbol näitab, et kõnealust toodet ei tohi koos teiste majapidamisjäätmetega kõrvaldada. Teie kohus on oma seadmete jäätmed kõrvaldada, viies need elektri- ja elektroonikaseadmete jäätmete ringlussevõtmiseks selleks ettenähtud kogumispunkti.
French notice Élimination des appareils mis au rebut par les ménages dans l'Union européenne Le symbole apposé sur ce produit ou sur son emballage indique que ce produit ne doit pas être jeté avec les déchets ménagers ordinaires. Il est de votre responsabilité de mettre au rebut vos appareils en les déposant dans les centres de collecte publique désignés pour le recyclage des équipements électriques et électroniques.
Greek notice . , . . , , . Hungarian notice Készülékek magánháztartásban történ selejtezése az Európai Unió területén A készüléken, illetve a készülék csomagolásán látható azonos szimbólum annak jelzésére szolgál, hogy a készülék a selejtezés során az egyéb háztartási hulladéktól eltér módon kezelend . A vásárló a hulladékká vált készüléket köteles a kijelölt gy jt helyre szállítani az elektromos és elektronikai készülékek újrahasznosítása céljából.
Italian notice Smaltimento delle apparecchiature da parte di privati nel territorio dell'Unione Europea Questo simbolo presente sul prodotto o sulla sua confezione indica che il prodotto non può essere smaltito insieme ai rifiuti domestici. È responsabilità dell'utente smaltire le apparecchiature consegnandole presso un punto di raccolta designato al riciclo e allo smaltimento di apparecchiature elettriche ed elettroniche.
Lithuanian notice Polish notice Pozbywanie si zu ytego sprz tu przez u ytkowników w prywatnych gospodarstwach domowych w Unii Europejskiej Ten symbol na produkcie lub jego opakowaniu oznacza, e produktu nie wolno wyrzuca do zwyk ych pojemników na mieci. Obowi zkiem u ytkownika jest przekazanie zu ytego sprz tu do wyznaczonego punktu zbiórki w celu recyklingu odpadów powsta ych ze sprz tu elektrycznego i elektronicznego.
Slovakian notice Slovenian notice Spanish notice Eliminación de residuos de equipos eléctricos y electrónicos por parte de usuarios particulares en la Unión Europea Este símbolo en el producto o en su envase indica que no debe eliminarse junto con los desperdicios generales de la casa. Es responsabilidad del usuario eliminar los residuos de este tipo depositándolos en un "punto limpio" para el reciclado de residuos eléctricos y electrónicos.
Swedish notice Bortskaffande av avfallsprodukter från användare i privathushåll inom Europeiska Unionen Om den här symbolen visas på produkten eller förpackningen betyder det att produkten inte får slängas på samma ställe som hushållssopor. I stället är det ditt ansvar att bortskaffa avfallet genom att överlämna det till ett uppsamlingsställe avsett för återvinning av avfall från elektriska och elektroniska produkter.
Regulatory compliance and safety
B Electrostatic discharge This appendix provides the following information: • How to prevent electrostatic discharge • Grounding methods How to prevent electrostatic discharge To prevent damage to the system, you must follow certain precautions when setting up the system or handling parts. A discharge of static electricity from a finger or other conductor may damage system boards or other static-sensitive devices. This type of damage may reduce the life expectancy of the device.
Electrostatic discharge
C Switch technical specifications This appendix provides the following information: • • • • • General specifications Weight and physical dimensions Environmental requirements Supported HBAs Supported SFPs General specifications Table 13 lists general specifications for the Cisco MDS 9124e Switch. Table 13 General specifications Specification Description Configurable port types F_Port, FL_Port, and E_Port Media types Small Form-Factor Pluggable (SFP) laser. 1/2/4Gb short wave up to 500 m (1,640 ft.
Specification Description EMC immunity • • • • • • • • • System architecture Nonblocking shared-memory switch ANSI protocol FC-PH (FC Physical and Signalling Interface standard) Modes of operation FC Class 2, Class 3, and Class F Maximum frame size 2112-byte Port-to-port latency 1.2 ì sec. with no contention, cut-through routing at 4Gb. Latency increases as input port speed increases and becomes disparate from output port speed.
Environmental requirements To ensure proper operation, the switch must not be subjected to environmental conditions beyond those for which it was tested. The ranges specified in Table 16 list the acceptable environment for both operating and non-operating conditions.
Switch technical specifications
Glossary This glossary defines terms used in this guide or related to this product. It is not a comprehensive glossary of computer terms. AL_PA EE_Credit Arbitrated loop physical address. A unique 8-bit value assigned during loop initialization to a port in an arbitrated loop. See also non-participating mode. alias server A fabric software facility that supports multicast group management. API Application programming interface.
defined zone configuration The set of all zone objects defined in the fabric. May include multiple zone configurations. See also zone, zone configuration. directory service See SNS. DLS Dynamic load sharing. Dynamic distribution of traffic over available paths. Allows for recomputing of routes when an Fx_Port or E_Port changes status. domain ID Unique identifier used in routing frames for all switches in a fabric. Usually assigned by the principal switch, but can be assigned manually.
Fibre Channel The primary protocol for building SANs to transmit data between servers, switches, and storage devices. Unlike IP and Ethernet, Fibre Channel is designed to support the needs of storage devices of all types. It is a high-speed, serial, bidirectional, topology-independent protocol, and is a highly scalable interconnection between computers, peripherals, and networks. fill word An IDLE or ARB ordered set that is transmitted during breaks between data frames to keep the link active.
L_Port Loop port. A node port (NL_Port) or fabric port (FL_Port) that has arbitrated loop capabilities. An L_Port can be in one of two modes: • Fabric mode: Connected to a port that is not loop capable and is using fabric protocol. • Loop mode: In an arbitrated loop and using loop protocol. An L_Port in loop mode can also be in participating mode or non-participating mode. See also non-participating mode. latency The time required to transmit a frame from the time it is sent until it arrives.
node An FC device that contains an N_Port or NL_Port. non-participating mode A mode in which an L_Port in a loop is inactive and cannot arbitrate or send frames, but can retransmit any received transmissions. This mode is entered if there are more than 127 devices in a loop and an AL_PA cannot be acquired. See alsoL_Port, AL_PA. Nx_Port A node port that can operate as an N_Port or NL_Port.
R_A_TOV Resource allocation time-out value. The maximum time a frame can be delayed in the fabric and still be delivered. RAID Redundant Array of Independent Disks. A collection of disk drives that appear as a single volume to the server and are fault tolerant through mirroring or parity checking. request rate The rate at which requests arrive at a servicing entity. route With respect to a fabric, the communication path between two switches.
topology With respect to FC, the configuration of the FC network and the resulting communication paths allowed. There are three possible topologies: • Point-to-point: A direct link between two communication ports • Switched fabric: Multiple N_Ports linked to a switch by F_Ports • Arbitrated loop: Multiple NL_Ports connected in a loop transmission character A 10-bit character encoded according to the rules of the 8b/10b algorithm. transmission word A group of transmission characters.
Glossary
Index A admin password recovery 26 audience 7 B indicators 33 licenses base 14 full 14 verifying 24 long wavelength 11 boot specifications 35 M C management Fabric Manager 29 managerment CLI 29 command line interface 23 conventions document 8 text symbols 8 P EIA 58 environmental requirements 55 Ethernet connection 29 password recovery 26 port channel 14 ports external 11 internal 11, 13 switch, port side 13 types 11 POST specifications 34 powering off and on 32 G S D document conventions 8 E
maintenance 30 management 29 replacement 31 setting the date and time 24 setting the IP address 21 symbols in text 8 T text symbols 8 66 Index
Cisco MDS 9124e Fabric Switch for HP c-Class BladeSystem 67
Index
