Brocade FCoE Switch Module for IBM BladeCenter Installation and User’s Guide
Brocade FCoE Switch Module for IBM BladeCenter Installation and User’s Guide Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide iii
Note: Before using this information and the product it supports, read the general information in the IBM Warranty and Support Guide and the IBM Safety Information and the IBM Systems Environmental Notices and User Guide on the IBM Documentation CD. First Edition (April 2010) © Copyright International Business Machines Corporation 2010. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
Contents Safety Chapter 1. Introducing the Brocade FCoE Switch Module Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 Dynamic Ports on Demand. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Switch management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Additional information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Related documentation . . . . . . . . . . . . .
POST activity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 POST-operation LED indications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Chapter 6. Configuring the switch module Establishing a TCP/IP session through the management module. . . . . . . . . 28 Enabling management through external ports . . . . . . . . . . . . . . . . . . . . . . . . 29 Configuring the switch module through the Telnet interface . . . . . . . . . . . . .
Appendix B. Notices Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 Important notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48 Electronic emission notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 Federal Communications Commission (FCC) statement . . . . . . . . . 49 Industry Canada Class A emission compliance statement . . . . . . .
viii Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Safety Before installing this product, read the Safety Information. Antes de instalar este produto, leia as Informações de Segurança. Pred instalací tohoto produktu si prectete prírucku bezpecnostních instrukcí. Læs sikkerhedsforskrifterne, før du installerer dette produkt. Lees voordat u dit product installeert eerst de veiligheidsvoorschriften. Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information. Avant d’installer ce produit, lisez les consignes de sécurité.
Antes de instalar este producto, lea la información de seguridad. Läs säkerhetsinformationen innan du installerar den här produkten. Important: Each caution and danger statement in this document is labeled with a number. This number is used to cross reference an English-language caution or danger statement with translated versions of the caution or danger statement in the Safety Information document.
• Never turn on any equipment when there is evidence of fire, water, or structural damage. • Disconnect the attached power cords, telecommunications systems, networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures. • Connect and disconnect cables as described in the following table when installing, moving, or opening covers on this product or attached devices. To Connect: To Disconnect: 1. Turn everything OFF. 1.
CAUTION: When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following: Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following. Laser radiation when open. Do not stare into the beam, do not view directly with optical instruments, and avoid direct exposure to the beam.
Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.
xiv Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Chapter 1.
• Two internal 100 Mb Ethernet ports to connect to the management module • Up to eight external 10 Gbps CEE ports for connecting small-form-factor pluggable (SFP+) modules • Up to eight external autosensing (2 Gbps, 4 Gbps, or 8 Gbps) Fibre Channel ports for connecting SFP+ modules • One external RS232 console port with a mini-USB interface for serial console management • One external 10/100/1000 Mb RJ45 Ethernet copper port for debugging and field support Dynamic Ports on Demand The base version of the
• A terminal emulation program connection to the mini-USB port interface • A Web browser-based interface (Brocade Web Tools) connection to the switch module • The IBM Chassis Advanced Management Module (AMM) For more information, see “Chapter 6. Configuring the switch module”. Additional information Your high speed switch comes with a one-year limited warranty. For information about your warranty, see the IBM Warranty and Support Information document on the IBM Documentation CD.
• IBM BladeCenter Advanced Management Module User’s Guide • Installation and User’s Guide for the BladeCenter unit • Safety Information Brocade documentation The following related Brocade Communications Systems, Inc. documentation is available from the main Brocade Communications Systems, Inc. Web site, http://www.brocade.com/. Additional related documentation also is available from this Web site. See this Web site for the most recent versions of all related Brocade Communications Systems, Inc.
• • • • • • IBM Safety Information document (multilingual) IBM Environmental Notices and User’s Guide Brocade EULA Brocade CEE Admin guide Brocade CEE CLI guide Brocade MIBS manual If any of these items are missing or damaged, contact your authorized reseller for replacement. Notices and statements in this document The caution and danger statements in this document are also in the multilingual Safety Information document, which is on the IBM BladeCenter Documentation CD for the BladeCenter unit.
1 2 6 5 3 5 6 4 1 RJ45 Ethernet port (eth1) 2 mini-USB console port 3 Fibre Channel ports 4 10GbE FCoE/CEE ports 5 Release latches 6 Release levers FIGURE 1 Major components 6 Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Chapter 2. Installing and replacing a high speed switch module This chapter provides instructions for installing a switch module in the BladeCenter unit and for removing a switch module from the BladeCenter unit. See the documentation for your BladeCenter unit for information about high-speed module bay locations and the components that can be installed in them that is specific to your BladeCenter unit type.
1 2 1 HSSM bays 7 and 8 FIGURE 3 2 HSSM bays 9 and 10 HSSM bays for BladeCenter HT chassis A compatible expansion card or converged network adapter (CNA) must be installed in each blade server that you want to communicate with. To enable the switch module to communicate with a blade server, at least one switch module must be installed in the BladeCenter unit. For details about expansion-card installation, configuration, and use, see the documentation that comes with the expansion card.
• Configuration requirements for the switch module and the BladeCenter unit might vary. You can obtain up-to-date information about the switch module and the BladeCenter unit at http://www.ibm.com/systems/bladecenter/. Installation guidelines Before you install the switch module in the BladeCenter unit, read the following information: • Read the safety information that begins on page v, “Handling static-sensitive devices” on page 10, and the safety statements in the BladeCenter unit documentation.
Cable requirements for the switch module are described in the IBM Configuration and Options Guide at http://www.ibm.com/servers/eserver/xseries/cog/. See the documentation that comes with the blade server for cable-routing information Handling static-sensitive devices Attention: Static electricity can damage the BladeCenter unit and other electronic devices. To avoid damage, keep static-sensitive devices in their static-protective packages until you are ready to install them.
1 2 1 Brocade FCoE Switch Module FIGURE 4 2 Release levers (open position) High speed switch module insertion 1. Read the safety information that begins on page ix and “Installation guidelines” on page 9. 2. Select the high-speed module bay in which to install the switch module. Note: For details about high-speed module bay requirements and bay locations, see the documentation for the BladeCenter unit and blade servers. 3. Remove the filler module from the selected bay.
The switch module takes approximately 60 seconds to complete the POST. When the switch module is turned on, an LED test occurs. All LEDs are lit and remain lit during POST; then, all the LEDs except the OK LED turn off. This indicates normal POST results. To maintain proper airflow, make sure that the ventilation holes on the front of the switch module are not blocked. 10. Make sure that the LEDs on the switch module indicate that it is operating correctly (see “Information LEDs” on page 24). 11.
1 2 1 Brocade FCoE Switch Module FIGURE 5 2 Release levers (open position) High speed switch module removal 1. Read the safety information that begins on page ix, and “Installation guidelines” on page 9. 2. Disconnect any cables from the switch module that you are removing. Removing these cables (especially an Ethernet cable) disrupts the network connection from the external Ethernet port to any connected external Ethernet devices.
14 Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Chapter 3. Installing and removing an SFP+ module The switch module supports both the 8-Gbps and 4-Gbps FC SFP+ transceiver and the 10-Gbps CEE SFP+ transceiver. The SFP+ transceivers are laser products that convert electrical signals to optical signals. For additional information about the location of the switch module, the network interface requirements, and expansion options, see the documentation for your BladeCenter unit.
CAUTION Class 1 Laser Product Laser Klasse 1 Laser Klass 1 Luokan 1 Laserlaite Appareil A` Laser de Classe 1 Installing an SFP+ module The SFP+ module provides two fiber-optic cable connectors for connecting to external ports. To install an SFP+ module, complete the following steps: 1. Read the safety information that begins on page ix and “Installation guidelines” on page 9. 2.
1 2 4 3 1 FC ports 3 Protective cap 2 FCoE/CEE ports 4 SFP+ module FIGURE 6 SFP+ installation 8. Remove the protective cap from the transceiver and connect the fiber optic cable (see “Connecting the SFP+ module cable” on page 20) and any cables that you disconnected earlier. Removing an SFP+ module To remove an SFP+ module, complete the following steps: 1. Read the safety information that begins on page v and “Installation guidelines” on page 9. 2.
3 1 1 Protective cap 2 Wire tab FIGURE 7 2 3 SFP+ module SFP+ removal 5. Grasp the wire tab on the SFP+ module and pull it out of the port. 6. Replace the protective cap on the SFP+ module and the port. 7. Place the SFP+ module into a static-protective package.
Chapter 4. Cabling the switch module and the SFP+ module This chapter describes how to cable the switch module and its optional devices. NOTE The illustrations in this document might differ slightly from your hardware. Connecting the USB console cable To connect the USB console cable to the switch module, connect the cable to the mini-USB console port of the switch module and the other end of the cable to the console device.
Connecting the SFP+ module cable ATTENTION To avoid damage to the fiber optic cables, follow these guidelines: • Do not route the cable along a folding cable-management arm. • When you attach the cable to a device on slide rails, leave enough slack in the cable so that it does not bend to a radius of less than 38 mm (1.5 in.) when the device is extended or become pinched when the device is retracted. • Route the cable away from places where it can be snagged by other devices in the rack.
1 2 4 3 1 FC ports 3 Fiber optic cable 2 CEE ports 4 SFP+ module FIGURE 10 Fiber optic cable insertion 3. Check the LEDs on the switch module. When the switch module is operating correctly, the green link LED is lit. For information about the status of the switch module LEDs, see , “Chapter 5. Information panels, LEDs, and external ports,” on page 23. Disconnecting the SFP+ module cable To disconnect the SFP+ module cable, complete the following steps: 1.
2 1 1 RJ-45 cable FIGURE 11 2 RJ-45 Ethernet port RJ-45 cable connection Disconnecting the RJ-45 cable To disconnect the RJ-45 connector, squeeze the release tab and gently pull the cable connector out of the switch module connector.
Chapter 5. Information panels, LEDs, and external ports This chapter describes the information panels and LEDs on the switch module and identifies the external ports on the information panels.
• One RJ-45 Ethernet port connector. Do not attach any devices to this connector other than a compatible cable. • One mini-USB console port connector used for switch management. This port requires a mini-USB plug on the serial cable. Information LEDs The front panel of the switch module has two sets of LEDs. The power and status/fault LEDs on the left of the switch module indicate the switch module status.
TABLE 2 Switch module status LEDs Status LED Description Status/fault (!) LED (amber) • • Power ( ) LED (green) • • Steady amber. There has been a POST failure or critical alert. Note: When this LED is lit, the system-error LED on the BladeCenter unit is also lit. Off. The switch module is working correctly if the green power LED is on. If the green LED is also off, the switch module is off. Steady green. The switch module is on. Off.
If one or more LEDs do not display a healthy state, verify that the LEDs are not set to beacon. Use the switchShow command or Web Tools to verify the LED state. For information about how to turn beaconing on and off, refer to the Fabric OS Administrator’s Guide or the Web Tools Administrator’s Guide. • Use the blade server chassis’ Management Module to verify that the switch module is working correctly. • Review the system log for errors. Any errors detected during POST are written to the system log.
Chapter 6. Configuring the switch module The switch module has an internal Ethernet path to the management module, eight external CEE ports, eight external FC ports, one external management port, and a serial console port. The switch module supports two remote-access modes for management through Ethernet connections. You can select the mode that is best suited for your BladeCenter environment. • Default mode: The default mode uses the internal path to the management module only.
• When you use the management module Web interface to update the switch module configuration, the management module firmware saves the new configuration in its internal nonvolatile random access memory (NVRAM). If the switch module restarts, the management module applies the saved configuration to the switch module. If the switch module restarts and the management module cannot apply the saved configuration, the switch module defaults to using the configuration that it had previously saved.
4. In the IP address field in the New Static IP Configuration area, type the new TCP/IP address of the switch module; then, click Save. NOTE The management module does not check for invalid IP addresses. 5. Click Advanced Configuration. You can now start a Web session or a Telnet session. The Web interface and the Telnet program provide different ways to access the same internal-switching software and configure it.
1. Log on to the management module as described in the User’s Guide or Command Line Interface Reference Guide for your advanced management module. If necessary, obtain the IP address of the management module from your system administrator. The management module window opens. 2. Click I/O Module Tasks → Configuration and click the bay number that corresponds to the location of the switch module that you installed. 3. Click Advanced Configuration and make sure that external management is enabled. 4.
Configuring the switch module through the mini-USB interface The mini-USB port provides basic communication serial-data transfer through a terminal emulation program (such as Hyperterminal). Because messages from the power-on self-test (POST) and all initialization information are transmitted through the serial port, you can use the serial port to log in to the switch module and access and configure the internal switching software. To log in to the switch module, complete the following steps: 1.
1. On a computer in the same network as the switch module, open a supported web browser, such as Internet Explorer. 2. Enter the IP address of the switch module in the address field. 3. Log into Web Tools using the default administrative account. Login: USERID Password: PASSW0RD where the sixth character is a zero See the Web Tools Administrator’s Guide for more information on using Web Tools. NOTE The passwords that are used to access the switch module are case-sensitive.
4. Type conf t and press Enter. 5. Type int int (press tab to complete the second int) 0/x where x is the internal port you wish to change and press Enter. 6. Once in the particular interface type fcoeport and press Enter. 7. Type no shut and press Enter. 8. Type exit and press Enter. 9. Repeat steps 5-8 for any other blade port you wish to configure. 10. Once finished with all of the blade ports, type exit and press Enter (you should still be in the CMSH at this point). 11.
Resetting the Brocade FCoE Switch Module to factory defaults ATTENTION Restoring the switch module to factory defaults is disruptive. Before beginning, make sure that any program using the high speed switch module has an alternate path to the storage and save the switch module configuration. If the high speed switch module is connected to an existing SAN, disconnect the switch module from the SAN before restoring to factory defaults and then follow proper setup procedures before reconnecting.
Chapter 7. Understanding Access Gateway The Brocade FCoE Switch Module can function in either Fabric OS Native mode or Brocade Access Gateway (AG) mode. Brocade Access Gateway is a Fabric OS feature that lets you configure your Enterprise fabric to handle additional N_Ports instead of domains. By reducing the number of domain IDs and ports you simplify configuration and management in a large fabric. NOTE The Brocade FCoE Switch Module cannot be used as a core AG, only as an edge AG.
Unlike AG in pure FC switches, port mapping in the high speed switch module proceeds from CEE ports to (internal) FCoE ports to FC ports. Since there are 22 CEE ports (both internal and external) and 22 FCoE ports (as a bridge from the CEE side of the high speed switch module to the FC side, the port mapping is one-to-one and no user configuration is required. The 22 FCoE ports, however, must be mapped to the 8 external FC ports.
switch:admin> ag --modeshow Access Gateway mode is enabled. Once AG mode has been enabled, complete the AG configuration. See the Brocade Access Gateway Administrator’s Guide and the Release Notes accompanying the Brocade FCoE Switch Module for details. You should be aware of some operational restrictions in AG on the high speed switch module. • If an N_Port becomes unreliable, its currently active online F_Ports DO NOT failover to another N_Port. They remain on the unreliable N_Port.
38 Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Chapter 8. Updating the firmware This chapter describes how to determine the level of the firmware that is installed on the switch module, how to obtain the latest level of switch firmware, and how to reset the switch module to activate the firmware upgrade. Determining the level of switch module firmware After you install the switch module in the BladeCenter unit, make sure that the latest firmware is installed on the switch module.
Downloading the firmware Once you have found the correct firmware you want to download to the Brocade FCoE Switch Module, you can use either the CLI or Web Tools to do the download. NOTE The firmware download for the Brocade FCoE Switch Module is not non-disruptive. Be sure that no traffic is flowing through the switch during the download process.
Chapter 9. Parts Replaceable components are of three types: • Tier 1 customer replaceable unit (CRU): Replacement of Tier 1 CRUs is your responsibility. If IBM installs a Tier 1 CRU at your request, you will be charged for the installation. • Tier 2 customer replaceable unit (CRU): You may install a Tier 2 CRU yourself or request IBM to install it, at no additional charge, under the type of warranty service that is designated for your server.
42 Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Chapter 10. Solving problems This section provides basic troubleshooting information to help you solve some problems that might occur while you are setting up the switch module. If you cannot locate and correct a problem by using the information in this section, see Appendix A, “Getting help and technical assistance,” on page 43. Running POST To ensure that it is fully operational, the switch module processes a series of tests during power-up or a restart (power-on self-test, or POST).
TABLE 7 Error listing Diagnostic indicator (in hex) Failing functional area Failure criticality 00 - 7F Base internal functions Critical 80 - 9F Internal interface failures Noncritical A0 - AF External interface errors Noncritical B0 - FE Reserved Noncritical FF Switch module “good” indicator Operation 44 Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Appendix A. Getting help and technical assistance If you need help, service, or technical assistance or just want more information about IBM products, you will find a wide variety of sources available from IBM to assist you. This section contains information about where to go for additional information about IBM and IBM products, what to do if you experience a problem with your system, and whom to call for service, if it is necessary.
Getting help and information from the World Wide Web On the World Wide Web, the IBM Web site has up-to-date information about IBM systems, optional devices, services, and support. The address for IBM System x® and xSeries® information is http://www.ibm.com/systems/x/. The address for IBM BladeCenter information is http://www.ibm.com/systems/bladecenter/. The address for IBM IntelliStation® information is http://www.ibm.com/intellistation/.
Appendix B. Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc., in the United States, other countries, or both and is used under license therefrom. Intel, Intel Xeon, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc., in the United States, other countries, or both.
Electronic emission notices Federal Communications Commission (FCC) statement Note: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment.
United Kingdom telecommunications safety requirement Notice to Customers This apparatus is approved under approval number NS/G/1234/J/100003 for indirect connection to public telecommunication systems in the United Kingdom. European Union EMC Directive conformance statement This product is in conformity with the protection requirements of EU Council Directive 2004/108/EC on the approximation of the laws of the Member States relating to electromagnetic compatibility.
Dieses Produkt entspricht dem “Gesetz über die elektromagnetische Verträglichkeit von Geräten (EMVG)”. Dies ist die Umsetzung der EU-Richtlinie 2004/108/EG in der Bundesrepublik Deutschland. Zulassungsbescheinigung laut dem Deutschen Gesetz über die elektromagnetische Verträglichkeit von Geräten (EMVG) (bzw. der EMC EG Richtlinie 2004/108/EG) für Geräte der Klasse A Dieses Gerät ist berechtigt, in Übereinstimmung mit dem Deutschen EMVG das EG-Konformitätszeichen - CE - zu führen.
Russia Electromagnetic Interference (EMI) Class A statement People's Republic of China Class A warning statement Taiwanese Class A warning statement 52 Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Appendix C.
Environmental requirements The information in Table 10 shows the operating and nonoperating requirements of the high speed switch module. TABLE 10 Environmental requirements Condition Operating Non-operating Temperature (low altitude) 0° -20° to 70° C (-4°F to 158° F) Humidity 10% to 90% RH non-condensing at 29° C 5% to 95% RH non-condensing at 38° C Altitude up to 3.048 km (10,000 ft) above sea level up to 10.
• FC-GS-5 ANSI INCITS 427:2006 • FC-FS-2 ANSI INCITS 424:2006 (includes the (includes the following) following) • FC-GS-4 ANSI INCITS 387:2004 • FC-FS INCITS 372:2003 • FC-IFR Rev 1 • FC-LS rev 1.51 (under development) • FC-SW-4 INCITS 418:2006 (includes • FC-BB-3 INCITS 414:2006 (includes the following) the following) • FC-BB-2 INCITS 372:2003 • FC-SW-3 INCITS 384:2004 • FC-SB-3 INCITS 374:2003 (replaces FC-SB ANSI X3.
56 Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
Index A Access Gateway and Fabric OS Native mode, 35 edge AG requirement, 35 enabling and disabling, 36 fabric information erased, 36 operational restrictions, 37 port configuration, 35 port mapping, 36 understanding, 35 Access Gateway mode verifying, 36 additional documentation, 3, 4 air flow, 54 components switch, 53 configUpload command, 33 configuration backing up, 33 default mode, 27 FCoE, 32 initial, 32 remote management mode, 27 resetting, 34 switch, 27 via mini-USB port, 31 via Web Tools, 31 conver
statement, 49 Japanese VCCI Class A statement, 51 Korean Class A warning statement, 51 People’s Republic of China Class A warning statement, 52 Russia Electromagnetic Interference (EMI) Class A statement, 52 Taiwanese Class A warning statement, 52 United Kingdom telecommunications safety requirement, 50 enabling Access Gateway, 36 disruptive, 36 transaction buffers, 36 environmental requirements, 54 error codes, 43 errors, critical and noncritical, 43 errShow command, 26 Ethernet cable connecting, 21 discon
notices, 47 NPIV, 35 N-Port ID Virtualization, see NPIV O operating requirements, 54 optical cabling, 20 P parts listing, 41 password, default, 30, 31, 32 POD license removal, 2 port licensing, 2 port licensing, 2 port mapping for Access Gateway, 36 port status LEDs, 25 port types, Fabric OS Native mode, 35 Ports on Demand, see POD POST, 43 errors, 43 LED patterns, 26 results, 25 processor, 53 R regulatory compliance, 55 reliability guidelines, 9 S safety statements, ix serial port settings, 31 setting
60 Brocade FCoE Switch Module for IBM BladeCenter: Installation and User Guide
1
Part Number: 60Y1582 Printed in USA (IP) P/N: 60Y1582 *60Y1582* 2
