HP 1:10Gb Ethernet BL-c Switch User Guide Part Number 445876-001 May 2007 (First Edition)
© Copyright 2007 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Microsoft, Windows, and Windows NT are U.S.
Contents Introduction .................................................................................................................................. 6 Additional references................................................................................................................................. 6 Features ................................................................................................................................................... 6 Enterprise class performance................
Installing XFP transceivers ......................................................................................................................... 24 Supporting software and special considerations .......................................................................................... 24 Replacing a switch...................................................................................................................... 26 Replacing an existing switch ................................................
Cannot connect to the switch console interface remotely using SSH................................................................ 57 Cannot connect to the switch SNMP interface ............................................................................................. 57 The port activity LEDs continuously indicate activity after connecting more than one port to another switch or destination device ............................................................................................................
Introduction In this section Additional references................................................................................................................................ 6 Features .................................................................................................................................................. 6 Switch architecture ...................................................................................................................................
• 9K jumbo frames that improve performance by increasing application throughput and decreasing server processor utilization • Robust configuration and management from any switch port using the included browser-based and scriptable command line user interfaces.
Switch redundancy In a dual switch configuration, the switches offer several redundancy and failover features. With these features, the network configuration is designed to allow for continued network access to each server blade in case of a component or link failure.
• A text-based, human read/write configuration file provides viewing, printing, and editing capabilities. • A DNS client supports primary and secondary DNS servers. • Any port can be enabled or disabled as desired. • Any switch port can be used to perform switch management and PXE.
ten Gigabit external Ethernet ports and sixteen internal Gigabit Ethernet ports providing connectivity to the blade servers within the enclosure. Redundant crosslinks In a dual switch configuration, the two switches are connected through a single ten gigabit crosslink. This crosslink provides throughput of ten Gb/s for traffic between the switches. This crosslink is disabled by default. This crosslink must be enabled for use.
• High availability VRRP Layer 3 switching provides more power, flexibility, and security capabilities to network administrators. Network traffic is managed much more efficiently and broadcast traffic between servers remains within the enclosure. Security features provide added protection for switch configuration data, while packet filtering helps secure and segment sensitive traffic or network access. IEEE 802.1 Q-based VLAN The switch provides support for a total of 1000 IEEE 802.
are members of a specific IP network. This is achieved by configuring the address/mask of that specific network as a restricted management network address/mask. Port mirroring The switch allows mirroring of one or multiple ports (source ports) to another port (destination port) for network monitoring and troubleshooting purposes.
RADIUS The switch supports the RADIUS method to authenticate and authorize remote administrators for managing the switch. This method is based on a client/server model. The RAS, the switch, is a client to the back-end database server. A remote user (the remote administrator) interacts only with the RAS, not the back-end server and database.
• The accounting attributes of protocol, start_time, stop_time, and elapsed_time. For BBI users, accounting stop records are only sent if the user presses the QUIT button. SSH and SCP SSH and SCP use secure tunnels to encrypt and secure messages between a remote administrator and the switch. Telnet does not provide this level of security. The Telnet method of managing a switch does not provide a secure connection.
through a procedure called auto-negotiation. Auto-negotiation involves probing the capability of the network using low-level signaling techniques to select compatible Ethernet speeds. Auto-negotiation was originally developed to make the migration from traditional Ethernet to Fast Ethernet products easier. Redundant images in firmware The switch stores up to two different software images, called image1 and image2, as well as boot software, called boot.
Component identification In this section 1:10Gb Ethernet Blade Switch front panel ................................................................................................ 16 1:10Gb Ethernet Blade Switch front panel CAUTION: Pressing the Reset button while the Health LED is green resets the switch. Item Description 1 UID LED 2 Health LED • Off—Not powered up • Green—Powered up and all ports match • Amber—Indicates a problem such as a port mismatch.
Item Description 6 XFP transceiver cage port 21 7 • Green—Link LED (top) • Flashing green—Activity LED (bottom) RJ-45 ports 22-25 Speed LED (right) • Off—10 Mb/s • Green—100 Mb/s • Amber—1 Gb/s Activity/Link LED (left) 8 • Green—Link • Flashing green—Activity Reset button Component identification 17
Installing the switch In this section Preparing for installation ......................................................................................................................... 18 Planning the switch configuration ............................................................................................................. 18 Installing the switch ................................................................................................................................
• Switch IP settings • VLAN settings • XFP settings • Port names and types • Port trunking settings • Interswitch X-Connect port settings • SNMP settings • User name and password settings • Default access to various management interfaces • NTP settings IMPORTANT: See "Runtime switching software default settings (on page 33)" for a complete list of default configuration settings.
NOTE: It is recommended to change the default switch passwords after initial configuration and as regularly as required under the network security policies. For more information, see the HP 1:10Gb Ethernet BL-c Switch Command Reference Guide. The default user name and password for each access level are: User account Description and tasks performed Password User The user has no direct responsibility for switch management.
Switch IP addresses are acquired by default using BOOTP, therefore, each switch has a unique IP address. Each switch is remotely accessed from a central deployment server and an individual switch configuration is downloaded to meet specific network requirements. See the HP 1:10Gb Ethernet BL-c Switch Command Reference Guide for additional information on using a TFTP server to upload and download configuration files. Installing the switch CAUTION: Do not cable the switch until after configuration.
A successful installation is indicated by a green Health LED. If the Health LED is amber or power is not applied to the switch, see the "Troubleshooting" section of the HP BladeSystem enclosure setup and installation guide for more information. Accessing the switch The switch is accessed remotely using the Ethernet ports or locally using the DB-9 management serial port. To access the switch remotely: 1. Assign an IP address.
NOTE: If the switch does not obtain the IP address by means of the BOOTP service, access the switch locally and configure the IP address manually. After assigning the IP address to the switch, then access the switch remotely. To access the switch locally: 1. Connect the switch DB-9 serial connector, using a null-modem serial cable to a local client device (such as a laptop computer) with VT100 terminal emulation software. 2.
Installing XFP transceivers CAUTION: To prevent damage to the fiber optic cable or the XFP transceiver, do not install or remove fiber-optic XFP transceivers with cables attached. Disconnect all cables from the XFP transceiver before removing or installing an XFP transceiver. CAUTION: Removing and installing an XFP transceiver can shorten the useful life. Do not remove and insert XFP transceivers more often than is necessary.
• Firmware Upgrade Smart Component (for Microsoft Windows only)—Provides quick and easy installation of the switch firmware, firmware upgrade tool, and readme file. A SoftPaq is available for use with Linux operating systems. The utilities package and documentation, and the SoftPaq listed above, are available on the HP website (http://www.hp.com/go/bladesystem/documentation).
Replacing a switch In this section Replacing an existing switch.................................................................................................................... 26 Replacing an existing switch CAUTION: Removing the switch from a powered enclosure results in the loss of network communications between the server blade network ports that are connected through this switch and the segment of network infrastructure those ports need to communicate.
5. Close the ejector lever and wait for the switch boot up completely. 6. If the configuration file was saved to a TFTP server, download the configuration. For more information on downloading a configuration file, see the HP 1:10Gb Ethernet BL-c Switch Command Reference Guide.
Regulatory compliance notices In this section Class A equipment ................................................................................................................................. 28 Modifications......................................................................................................................................... 28 Cables ..................................................................................................................................................
European Union regulatory notice This product complies with the following EU Directives: • Low Voltage Directive 2006/95/EC • EMC Directive 2004/108/EC Compliance with these directives implies conformity to applicable harmonized European standards (European Norms) which are listed on the EU Declaration of Conformity issued by Hewlett-Packard for this product or product family.
Korean class A notice Laser compliance This product may be provided with an optical storage device (that is, CD or DVD drive) and/or fiber optic transceiver. Each of these devices contains a laser that is classified as a Class 1 Laser Product in accordance with US FDA regulations and the IEC 60825-1. The product does not emit hazardous laser radiation. Each laser product complies with 21 CFR 1040.10 and 1040.11 except for deviations pursuant to Laser Notice No.
Technical specifications In this section General specifications ............................................................................................................................ 31 Port names, VLANs, STP, trunking default settings....................................................................................... 32 Runtime switching software default settings................................................................................................
Category Specification 100Base-TX Two Pair or Four Pair UTP Category 5 (100 m) EIA/TIA-568 100-ohm STP (100 m) 1000Base-T Four Pair UTP Category 5e (100 m) EIA/TIA-568 100-ohm STP (100 m) 10 Gb multimode fiber cable 62.5/125 or 50/125 microns 10 Gb singlemode fiber cable 9/25 micron 10 Gb CX4 copper cable Use only these approved HP cables: Number of ports per switch: • HP BLadeSystem c-Class .
Port type Port number Port name STP Server 4 Downlink4 Disabled Server 5 Downlink5 Disabled Server 6 Downlink6 Disabled Server 7 Downlink7 Disabled Server 8 Downlink8 Disabled Server 9 Downlink9 Disabled Server 10 Downlink10 Disabled Server 11 Downlink11 Disabled Server 12 Downlink12 Disabled Server 13 Downlink13 Disabled Server 14 Downlink14 Disabled Server 15 Downlink15 Disabled Server 16 Downlink16 Disabled X-Connect 17 XConnect1 Enabled Mgmt 1
Setting Value Primary default gateway 0.0.0.0 Secondary default gateway 0.0.0.0 Primary DNS server address 0.0.0.0 Secondary DNS server address 0.0.0.0 Default domain name None Management network/mask 0.0.0.0 / 0.0.0.
Setting Value Port Trunking Load Sharing The algorithm selects the following as forwarding ports for forwarding traffic: Algorithm 1 For forwarding IP Packets—modulus of XOR of last 3 bits of source and last 3 bits of Destination IP address 2 For forwarding non-IP packets—modulus of XOR of last 3 bits of source and last 3 bits of Destination MAC address 3 For forwarding broadcast, multicast packets, and unknown unicast packets— the lowest active port number in the trunk group Port Mirroring-Mirror Sta
Setting Value Serial Port Parity Bit None Serial Port Stop Bit 1 Serial Port Flow Control None Default VLAN Default VLAN (VID=1) with all ports assigned including CPU, STG=1 NTP State Disabled NTP Server 0.0.0.0 NTP Resync Interval 720 minutes GMT Timezone Offset -06:00 Daylight Savings Time State Disabled System Up Time 0 days 00 :00 :00 Current time RTC or NTP (00 :00 :00) Date None Syslog Host 0.0.0.0 Syslog Host 2 0.0.0.
Setting Value RADIUS Server Port 1645 RADIUS Server Retries 3 RADIUS Server Timeout 3 RADIUS Backdoor for Telnet Access Disabled Re-ARP Period in Minutes 10 MSTP Disabled MSTP Default Mode RSTP MSTP Region Name None MSTP Region Version 1 MSTP Max Hop Count 20 CIST Bridge Max Age 20 seconds CIST Bridge Hello Time 2 seconds CIST Bridge Forward Delay 15 seconds CIST Bridge Priority 32768 CIST MAC Address Aging Time 300 seconds CIST Port Priority 128 CIST Port Path Cost 20000
Setting Value Aggregate IGMP Report Disabled IGMP Fastleave Disabled IGMP Fastleave VLANs None IGMP Filtering Disabled IGMP Filters None Static Multicast Router Port None Uplink Failure Detection (UFD) Off UFD Failure Detection Pair Disabled UFD Link To Monitor - Port None UFD Link To Monitor Trunk None UFD Link to Disable - Ports None UFD Link To Disable Trunks None RMON History Group Number None RMON History Interface MIB to Monitor None RMON History Number of Requested Bucke
Setting Value RMON Alarm Falling Event 0 Index RMON Alarm Owner Null IP Forwarding Disabled Configurable User Name admpw admin Configurable User Name opw Disabled Configurable User Name usrpw user Configurable User Name UID 1-10 Disabled Uplink Fast Disabled THASH - enable SIP and DIP SNMPv1 - Read community string: public SNMPv1 - Write community string: private SNMPv1 - SNMP state machine timeout: 5 SNMPv1 - authentication traps: Disabled SNMPv1 - Uplink Failure Detection traps:
Setting Value SNMPv3 - v1v2only subtree=1, included subtree=1.3.6.1.6.3.15, excluded subtree=1.3.6.1.6.3.16, excluded subtree=1.3.6.1.6.3.18, excluded FTP - port 21 (not configurable) Browser upgrade option Enabled, (not configurable) STP Fast Disabled HTTPS Port Disabled Physical and environmental specifications Category Specification DC inputs 12 VDC: 4.
Category Specification Best downlink external port packet forwarding rate ratio 16 : 5 Interswitch xconnects across enclosure backplane 1 X 10 Gb port MAC address learning Automatic update Forwarding table age time Maximum age: 1 to 1,000,000 seconds Default: 300 seconds Technical specifications 41
Performing a serial download In this section Introduction ........................................................................................................................................... 42 Serial upgrade of boot code firmware image procedure ............................................................................. 42 Serial upgrade of operating system firmware procedure .............................................................................
4. Hold down the Shift key and press the D key repeatedly during the Memory Test, until this message appears: NOTE: To perform serial downloads at 57600 baud rate, press the Shift-F keys. To perform serial downloads at 115200 baud rate, press the Shift-D keys. 5. After the message in Step 4 appears, reconfigure the terminal emulation console using these parameters. Parameter Value Baud rate 115200 Data bits 8 Parity None Stop bits 1 Flow control None 6.
8. Select from the menu and choose these options in the Send File window: The Send File window displays progress of the file transfer. The file transfer might take up to seven minutes. NOTE: Although slower, XModem also works if 1K MODEM is not used. 9. After completing the transfer, a message displays how many bytes transferred, followed by another message displaying the status of image extraction. Do not power cycle the switch during this process.
Serial upgrade of operating system firmware procedure To perform a serial upgrade of the switch operating system firmware image, usually named GbE2c-110G_100.bin: 1. Using the null modem cable, connect the console port of the switch to the serial port of a PC that supports XModem/1K XModem. 2.
NOTE: To perform serial downloads at 57600 baud rate, press the Shift-F keys. To perform serial downloads at 115200 baud rate, press the Shift-D keys. 5. After the message in Step 4 appears, reconfigure the terminal emulation console using these parameters. Parameter Value Baud rate 115200 Data bits 8 Parity None Stop bits 1 Flow control None 6. Press the Enter key several times on the PC that is connected to the console port of the switch.
Depending on the selection, 1 or 2, the system updates image1 or image2 on the flash and a message with a progress indicator displays as shown below. If selecting n, the system aborts the update procedure and prompts to reset the baud rate and power cycle the switch. 11. Change the baud rate to 9600 and power off the switch. Wait for a few seconds, and power on the switch. During bootup the switch the following prompt appears: To use the other operating system image, press the Ctrl-o keys.
SNMP MIBs support In this section MIB overview......................................................................................................................................... 48 SNMP Manager software........................................................................................................................ 48 Supported MIBs ..................................................................................................................................... 49 Supported traps ...........
Supported MIBs The SNMP agent for the switch supports these MIBs: • dot1x.mib • GbE2c-1-10G-L2L3.mib • GbE2c-1-10G-L2L3_cpqhost.mib • GbE2c-1-10G-L2L3_cpqrack.mib • GbE2c-1-10G-L2L3_cpqsinfo.mib • rfc1213.mib • rfc1215.mib • rfc1493.mib • rfc1573.mib • rfc1643.mib • rfc1757.mib • rfc1907.mib • rfc2037.mib • rfc2571.mib • rfc2572.mib • rfc2573.mib • rfc2574.mib • rfc2575.mib • rfc2576.mib Supported traps The switch SNMP agent supports these traps: • • • rfc1215.
• o risingAlarm o fallingAlarm GbE2c-1-10G-L2L3.
Electrostatic discharge In this section Preventing electrostatic discharge............................................................................................................. 51 Grounding methods to prevent electrostatic discharge ................................................................................ 51 Preventing electrostatic discharge To prevent damaging the system, be aware of the precautions you need to follow when setting up the system or handling parts.
RJ-45 pin specification In this section Standard RJ-45 receptacle/connector ....................................................................................................... 52 RJ-45 to DB-9 serial adapter with flow control pin assignment...................................................................... 53 Standard RJ-45 receptacle/connector When connecting the switch to a switch, bridge, or hub, an Ethernet cable is necessary.
RJ-45 to DB-9 serial adapter with flow control pin assignment RJ-45 signals RJ-45 pins DB-9 pins DB-9 signals Request to send (RTS) 1 8 Clear to send (CTS) Data set ready (DSR) 2 Data carrier detect (DCD) 3 Receive data (RxD) 4 3 Transmit data (TxD) Transmit data (TxD) 5 2 Receive data (RxD) Ground (GND) 6 5 Ground (GND) 7 Request to send (RTS) Data terminal ready (DTR) 7 Clear to send (CTS) 8 (Not connected) 9 RJ-45 pin specification 53
Troubleshooting In this section Forgotten administrator user name and password that was configured on the switch ...................................... 54 Health LED on the switch is not on ............................................................................................................ 54 Health LED on the switch stays amber for more than 30 seconds and switch does not boot .............................
• The server blade enclosure is not powered up. Be sure that the server blade enclosure is powered up and all the power connections are intact. • There is a faulty LED. Check the console to see if the switch is booted. • The switch fuse is blown. Send for repair. Health LED on the switch stays amber for more than 30 seconds and switch does not boot Action: The Standby Mode Timeout function is malfunctioning. Force the switch to reboot by pressing the Reset button.
Error message that the switch failed to complete the system self-testing appears on the serial console screen Action: The system diagnostic tests failed. Note the reason for the failure from the serial console screen message and call a service representative. The switch fails to get its IP settings from the BOOTP server, even though by default it is configured for BOOTP Action: • The switch is not connected properly to the network.
• The setting allowing access to the switch using the Telnet interface is disabled. From the serial console interface, be sure that the Telnet interface is enabled. • The management network address/mask (if used) does not contain the IP address of the management station. From the serial console interface, be sure that the Management Network Address/Mask contains the IP address of the management station.
The port activity LEDs continuously indicate activity after connecting more than one port to another switch or destination device Action: Because there are multiple links across this device and the destination device, they form loops, which cause broadcast storms. Enable STP for multiple links. This setting prevents loops and maintains standby links for resilience in case of primary link failure.
The switch does not let the user enable two adjacent ports into two different VLANs while assigning the ports to VLANs Action: The ports are two adjacent ports that are bundled in a Port Trunk. Two ports that are assigned to a Port Trunk cannot be assigned to two different VLANs. Either break the trunk to assign it two different VLANs or assign the ports to one VLAN.
• o Be sure that a valid configuration file exists on the TFTP server to download to the switch. o On the switch, check the file name configured to download or upload. The TFTP server was started with a configured directory. The switch must be configured using the full path name, if it is not in the directory specified in the TFTP server.
Acronyms and abbreviations AAA authentication, authorization, and accounting BBI browser-based interface BOOTP Bootstrap Protocol CLI Command Line Interface CPU central processing unit CSMA/CD Carrier Sense Multiple Access with Collision Detection DNS domain name system FDB forwarding database FTP file transfer protocol GMT Greenwich mean time HTTP hypertext transfer protocol HTTPS hypertext transfer protocol secure sockets Acronyms and abbreviations 61
IEEE Institute of Electrical and Electronics Engineers IGMP Internet Group Management Protocol IP Internet Protocol iSCLI industry standard command line interface LACP Link Aggregation Control Protocol LAN local-area network MAC medium access control MAU media attachment unit MDI medium dependent interface MDI-X medium dependent interface-crossover MIB management information base MSTP Multiple Spanning Tree Protocol NAS network access server NIC network interface controller Acronyms and abbrev
NTP network time protocol NVRAM non-volatile memory OID object identifier OS operating system OSI Open Systems Interconnection OSPF open shortest path first POST Power-On Self Test PXE Preboot Execution Environment RADIUS Remote Authentication Dial-In User Service RAS remote access service RFC request for comments RIP routing information protocol RMON remote monitoring RSTP Rapid Spanning Tree Protocol Acronyms and abbreviations 63
SCP Secure Copy SFP small form-factor pluggable SNMP Simple Network Management Protocol SSH Secure Shell STP Spanning Tree Protocol TACACS+ Terminal Access Controller Access Control System Plus TFTP Trivial File Transfer Protocol UDP User Datagram Protocol UFD uplink failure detection UTP unshielded twisted pair VID VLAN ID VLAN virtual local-area network VRRP virtual redundant router protocol XFP 10 Gb small form factor pluggable Acronyms and abbreviations 64
Index A G accessing the switch serial console interface, troubleshooting 55 additional references 6 architecture 9 Auto-MDI/MDIX 14 auto-negotiation of duplex mode and speed 14 grounding methods 51 B BOOTP server, troubleshooting 56 Bootstrap Protocol (BOOTP) 12 BSMI notice 29 C Canadian notice 28 configuration and management of switch 8, 23 configuration, troubleshooting 60 configuring multiple switches, using a configuration file 20 configuring multiple switches, using scripted CLI commands 20 config
planning switch configuration 18 port mapping 9 port mirroring 12 port trunking 12 U R VLANs, troubleshooting 58, 59 redundancy 8, 10, 15 redundant crosslinks 10 redundant images in firmware 15 redundant paths to server bays 10 regulatory compliance notices 28 Remote Authentication Dial-in User Service (RADIUS) 13 replacing an existing switch 26 replacing the switch 26 RJ-45 pin specification 52 RJ-45, standard connector 52, 53 runtime switching software, default settings 33 upgrading the switch 26 V