Cisco SFS 3001 Multifabric Server Switch Quick Start Guide (Topspin 90 Quick Start Guide) Release 2.1.
Copyright © 2003-2004 Topspin Communications, Inc. All rights reserved. The Topspin Switched Computing System, Topspin Host Channel Adapter, Topspin Element Manager, and collateral software programs and documentation are subject to and made available only pursuant to the license agreement signed by you and Topspin, Communications, Inc. (or if no signed license agreement exists, the license agreement included with your original media) and may only be used in accordance with the terms of that agreement.
iii Contents Regulatory Notices.......................................... v FCC Statement .............................................................................................................................................v Safety Information .......................................................................................................................................v Electrical Cautions .....................................................................................................
iv Launch Chassis Manager ...........................................................................................................................11 Configure Additional Settings ...................................................................................................................12 (Optional) Configure the Ethernet Gateway .............................................................................................13 Layer 2 Bridging Procedure................................................
v Regulatory Notices FCC Statement This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment.
vi Ensure the ground connection on the power supply is correct and functioning before applying power to the Topspin system. CAUTION: Always ground yourself before touching any internal Topspin system components to avoid damage from electrostatic discharge (ESD). CAUTION: The Topspin system has two power cables. The operator must disconnect all power cables before attempting to remove the system from the rack. CAUTION: Remove power cables by grasping the cable connector and pulling straight out.
vii CAUTION: Never place your hand inside an empty card or module bay. You should never have cause to place a hand anywhere inside the Topspin chassis. Unused card and module bays should always have a Topspin cover over the bay to ensure proper safety, ventilation, and cooling. General Cautions CAUTION: No user is authorized to remove the Topspin system enclosure cover. The internal chassis contains no user-serviceable components. Removing the enclosure cover voids your warranty.
viii Laser Specs Table III-1: Topspin P/N Application Optical Parameters 48-00001-01 Fibre Channel *CDRH/IEC Laser Class: 1/1 Maximum Data Rate: 2.125 GB/s Wavelength: 850nm I/O connector: * Standards used: CDRH - 21CFR Chapter I §1040.10; IEC - IEC60825-1:1994 Contact Information Table III-2: Customer Contact Information Address Topspin Communications, Inc. 515 Ellis St.
1 1 Topspin 90 Quick Start This document describes the basic steps required to install and configure the Topspin 90 system. For more detailed information about the Topspin 90 server switch, we recommend that you have the Topspin 90 Hardware Guide available.
2 5. Prepare the physical environment for the Topspin 90. a. Make sure that you have an approved grounding wrist-strap. b. Make sure the system has the right cables and sufficient ventilation. c. Unpack the Topspin 90 package, using the packing list provided. d. Verify that you have all of the items on the Requirements list. See “Requirements” on page 2. Install the Topspin 90 in an Equipment Rack There are two different methods that can be used to rack the Topspin 90.
3 1. Take one connected pair of rack brackets and separate them. Each side arrives assembled to its counterpart, but should be separated before attaching to the switch when using this method of installation. Separate Brackets Figure 1-1: Assembled Rack Bracket Pair 2. Attach the rack bracket that has screw holes to the side of the chassis with the flange facing away from the switch, as shown in Figure 1-2. The standard method is to face the flange toward the front of the chassis.
4 5. Attach the remaining two rail brackets to your rack. a. Orient a bracket toward the back of the rack with the flange facing away from the rack. The flange should go around the outside of the rack post, as shown in, as shown in Figure 1-3. NOTE: If you are mounting the switch backward, the rack bracket should be installed toward the front of the rack. b. Secure the brackets with your screws through the back of the rack posts, as shown in Figure 1-4. c. Repeat on both sides of the rack.
5 If the brackets do not slide easily, the alignment may be off. Pull the switch back toward you and realign the brackets. Figure 1-5: Sliding the Switch Into the Rack 8. Secure the switch with your screws through the front of the rack, as show in Figure 1-6. Figure 1-6: Secure Switch with Screws through the Front of the Rack Install Expansion Modules (Optional) 1. Install any optional Fibre Channel or Ethernet Gateway modules. 2. Install all hardware components before the Topspin 90 is powered on.
6 Connect InfiniBand Cables 1. Plug InfiniBand Cables from the InfiniBand-enabled host to the InfiniBand switch ports. This can also be done in a later step. Refer to step 5. 2. Plug InfiniBand cables from the Topspin 90 to any additional InfiniBand switches that you want to connect. (Optional) Connect to Ethernet Devices 1. Connect the optional Ethernet gateway to workstations, routers or switches.
7 c. Enter the enable command. Topspin-90> enable Topspin-90# d. Enter the configure command. Topspin-90# configure Topspin-90(config)# e. Enter the interface mgmt-ethernet command. Topspin-90(config)# interface mgmt-ethernet f. Enter the IP address of the management port followed by the netmask. Topspin-90(config-if-mgmt-ethernet)# ip address 10.10.0.22 255.255.255.0 g. Set the default gateway for the management port. For example: Topspin-90(config-if-mgmt-ethernet)# gateway 10.10.0.1 h.
8 f. Enter the option dhcp command. The chosen method will be persistent across module reboots. Topspin-90(config-if-mgmt-ethernet)# option dhcp g. Enable the management port by entering the no shutdown command. Topspin-90(config-if-mgmt-ethernet)# no shutdown h. Save the configuration to preserve it between reboots. Topspin-90(config-if-mgmt-ethernet)# exit Topspin-90(config)# exit Topspin-90# copy running-config startup-config i.
9 d. Open a terminal or graphic window and access the top-level directory on the CD-ROM e. Execute the command ./tsinstall in a terminal window. This program automatically detects the available kernel and installs the appropriate drivers as RPM packages. By default, topspin files are saved in the /usr/local/topspin directory. # cdmount ./tsinstall 4. Configure the HCA drivers. a. Configure the IPoIB driver by assigning an IP address to interface ib0 and/or ib1, which corresponds to the two HCA ports.
10 5. Plug InfiniBand Cables from the host to the InfiniBand switch. a. To plug in an InfiniBand cable, push the connector into the interface until you hear/feel a click. Figure 1-7: Fully Installed IB Cable with Pinch Connector NOTE: If your host does not provide an ample amount of free space around a given IB port, double-check that your IB cable connector engages fully. Wiggle your connector back and forth to be sure that both sides of the connector have locked firmly into place. b.
11 • 300 Mhz processor • 800x600 screen resolution, 16bit color depth 2. Insert the Topspin CD-ROM into the CD-ROM drive of a server that has network access to a Topspin management port. 3. Access the top folder of the CD-ROM. The GUI can be found in the following location on the CD-ROM. 4. 5. • Linux/install_linux_ia64.bin • Linux/install_linux_x86.bin • Windows/install_x86.exe • Solaris/install_solaris_sparc.bin Run the installation wizard: a. On Windows, double-click install.exe. b.
12 4. Chassis Manager loads in your browser window. Figure 1-10: Chassis Manager Opening Display for the Topspin 90 Server Switch Configure Additional Settings You can now fully manage the device with CLI over Telnet/SSH or the GUI. 1. Verify that you are running the latest version of software. a. Refer to the Topspin support Web site: http://topspin.com/support/ b.
13 • In the CLI, enter the configuration mode and enter the ntp command with the IP address of the NTP server. Example Topspin-90(config)# ntp server-one 10.2.0.50 3. Configure administrators and privilege levels. See Creating User Accounts in the User Guide. (Optional) Configure the Ethernet Gateway Configure the Ethernet Gateway if you have installed an Ethernet card into the chassis. Refer to the Ethernet Gateway User Guide for more information.
14 Use the broadcast-forwarding command. Example Topspin-90(config)# bridge-group 21 broadcast-forwarding Topspin-90(config)# or If you are not using DHCP, configure the next InfiniBand hop. Use the ib-next-hop command. Example Topspin-90(config)# bridge-group 1 ib-next-hop Topspin-90(config)# 4. Specify the Ethernet Gateway to which you want to assign the new bridge-group.
15 Configure the Fibre Channel Gateway (Optional) To configure ITLs, perform the following steps: 1. Log in to your host. 2. Enter the /etc/init.d/ts_srp stop command at the host CLI to force the host to log out of any storage. You must disable connections now and enable them later in this process. 3. Enter the /usr/local/topspin/bin/vstat --verbose|grep -i guid command at the host CLI to display the host GUID. NOTE: Record the GUID value. You will enter it repeatedly. 4.
16 advantage of CLI options to assign these values dynamically. The remainder of this process dynamically allocates WWNNs and WWPNs. The auto-bind keyword: • Assigns a unique WWNN to the initiator. • Creates a virtual port (that maps to the initiator) for all possible (actual & potential) physical FC gateway port and assigns a WWPN to each virtual port. Example Topspin-90# configure terminal Topspin-90(config)# fc srp initiator 00:05:ad:00:00:01:29:5c 00:00:00:00:00:00:00:00 auto-bind 7.
17 8. (Optional) Enter the show fc srp initiator command to verify the new initiator.
18 NOTE: This command may take some time to execute. Example Topspin-90(config)# fc srp initiator 00:05:ad:00:00:01:29:c5 00:00:00:00:00:00:00:00 discover-itl 10. Enter the show fc srp itl command to display the potential ITLs and record the target-wwpn and fc-lunid values.
19 NOTE: The fc-lunid field displays the LUN ID of the ITL that you will configure. For non-sequential LUNs, this value will always appear as 00:00:00:00:00:00:00:00. For sequential LUNs, the value will iterate by 1 for each LUN in the target device. 11.
20 15. Return to User Exec mode or Privileged Exec mode and enter the show fc srp itl command to verify that the ITL is active. Port numbers appear in the physical-access and active-ports fields to indicate that the ITL is active.
Index B basic connectivity ...................................................6 C chassis manager launching .........................................................11 configure basic connectivity ...................................6 connectivity, basic ..................................................6 connectivity, configuring ........................................6 connectors InfiniBand cables ..............................................6 installing in a rack .....................................