QLogic 12000 Series InfiniBand Switches and Directors Hardware Installation Guide Version 6.
QLogic 12000 Series InfiniBand Switches and Directors Hardware Installation Guide Information furnished in this manual is believed to be accurate and reliable. However, QLogic Corporation assumes no responsibility for its use, nor for any infringements of patents or other rights of third parties which may result from its use. QLogic Corporation reserves the right to change product specifications at any time without notice.
Table of Contents Preface Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . License Agreements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Technical Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Contact Information . . . . . . . . . . . . . . . . . . . . . .
QLogic 12000 Series InfiniBand Switches and Directors Hardware Installation Guide Selecting a Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Installation Tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12800-360 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Mounting Hardware Kit Contents: . . . . . . . . . . . . . . . . . . . . . . . . . . . . Selecting a Rack . . . . . . . . . .
QLogic 12000 Series InfiniBand Switches and Directors Hardware Installation Guide 12200 and 12300. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IB Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Attention . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . RJ45 LEDs . . . . . . . . . . . . . . . . . .
QLogic 12000 Series InfiniBand Switches and Directors Hardware Installation Guide QLogic 12300 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chassis Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Removal Procedures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Replacement Procedures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fan/Power Supply Replacement . . . . . . . . . . . . . . .
Preface This manual describes the hardware installation and initial configuration tasks for the QLogic 12000 series that includes: The QLogic 12200 36-port fixed-configuration InfiniBand switch The QLogic 12300 36-port configurable InfiniBand switch The QLogic 12300 18-port configurable InfiniBand switch The QLogic 12800 series: 12800-040 12800-120 12800-180 12800-360 This manual is organized as follows: Preface describes the intended audience and technical support.
Preface Documentation Conventions CAUTION! indicates the presence of a hazard that has the potential of causing damage to data or equipment. WARNING!! indicates the presence of a hazard that has the potential of causing personal injury. Text in blue font indicates a hyperlink (jump) to a figure, table, or section in this guide, and links to Web sites are shown in underlined blue. For example: viii Table 9-2 lists problems related to the user interface and remote agent.
Preface License Agreements License Agreements Refer to the QLogic Software End User License Agreement for a complete listing of all license agreements affecting this product. Technical Support Customers should contact their authorized maintenance provider for technical support of their QLogic products. QLogic-direct customers may contact QLogic Technical Support; others will be redirected to their authorized maintenance provider.
Preface Technical Support Knowledge Database The QLogic knowledge database is an extensive collection of QLogic product information that you can search for specific solutions. We are constantly adding to the collection of information in our database to provide answers to your most urgent questions. Access the database from the QLogic Support Center: http://support.qlogic.com.
1 Installation This section describes how to install and configure for first-time use: The QLogic 12000 switches in a network environment. Planning the Installation The 12000 is designed to be installed in an existing 19-inch equipment rack or server rack. NOTE: These switches are designed for a four-post server cabinet. Do not mount in a two-post telco cabinet. Racks should conform to conventional standards.
1–Installation Planning the Installation Cable Requirements Cable Distances When planning the location of the switches, consider the distance limitations for signaling, EMI, and connector compatibility. It is recommended that the user does not exceed specified transmission rate and distance limits. Cable Guidelines NOTE: Building and electrical codes vary depending on the location. Comply with all code specifications when planning the site and installing cable.
1–Installation Planning the Installation Cable Handling and Bend Radius Provide proper strain relief by adhering to the following guidelines: Table 1-1. IB Copper Cable Guidelines IB Copper Cable Bend Radii American Wire Gauge (AWG) Size Cable Bend Radius 26 2.43 inches 28 2.28 inches 30 1.98 inches For copper cable, the temporary 90-degree bend can never be more than 0.5 inches tighter than the values listed above for any assembly.
1–Installation Planning the Installation Table 1-2. IB Fiber Optic Cable Guidelines IB Fiber Optic Cable Bend Radii Cable Type Fiber Optic Standard Cable Bend Radius 25 millimeters NOTE: A 50mm diameter is the smallest circle limit Figure 1-2.
1–Installation Installation Tasks Checklist Whether or not the UPS unit also provides online protection. Installation Tasks Checklist To perform the actual switch installation, the site implementation engineer must perform the following tasks, which are detailed in this section. CAUTION! Be sure to review the safety information before starting the installation and during the installation process (refer to Appendix B. 1.
1–Installation Installation Tasks Checklist The ambient temperature stays between 50° - 113°F (5° - 40° C). Cabinet doors do not interfere with front-to-back air flow. The cabinet should have its own switchable power distribution. If the switch has two power supplies, it is suggested that a cabinet with dual power distribution units is used. It is recommended that cabinet anti-tip devices are used.
1–Installation 12200/12300 Installation 12200/12300 Installation This section describes the rack mounting instructions for the 12200 and 12300: Four Post Standard-Depth Rack Installation In a standard-depth rack, the distance between the front and back mounting posts is ~28" (700mm). Mounting rails for the 12200 and 12300 are adjustable to accommodate racks with 26"-33" between mounting posts.
1–Installation 12200/12300 Installation 2. Install eight (8) cage nuts into rack posts, two (2) cage nuts per post. Install the mounting rails and fasten to cage nuts using six (6) M6 screws. Torque screws to 30in-lb. Do not install two (2) screws in lower locations on equipment installation side of the rack until the switch is installed in the rack. Note the orientation of mounting rails in Figure 1-4..
1–Installation 12200/12300 Installation Figure 1-5. 12200 and 12300 Four Post Standard Rack Mounting 12200 Four Post Shallow-Depth Rack Installation In a shallow-depth rack, the distance between the front and back mounting posts is ~16" (400mm). Mounting rails for the 12200 are adjustable to accommodate racks with 14"-20" between mounting posts.
1–Installation 12200/12300 Installation Installation 1. Install the hat rails with mounting ears towards the port side of the switch. Fasten with three (3) #6-32 screws per rail. Torque screws to 8in-lb. Figure 1-6. 12200 Hat Rails 1-10 2. Install six (6) cage nuts into the rack posts. Two cage nuts into posts on the front side of the rack and four cage nuts into posts in the rear of the rack. Note that the front of the rack is where the switch is installed. 3.
1–Installation 12200/12300 Installation Figure 1-7.
1–Installation 12800-040 Installation 12800-040 Installation NOTE: The following procedures are for installing the switch using variable distances between the front and rear rack posts. Mounting Hardware Kit Contents NOTE: The mounting kit contains all of the necessary parts for installing and mounting the switch into a 19" 4-post server rack, with a distance between front and rear rack posts ranging from 28" - 33" (711mm - 838mm).
1–Installation 12800-040 Installation Installation Tasks 1. Install the clip nuts. Install M6 clip nuts in the following locations on EIA rails: Figure 1-8. Clip Nut Installation Locations For improved stability, orient the clip nuts as shown (that is, orient the flanges horizontally): Figure 1-9. Clip Nut Orientation 2. D000140-001 D Install support rails in the rack. Fasten with two (2) M6 screws per EIA rail to pre-installed clip nuts and torque to 30 in-lb.
1–Installation 12800-040 Installation Figure 1-10. Support Rail Installation 3. Orient the chassis such that mounting flanges are in the front of the rack. Install the chassis in the rack. Fasten chassis to the rack with four (4) M6 screws. Torque to 30in-lb. WARNING!! To avoid injury, use a team of people appropriate to the weight of the product and in conjunction with applicable laws and guidelines. 4. 1-14 Fasten chassis to the rack with four (4) M6 screws. Torque to 30in-lb.
1–Installation 12800-040 Installation Figure 1-11. Rack Installation 5. D000140-001 D If applicable, replace the door(s) on the rack.
1–Installation 12800-120 Installation 12800-120 Installation NOTE: The mounting kit contains all of the necessary parts for installing and mounting the switch into a 19" 4-post server rack, with a distance between front and rear rack posts ranging from 28" - 33" (711mm - 838mm).
1–Installation 12800-120 Installation Figure 1-12. Clip Nut Installation Locations For improved stability, orient the clip nuts as shown (i.e., orient the flanges horizontally): Figure 1-13. Clip Nut Orientation NOTE: It is recommended that 12800-120 is installed into the rack at 5U or 6U location. This locates the chassis approximately 12" from the floor and allows the chassis to be moved onto the support rails by sliding off of the pallet.
1–Installation 12800-120 Installation 3. Install support rails in the rack. Fasten with two (2) M6 screws per EIA rail to pre-installed clip nuts and torque to 30 in-lb. Figure 1-14. Support Rail Installation 4. 1-18 Install two (2) rear mounting Hat Brackets on the chassis and fasten with #8-32 screws. There are four (4) screws per bracket. Torque to 30in-lb.
1–Installation 12800-120 Installation Figure 1-15. Hat Bracket Installation 5. Orient the chassis such that mounting flanges are in the front of the rack. Install the chassis in the rack. WARNING!! To avoid injury, do not manually lift the chassis when fully loaded. Use a mechanized lift whenever possible. For a manual lift, unload the product FRUs to minimize the weight. Use a team of people appropriate to the weight of the product, and in conjunction with applicable laws and guidelines.
1–Installation 12800-120 Installation Figure 1-16. Mounting Flange Installation 6. 1-20 Fasten the chassis to the rack with eight (8) M6 screws. Torque to 30in-lb.
1–Installation 12800-120 Installation Figure 1-17. Chassis Installation 7. D000140-001 D Slide two (2) C-brackets over the Hat brackets that are pre-installed on the chassis.
1–Installation 12800-120 Installation Figure 1-18. C Bracket Installation 8. 1-22 If applicable, install the optional cable management guides. Fasten to the EIA rails with M6 screws. Torque all screws to 30in-lb.
1–Installation 12800-120 Installation Figure 1-19. Cable Management Installation 9. D000140-001 D If applicable, replace the door(s) on the rack.
1–Installation 12800-180 Installation 12800-180 Installation Mounting Hardware Kit Contents: NOTE: The mounting kit contains all of the necessary parts for installing and mounting the switch into a 19" 4-post server rack, with a distance between front and rear rack posts ranging from 28" - 33" (711mm - 838mm).
1–Installation 12800-180 Installation Figure 1-20. Clip Nut Locations For improved stability, orient the clip nuts as shown (i.e., orient the flanges horizontally): Figure 1-21.
1–Installation 12800-180 Installation 3. Install support rails in the rack. Fasten with two (2) M6 screws per EIA rail to pre-installed clip nuts and torque to 30 in-lb. Figure 1-22. Support Rail Installation 4. 1-26 Install four (4) rear mounting brackets to the chassis and fasten with #8-32 screws. There are four (4) screws per bracket. Torque to 30in-lb.
1–Installation 12800-180 Installation Figure 1-23. Flat Bracket Installation 5. D000140-001 D Orient the chassis such that mounting flanges are in the front of the rack. Install the chassis in the rack.
1–Installation 12800-180 Installation WARNING!! To avoid injury, when fully loaded do not lift manually. Use a mechanized lift only. If a manual lift is necessary, first unload all field replaceable units (FRUs) to minimize weight. Use a team of people appropriate to the weight of the product and in conjunction with applicable laws and guidelines. 6. 1-28 Fasten the mounting flanges using M6 screws to the clip nuts that are pre-installed in the rack. There are six (6) screws per mounting flange.
1–Installation 12800-180 Installation Figure 1-24. Mounting Flange Installation 7. D000140-001 D Slide four (4) C-brackets over the HAT brackets that are pre-installed on the chassis.
1–Installation 12800-180 Installation Figure 1-25. U Bracket Installation 8. 1-30 If applicable, install the optional cable management guides. Fasten to the EIA rails with M6 screws. Torque all screws to 30in-lb.
1–Installation 12800-180 Installation Figure 1-26. Cable Management Guide Installation 9. D000140-001 D If applicable, replace the door(s) on the rack.
1–Installation 12800-360 Installation 12800-360 Installation Mounting Hardware Kit Contents: NOTE: The following procedures are for installing the switch using variable distances between the front and rear rack posts. Mounting Kit containing: Support Shelf HAT Brackets C-Brackets #10 Mounting screws M6 Mounting Screws M6 Clip Nuts Selecting a Rack 12800-360 is the largest in the 12800-series of switches, capable of supporting up to 864 InfiniBand ports operating at QDR speed.
1–Installation 12800-360 Installation Figure 1-27.
1–Installation 12800-360 Installation Locating Rack Mounting Posts for Front and Back Cable Routing In a typical rack, front EIA rails are positioned approximately 50mm from the front face of a rack. With a chassis mounted flush with the front rails, space available in the front the rack is insufficient for cable routing. To allocate enough space in the front of the rack to route 300+ cables, the two front rails should be recessed 135mm from the front of the rack.
1–Installation 12800-360 Installation Installation Tasks NOTE: It is recommended that 12800-360 is installed into the rack at 5U or 6U location. This will locate the chassis approximately 12" from the floor and will allow the chassis to be moved onto the support rails by sliding off the pallet. 1. Install clip nuts: If applicable, remove the doors of the rack. Install M6 clip nuts in the following locations on EIA rails for U5 installation. For U6 installation, increment clip nut locations by one U (1.
1–Installation 12800-360 Installation Figure 1-30. Clip Nut Orientation 1-36 2. Attach four (4) mounting brackets to the support shelf as shown in Figure 1-31. Align the brackets with "B" marks on a support shelf and fasten with six (6) M6 HEX screws per bracket. Use a HEX socket wrench to tighten the screws. Torque the screws to 120in-lb. 3. Attach the support bracket to the support shelf and fasten with seven (7) #10-32 flat head screws. Torque screws to 30in-lb.
1–Installation 12800-360 Installation Figure 1-31. Support Shelf Assembly 4. D000140-001 D Install the support shelf into the rack. Fasten the M6 screws to pre-installed clip nuts and torque to 30 in-lb. There are three (3) screws per mounting bracket.
1–Installation 12800-360 Installation Figure 1-32. Attaching the Support Shelf to the Rack 5. 1-38 Orient and position the chassis for installation in the rack.
1–Installation 12800-360 Installation WARNING!! To avoid injury, when fully loaded do not lift the 12800-260 manually. Use a mechanized lift only. If a manual lift is necessary, first unload all field replaceable units (FRUs) to minimize weight. Use a team of people appropriate to the weight of the product and in conjunction with applicable laws and guidelines. 6.
1–Installation 12800-360 Installation Figure 1-33. Loading from the Pallet 7. 1-40 Position the chassis on front on the rack. Use pallet jack to move the chassis. Orient the chassis on a pallet in front of the rack as shown. Chassis rear should be facing front of the rack. For installations in racks arranged in rows, distance between adjacent rows of racks (width on a cold isle) should be greater than 36" to be able to move the chassis on a pallet through a cold isle.
1–Installation 12800-360 Installation Figure 1-34. Positioning the Switch 8. D000140-001 D Installing the chassis in the rack: Align the chassis with the rack. Raise the chassis using a pallet jack such that the bottom of the chassis is at or slightly higher than the top surface of the support shelf pre-installed in the rack. Lock the pallet jack wheels. Use a group of people to push the chassis from the front to slide it off the pallet and on the support shelf.
1–Installation 12800-360 Installation Figure 1-35. Sliding the Switch off the Pallet 9. 1-42 Fasten the front of the chassis to the rack by installing the front support bracket and fasten to the base of the chassis with five (5) M6 screws. Fasten to the support shelf with seven (7) #10-32 screws. Torque to 30 in-lb.
1–Installation 12800-360 Installation Figure 1-36. Fasten the Chassis to the Front of the Rack 10. Fasten the rear of the chassis to the rack: Fasten the rear support bracket to the base of the chassis with five (5) M6 screws. Torque to 30 in-lb. 11. Install two (2) C-brackets by sliding over the H-brackets that are pre-installed on the chassis.
1–Installation 12800-360 Installation Figure 1-37.
1–Installation 12800-360 Installation 12. Attach the cable management guides. If applicable, attach the cable management guides to the front and rear EIA mounting rails, and fasten with M6 screws to the pre-installed clip nuts. The guides should be installed such that the wireframe supports line up with the chassis leaf module slots. There are four (4) guides in the front of a rack and four (4) in the rear of a rack. Figure 1-38. Attaching Cable Management Guides 13.
1–Installation Connect Equipment to the Ports and Power On the System Connect Equipment to the Ports and Power On the System NOTE: Before connecting equipment, it is important to understand the locations of the serial and Ethernet ports on the 12200, 12300 and 12800 series. For the 12200 and 12300, these are located on the switch IB port side. For the 12800 series, these are located on the Serial, Ethernet, Chassis EEPROM Board (SEEB) modules.
1–Installation Connect Equipment to the Ports and Power On the System 1. Connect a Category 5 or 6 (Cat 5/6) Ethernet cable to the RJ-45 connector(s) on the switch. Connect the other end of the Cat 5/6 to an OOB LAN workstation, another switch or a hub. 2. Connect the switch to IB-enabled host(s)/switch(es) using QDR QSFP IB cables, or to DDR host(s)/switch(es) using a QSFP-CX4 cable. NOTE: Make sure all cables latch securely into the corresponding port connectors.
1–Installation Connect Equipment to the Ports and Power On the System NOTE: For the 12800 switches, make certain the DC ON/OFF switch is illuminated. If it is not, press the button to supply power. The switch is located: 12800-360: Next to the AC power inlets on the top of the chassis. 12800-040: Next to the AC power inlets. 12800-180 and 12800-120: Next to the power supplies. If applicable, the user needs to remove the fascia covering the supplies to access the DC ON/OFF switch. Figure 1-41.
1–Installation Bringing Up the System For the First Time Bringing Up the System For the First Time 12800-Series Management Module Protective Label Guidelines A management module installed in a 12800 system may have a protective label installed, as shown in Figure 1-42. This label protects the mechanical release latch (MRL) switch inside the management module from shock and vibration during shipping. Figure 1-42.
1–Installation Bringing Up the System For the First Time Figure 1-44. MRL Protective Label 3 3. After testing is complete at the staging area, reverse Steps 1 and 2 to prepare the system for shipment to the end-user site (see Figure 1-45). Figure 1-45. MRL Protective Label 4 User Site Installation After final installation of a 12800-series switch is completed at the end user site: 1. Disengage the thumb screw and partially rotate the lever as shown in Figure 1-46. Figure 1-46.
1–Installation Bringing Up the System For the First Time 2. Peel off the protective label. Re-engage the lever and tighten the thumb screw as shown in Figure 1-47. Figure 1-47. MRL Protective Label 6 Start-up Procedures 1. Power up the switch. 2. From its flash image on the management module, the switch begins its boot process.
1–Installation Bringing Up the System For the First Time Changing the Switch IP Address and Default Gateway via the CLI The command line interface (CLI) can be accessed via Telnet, SSH, the SEEB module DB-9 or 12200/12300 RS-232 serial port(s). 1. Determine the CLI access method (that is, Telnet, SSH, or Serial). NOTE: If using a serial port, skip to Step 6. Steps 2 through 5 are for those users accessing the switch via Telnet or SSH.
1–Installation Bringing Up the System For the First Time Welcome to the CLI. Type 'list' for the list of commands. 6. To change the switch IP address enter: setChassisIpAddr -h ipaddress -m netMask where -h ipaddress is the new IP address in dotted decimal (i.e., xxx.xxx.xxx.xxx) format, and -m netMask is the new subnet mask in dotted decimal (i.e., xxx.xxx.xxx.xxx) format. 7.
1–Installation Bringing Up the System For the First Time Management Module 227: 192.168.100.10 Management Module 228: 192.168.100.11 It is necessary for each management module to have a unique IP address for the following reasons: Unique IP addresses are used when sending syslog messages from a managed spine to a syslog server. Gives the user the ability to ping each management spine separately. If the IP addresses are not unique, collisions will occur, causing IP operations to fail.
1–Installation Bringing Up the System For the First Time Enabling 8X Ports Users can enable 8X (10 Gbps) ports by combining two (2) 4X ports together (also known as a “DUO”). The first port in a DUO is known as the master port; the second port is the partner or slave port. The following CLI commands can enable 8x ports: ismPortSetWidth: sets the supported link width for an individual IB port. ismChassisSetWidth: sets the supported link width for all chassis IB ports.
1–Installation Bringing Up the System For the First Time 4. At the switch, unplug and reinsert the cables to the physical ports. After reinserting the first cable, the user has four (4) seconds to reinsert the second cable associated with the 8x connection before the link begins training. NOTE: For proper 8x functionality, it is required that both QSFP cables for a DUO are from the same manufacturer, as well as the same length. 5. After reinserting the cables, bring up Chassis Viewer.
1–Installation Bringing Up the System For the First Time Figure 1-50. 8X Port Statistics The first port of the group (port 10) is shown as active and Up, while the other port in the DUO (port 28) is displayed as down and Disabled.
1–Installation Bringing Up the System For the First Time Creating an 8x Port: 12800 Series For the 12800 switches, 8x DUOs are set up on the leaf modules as follows: UHP Leaf (18 4x QDR ports): combine the 4X port on the bottom row with the 4X port directly above it (for example, port 1 with port 10, port 2 with 11, port 3 with port 12, etc.).
1–Installation Bringing Up the System For the First Time NOTE: For proper 8x functionality, it is required that both QSFP cables for a DUO are from the same manufacturer and the same length. 5. After reinserting the cables, bring up Chassis Viewer. The 8X ports are displayed as shown in Figure 1-52 where both ports of the DUO have LEDs on. Figure 1-52. 8X Ports Enabled 6. D000140-001 D From the Chassis Viewer main menu, click on Port Stats then IB Port Stats to display the IB Port Statistics screen.
1–Installation Bringing Up the System For the First Time Figure 1-53. 8X Port Statistics The first port of the group (port 8) is shown as active and Up, while the other port in the DUO (port 17) is displayed as down and Disabled.
1–Installation Component LEDs Component LEDs Management Module Figure 1-54. Management Module LEDs Module Status The status LED indicates one of the following conditions: Steady Green - the module is operating normally. Blinking Green - LED test state. Off - module is in the removable state. Module Attention The Attention LED indicates one of the following conditions: Off - the system is functioning normally.
1–Installation Component LEDs The module is not removable. Chassis Status and Attention The chassis status LED is Green when the system is functioning normally. The chassis status LED is Amber when one of the following conditions exists: Any Fan Alarm is amber. Any power supply AC OK LED is off. Any power supply DC OK LED is off Any spine module Attention LED is on, or it has been determined that a spine is not functioning (even if it is unable to turn on the LED).
1–Installation Component LEDs Figure 1-55.
1–Installation Component LEDs Leaf Module Figure 1-56. Leaf Module LEDs IB Port LEDs Each module IB port has a Green IB link status LED that provide the following indications: On - the logical link is up (port is in the Active state). Off - the physical link is down (port is in the Down state). Module Status The status LED indicates one of the following conditions: Steady Green - the module is operating normally. Blinking Green - LED test state. Off - module is in the removable state.
1–Installation Component LEDs Off - the system functioning normally. Steady Amber - the system requires some attention, which could indicate one of the following conditions: The switch temperature is at a warning level on the module. The switch silicon temperature is at a warning level (approximately 90 degrees C). DC voltages on the board are slightly out of tolerance (12V Bulk, 5V, 3.3V and 1.8V are all monitored). The module can no longer function properly.
1–Installation Component LEDs The switch temperature is at a warning level on the module. The switch silicon temperature is at a warning level (approximately 90 degrees C). DC voltages on the board are slightly out of tolerance (12V Bulk, 5V, 3.3V and 1.8V are all monitored). The module can no longer function properly. The system will take the appropriate actions to ensure that no damage is done to its components. Blinking Amber (once every four seconds) - LED test state.
1–Installation Component LEDs 12200 and 12300 Figure 1-59. 12200 and 12300LEDs IB Port LEDs Each module IB port has a Green IB link status LED that provide the following indications: On - the logical link is up (port is in the Active state). Off - the physical link is down (port is in the Down state). Status The status LED indicates one of the following conditions: Steady Green - the module is operating normally. Blinking Green - LED test state. Off - module is in the removable state.
1–Installation Component LEDs DC voltages on the board are slightly out of tolerance (12V Bulk, 5V, 3.3V and 1.8V are all monitored). The module can no longer function properly. The system will take the appropriate actions to ensure that no damage is done to its components. Blinking Amber (once every four seconds) - LED test state. RJ45 LEDs The RJ45 connectors have two LEDs, Act and 100. The 100 LED is Green when a 100Mbps link is connected.
1–Installation Component LEDs A single fan failure when the rotation speed is less than 4000 RPM or greater than 10950 RPM. Green and Amber on indicates a possible problem, including: The fan tray is not responding to commands for configuration and temperature-related operations. A fan is not responding to commands for temperature and speed related operations. The fan speed has fallen below the minimum allowed RPM for a fan. Power Supply LEDs Figure 1-61.
1–Installation Switch-Based QLogic Fabric Manager License Key Switch-Based QLogic Fabric Manager License Key If purchased, certain packages of the InfiniBand Fabric Suite entitle the user to the switch-based QLogic Fabric Manager. Refer to the licensing documentation that comes with the InfiniBand Fabric Suite for instructions on generating the license key. Figure 1-62.
1–Installation Switch-Based QLogic Fabric Manager License Key Procedures 1. Record the IFS serial number. 2. Go to the QLogic Feature Activation/License Key web site http://lk.qlogic.com. Figure 1-63. License Key Activation Center 1 3. Enter the InfiniBand Fabric Suite serial number. Click Continue. The system validates the serial number and displays the following screen: Figure 1-64.
1–Installation Switch-Based QLogic Fabric Manager License Key 4. Click Activate License Key and click Continue. The following screen is displayed: Figure 1-65. License Key Activation Center 3 5. 1-72 Enter your email address in the Email: and Confirm Email: text boxes. Click Continue.
1–Installation Switch-Based QLogic Fabric Manager License Key Figure 1-66. License Key Activation Center 4 6. D000140-001 D Enter all applicable information. For the City: and/or the Zip/Postal Code entries, click on the flashlight hyperlinks.
1–Installation Switch-Based QLogic Fabric Manager License Key Figure 1-67. License Key Activation Center 5 7. In the City: and Zip: text boxes, enter the applicable information and click Search. Alternatively, search through the list of cities, click the applicable radio button, then click Search. The following is displayed: Figure 1-68. License Key Activation Center 6 8. 1-74 If the information is correct, click Close.
1–Installation Switch-Based QLogic Fabric Manager License Key Figure 1-69. License Key Activation Center 7 9. D000140-001 D Click Continue.
1–Installation Switch-Based QLogic Fabric Manager License Key Figure 1-70. License Key Activation Center 8 10. In the GUID: text box, enter the FRU GUID of the following applicable components: QLogic 12300 chassis QLogic 12800 series Management Module to be used as the master subnet manager Master and redundant switch-based QLogic Fabric Manager license keys can be generated by entering the GUID of the primary and redundant management modules in the GUID: text boxes. Click Continue.
1–Installation Switch-Based QLogic Fabric Manager License Key NOTE: The FRU GUID can be found: On the label of each FRU. Using the Chassis Viewer, the View FRU button for each applicable chassis or module FRU. For the12300 via the switch Command Line Interface (CLI), using the command showIBNodeDesc. For the 12800 series via the switch Command Line Interface (CLI), using the command ShowInventory.
1–Installation QLogic 12000 Six-Port Upgrade QLogic 12000 Six-Port Upgrade Users can order a six-port License Key upgrade for the QLogic 12300-BS18 advanced 40Gb/s QDR InfiniBand switch. Refer to the licensing documentation that comes with the QLogic 12300-BS18 switch for instructions on generating the license key. Figure 1-71.
1–Installation QLogic 12000 Six-Port Upgrade Procedures 1. Record the 12300-BS18 serial number. 2. Go to the QLogic Feature Activation/License Key web site http://lk.qlogic.com. Figure 1-72. License Key Activation Center 3. Enter the 12300-BS18 serial number. Click Continue. The system validates the serial number and moves to the next screen. 4. Click Activate License Key and click Continue. 5. Enter your email address in the Email: and Confirm Email: text boxes. Click Continue. 6.
1–Installation QLogic 12000 Six-Port Upgrade 1-80 D000140-001 D
A QLogic 12000 Series Product Specifications Physical Specifications All products within the 12200, 12300 and 12800 Director series are designed to be installed in industry-standard 19-inch four-post server racks. Racks should conform to conventional standards. Use the American National Standards Institute (ANSI)/Electronic Industries Association (EIA) standard ANSI/EIA-310-D-92 and International Electrotechnical Commission (IEC) 297. These racks are commercially available in various depths.
A–QLogic 12000 Series Product Specifications Environmental Specifications Environmental Specifications Operating temperature: Non-operating temperature: 5°–40°C at sea level, altitude derating 1°C per 300m to 2,400m -40°C to 65°C Relative humidity (non-condensing): Operating 5% - 85%; Non-operating 5% - 90% 12200 and 12300 Cooling and Thermal Management: Cooling: Air cooled with a hot plug fan/power tray, three fans per tray, 40mm, 12VDC (12300) Four fans, no fan trays (12200)
A–QLogic 12000 Series Product Specifications 12800 Series 12800 Series All 12800 series switches use the same fan tray modules -- intake and exhaust -and share the same thermal management attributes listed below. The quantity of fan tray modules used in each system is defined in the following table: Table A-2.
A–QLogic 12000 Series Product Specifications 12800 Series Temperatures of all major heat producing components are continuously monitored by system management modules. Fan speed is monitored and automatically adjusted by system management modules to maintain appropriate temperatures of major heat producing components. Monitoring is performed via a two wire I2C interface to each Fan Tray. Power Specifications All products within the 12800 series use a common switching power supply.
A–QLogic 12000 Series Product Specifications 12800 Series Table A-3.
A–QLogic 12000 Series Product Specifications 12800 Series Power Distribution Guidelines The following section details power distribution guidelines and recommendations for the QLogic 12800 series. The power supplies for the 12800 series has a maximum inlet current of 15amps @ 110volts and 6amps @ 220volts. Please observe power outlet, power strip and extension cable ratings.
A–QLogic 12000 Series Product Specifications 12800 Series Figure A-1. 12800-Series Power Distribution Table A-4.
A–QLogic 12000 Series Product Specifications 12800 Series Table A-4. AC Plug Types A-8 Region/Countr y Voltage Rating Plug Type Misc/Notes Europe (Schuko) 200-240 CEE 7/7 Used in Austria, Belgium, Finland, France, Germany, Greece, Hungary, Indonesia, The Netherlands, Norway, Poland, Portugal, Russia, Spain, Sweden. International 200-240 IEC 309 3-wire (two-phase & earth). Connector size and color variations are used to indicate amperage rating.
A–QLogic 12000 Series Product Specifications 12800 Series D000140-001 D A-9
A–QLogic 12000 Series Product Specifications 12800 Series Notes A-10 D000140-001 D
B Safety and Regulatory Compliance Information This section provides regulatory compliance, safety and electromagnetic compatibility (EMC) information for the QLogic 12000 series products. Safety Information Statement 1: Disconnect Device - This unit may have more than one power cord. To reduce the risk of electrical shock, disconnect all power cords before servicing unit. Verklaring 1: Apparaat loskoppelen - Deze eenheid heeft mogelijk meer dan een stroomkabel.
Safety and Regulatory Compliance Information Safety Information Dichiarazione 1: Scollegare il dispositivo - L'unità potrebbe avere più di un cavo di alimentazione. Per ridurre il rischio di scosse elettriche, scollegare tutti i cavi di alimentazione prima di intervenire sull'unità. Erklæring 1: Frakobling av enheten - denne enheten kan ha mer enn én strømledning. For å redusere faren for elektrisk sjokk, må alle strømkablene trekkes ut før enheten vedlikeholdes.
Safety and Regulatory Compliance Information Safety Information Statement 2: Chassis Lifting - Use safe practices when lifting. NOTE: Use a team of people appropriate to the weight of each specified product and in conjunction with applicable guidelines. Whenever possible, use a mechanical lift. Verklaring 2: Chassis optillen - Volg de veiligheidsinstructies bij het optillen. ANMERKUNG: Gebruik genoeg mensen voor het gewicht van elk gespecificeerd product en hanteer de toepasselijke richtlijnen.
Safety and Regulatory Compliance Information Safety Information NOTA: utilizzare un gruppo di persone adeguato al peso di ogni prodotto specifico e insieme alle indicazioni applicabili. Se possibile, usare un sollevatore meccanico. Erklæring 2: Løfting av kabinettet - utvis varsomhet ved løfting. MERK: Bruk flere personer til bæring, avhengig av vekten til hvert enkelt produkt og i samsvar med gjeldende retningslinjer. Bruk mekaniske løftemekanismer når mulig.
Safety and Regulatory Compliance Information Safety Information 声明 2： 提起机箱 - 提起机箱时请采取安全措施。 注： 请按照每个具体产品的重量来使用一定的人数，并遵照适当的说 明。可能的话，使用机械起重器。 ステートメント 2： シャーシの持ち上げ - シャーシを持ち上げる際は安全に配慮してください。 メモ : D000140-001 D 各製品の重量に見合った人数で、適切なガイドラインに従って 持ち上げてください。可能な場合は、リフト機を使用してくだ さい。 B-5
Safety and Regulatory Compliance Information Safety Information Statement 3: Energy Hazard - To reduce risk of electric shock, keep hands and fingers out of the power supply bays and backplane areas. Verklaring 3: Stroomgevaar - Reduceer het risico op een elektrische schok door handen en vingers weg te houden bij de voedingscompartimenten en de gebieden rond de centrale printplaat. Varoitus 3: Sähköiskun vaara.
Safety and Regulatory Compliance Information Safety Information Uttalande 3: Risk för elektrisk stöt. Reducera risken för elektrisk stöt genom att hålla händer och fingrar borta från strömförsörjningsfack och bakpanelsområden. Kijelentés 3: Áramütés veszélye – Az áramütés kockázatának csökkentése érdekében kezeit és ujjait tartsa távol a tápcsatlakozóktól és a hátsó területektol.
Safety and Regulatory Compliance Information Safety Information Statement 4: Laser Radiation - certain optical products may emit laser radiation. Removing covers could result in exposure to hazardous laser radiation. Radiation may be emitted from connectors or fiber optic cables. Verklaring 4: Laserstraling - bepaalde optische producten kunnen laserstraling verspreiden. Het verwijderen van dekplaten kan resulteren in blootstelling aan schadelijke laserstraling.
Safety and Regulatory Compliance Information Safety Information Declaração 4: Radiação laser - Certos produtos ópticos podem emitir radiação laser. A remoção de tampas pode resultar na exposição a níveis perigosos de radiação laser. A radiação pode ser emitida de conectores ou de cabos de fibra óptica. Declaración 4: Radiación de láser - Ciertos productos ópticos pueden emitir radiación de láser. Quitar las cubiertas podría resultar en la exposición peligrosa a radiación de láser.
Safety and Regulatory Compliance Information Safety Information Statement 5: No User Serviceable parts - Hazardous energy levels may be present inside power supplies and circuit card modules. Do not remove covers. Verklaring 5: Onderdelen die niet door de gebruiker mogen worden onderhouden - Er kunnen gevaarlijke energieniveaus aanwezig zijn binnen voedingen en printplaten. Verwijder in geen geval dekplaten. Varoitus 5: Ei osia, jotka käyttäjä voisi vaihtaa.
Safety and Regulatory Compliance Information Safety Information Uttalande 5: Inga delar kan underhållas av användaren. Farliga energinivåer kan finnas i strömförsörjningsenheter kretskortmoduler. Ta inte bort skydd. Kijelentés 5: A berendezés nem tartalmaz felhasználó által javítható alkatrészeket – Veszélyes energiaszint lehet a tápegységeken és az áramköri kártyamodulokon belül. Ne távolítsa el a burkolatokat.
Safety and Regulatory Compliance Information Safety Information Statement 6: Equipment Installation - Only qualified personnel should be allowed to install, remove or replace chassis or modules. Verklaring 6: Installatie apparatuur - Voor het installeren, verwijderen of vervangen van chassis of modules mag alleen gekwalificeerd personeel worden gebruikt. Varoitus 6: Laitteiston asentaminen. Vain pätevä asentaja saa asentaa, poistaa ja vaihtaa koteloita tai moduuleja.
Safety and Regulatory Compliance Information Safety Information Kijelentés 6: Berendezés telepítése – Kizárólag szakképzett személyzet számára megengedett a burkolat vagy a modulok telepítése, eltávolítása vagy cseréje. Инструкция 6: Установка оборудования – Установка, удаление и замена корпуса или модулей устройства должна производиться только квалифицированным техническим персоналом.
Safety and Regulatory Compliance Information Safety Information Statement 7: Adding or Replacing Modules - These modules are intended only for installation in QLogic 12000 base units. Always install blanks when removing an active module. They prevent exposure to energy hazards inside the unit, contain EMI, and maintain cooling air balance in the chassis. Verklaring 7: Toevoegen of vervangen van modules - deze modules zijn alleen bedoeld voor installatie in basiseenheden uit de QLogic 12000-reeks.
Safety and Regulatory Compliance Information Safety Information Erklæring 7: Tillegging eller utskifting av moduler - disse modulene skal kun installeres i baseenhetene på QLogic 12000-serien. Installer alltid tomme enheter når en aktiv modul fjernes. De forhindrer utsettelse for strømfare inni enheten, inneholder EMI og opprettholder kjølebalansen i kabinettet. Declaração 7: Adição ou troca de módulos - Estes módulos foram projectados para serem instalados apenas nas unidades de base QLogic 12000 série.
Safety and Regulatory Compliance Information Safety Information ステートメント 7： モジュールの追加または取替え - これらのモジュールは QLogic 12000 シリーズ MPFD ベースユニットへの取り付け専用です。アクティブなモジュールを取り除 く際は、常にダミーを取り付けてください。これはユニット内の危険なエネル ギーの露出を防止し、EMI を阻止、およびシャーシ内の空冷バランスを維持しま す。 B-16 D000140-001 D
Safety and Regulatory Compliance Information Safety Information D000140-001 D B-17
Safety and Regulatory Compliance Information Safety Information Notes B-18 D000140-001 D
C Serial Port Pinouts For those users making their own serial cables, follow the guidelines below.
Serial Port Pinouts Figure C-1 represents the RJ-11 connector located on the QLogic 12200 and12300. The only serial port signals required are: Tx, Rx and Ground. All other serial port signals are NOT used. Please see Table C-1 for a list of RJ45 (on Digi) to RJ11 cross-references. The cable should connect the three RJ45 signals (on the Digi) to the RJ11 connector. The signals for the T3 card located inside the switch and spine are included for reference only. Table C-1.
Serial Port Pinouts D000140-001 D C-3
Serial Port Pinouts Notes C-4 D000140-001 D
D FRU Replacement This section details replacement information for various QLogic 12000 field replaceable units (FRUs). For replacement parts, contact QLogic or an approved reseller. NOTE: If it is part of a standard operating procedure, add replacement identification tags to both the rack and the FRU hardware to ensure that the warranty is transferred to the replacement part(s).
D–FRU Replacement QLogic 12300 3. Remove the switch from the rack. Keep all rail hardware installed in the rack. 4. Remove the hat rails from the switch. Set these aside for for reinstalling the replacement switch. Replacement Procedures 1. Install the hat rails to the switch. 2. Rack mount the switch in the existing rails on the rack. 3. Connect Ethernet and Serial cables (managed 12200 only). 4. Connect AC power. 5.
D–FRU Replacement QLogic 12300 Fan/Power Supply Replacement FRU part number:12300-PS01 NOTE: These fan/power supplies are to be used exclusively with the QLogic 12300 QDR InfiniBand switch and are not intended to be sold separately. Removal Procedures 1. Push the finger tab to the right. 2. While holding the finger tab, pull the module handle to disengage the unit from the switch. Figure D-1 .12300 Fan/Power Module Removal Replacement Procedures 1.
D–FRU Replacement QLogic 12800 Series QLogic 12800 Series Fan Replacement FRU part numbers: Intake Fan: 12800-FITK Exhaust Fan: 12800-FEXH Removal Procedures 1. While holding the handle, push the release latch to the right Figure D-2 .12800 Fan Removal D-4 2. Pull the fan by the handle until disengaged from the chassis. 3. Determine whether this is an intake or exhaust fan by checking the FRU label or noting the location of the open notch.
D–FRU Replacement QLogic 12800 Series Figure D-3 .12800 Intake and Exhaust Fans Replacement Procedures 1. Slide the fan tray straight into the open slot until it engages with the backplane connector. 2. Make sure the fan is operating and the status LED is green.
D–FRU Replacement QLogic 12800 Series Power Supply Replacement FRU part number:12800-PS01 NOTE: These power supplies are to be used exclusively with the QLogic 12800-series QDR InfiniBand switches and are not intended to be sold separately. Removal Procedures 1. Push the release latch to release the arm. Figure D-4 .12800 Power Removal 2. Carefully pull the supply until it is disengaged from the chassis. Replacement Procedures D-6 1.
D–FRU Replacement QLogic 12800 Series Leaf Module Replacement FRU part number: 18 Port Leaf: 12800-LF18 24 Port Leaf: 12800-LF24 Removal Procedures NOTE: If the leaf module is in one of the chassis management slots, the mechanical release latch (MRL) must be moved in order to remove the leaf. To move the MRL, loosen the thumbscrew attached to the the Serial, Ethernet, Chassis EEPROM Board (SEEB) module, then slide the MRL to the left. This allows enough clearance for leaf release arm. Figure D-5 .
D–FRU Replacement QLogic 12800 Series 1. Pull the release arms down until the leaf module disengages from the backplane connector. Figure D-6 .12800 Leaf Removal 2. Carefully pull the module out of the chassis. Replacement Procedures D-8 1. Slide the module straight into the open slot until it engages with the backplane connector. 2. Push the arm up until they lock in place. 3. Make sure the module is operating and the Status LED is green.
D–FRU Replacement QLogic 12800 Series Spine Module Replacement FRU part number: Single Spine Module: 12800-SPSG01 Double Spine Module: 12800-SPDB01 Removal Procedures 1. Pull the release arms out until the spine module disengages from the backplane connector. Figure D-7 .12800 Spine Removal 2. Carefully pull the module out of the chassis. Replacement Procedures 1. Slide the module straight into the open slot until it engages with the backplane connector. 2.
D–FRU Replacement QLogic 12800 Series Management Module Replacement FRU part number:12800-MM01 Removal Procedures 1. Loosen the thumbscrew until it releases from the faceplate. 2. Pull the release arms out until the management module disengages from the backplane connector. Figure D-8 .12800 Management Module Removal 3. Carefully pull the module out of the chassis. Replacement Procedures 1. Slide the module straight into the open slot until it engages with the backplane connector. 2.
Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway Aliso Viejo, CA 92656 949.389.6000 www.qlogic.com International Offices UK | Ireland | Germany | India | Japan | China | Hong Kong | Singapore | Taiwan © 2010 QLogic Corporation. Specifications are subject to change without notice. All rights reserved worldwide. QLogic and the QLogic logo are registered trademarks of QLogic Corporation. All other brand and product names are trademarks or registered trademarks of their respective owners.
