y ar im in SANbox-16HA High Availability Fibre Channel Switch Installer’s/User’s Manual Pr el Publication No. 59005-03 Rev.
y ar in QLogic Corporation 6321 Bury Drive Eden Prairie, MN 55346 (952) 932-4000 Release Number 03, Revision A ( August, 2000) im The following paragraph does not apply to the United Kingdom or any country where such provisions are inconsistent with local law: THIS PUBLICATION is printed “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
y Table of Contents ar Preface 1 el im in How to Use This Manual 1 Intended Audience 1 Related Materials 2 Safety Notices 3 Sicherheitshinweise 3 Notes informatives relatives à la sécurité 3 Communications Statements 4 Federal Communications Commission (FCC) Class A Statement 4 Canadian Department of Communications Class A Compliance Statement 4 Avis de conformité aux normes du ministère des Communications du Canada 4 CE Statement 5 VCCI Class A Statement 6 Laser Safety Information 7 Labeling Requir
Installation y ar im 2 in Power Switches 1-19 Test Mode Switch 1-19 Front Panel LEDs 1-20 Heartbeat LED (Yellow) 1-20 Switch Logic Power Good LED (Green) 1-20 Power Supply Fail LED (RED) 1-20 Over Temperature LED (Red) 1-21 Logged-In LED (Green) 1-21 Traffic LED (Yellow) 1-22 AC Input Power Connectors and Fuses 1-22 Switch Management Connector 1-22 Chassis Back 1-23 Power Supply(s) 1-24 Back Panel Lights 1-24 Pr el Introduction 2-1 Unpack 2-1 Place or Mount the Equipment 2-2 Shelf Mount 2-2 Rack Moun
ar 3 Diagnostics/Troubleshooting in Introduction 3-1 Power Supply Troubleshooting 3-2 Power-On-Self-Test (POST) 3-6 Overview 3-6 Heartbeat LED Blink Patterns 3-8 Test/Failure Descriptions 3-8 Cable Continuity Tests 3-12 Removal/Replacement Procedures Pr el Introduction 4-1 Input Fuse 4-1 Removal 4-1 Replacement 4-2 GBIC 4-3 Removal 4-3 Replacement 4-4 Power Supply 4-6 Removal 4-6 Replacement 4-7 Battery 4-7 im 4 y TL_Ports 2-19 T_Ports 2-19 Tuning Ports for Multi-Frame Sequences 2-20 Zoning 2-21
y ar Reference Information el A im in Mesh Latency 5-9 Mesh Bandwidth 5-10 Mesh Physical Distance Between Chassis 5-10 Mesh Zoning 5-11 MKII Compatibility 5-11 Multistage Topology 5-12 T_Port Rules for SANbox IO/T Chassis 5-12 T_Port Rules for SANbox Cross-Connect (CC) Chassis 5-12 Multistage Fabric Size 5-12 Multistage Latency 5-12 Multistage Bandwidth 5-13 Multistage Physical Distance Between Chassis 5-13 Multistage Zoning 5-13 MKII Compatibility 5-13 Multistage Examples 5-14 Cabling 5-17 Fiber Opti
B QLogic Customer Support ar y Help Desk B-1 Hardware Support B-1 Software Support B-2 Customer Responsibilities B-2 Pr el im in Index SANbox-16HA Fibre Channel Switch Installer’s/User’s Manual 59005-03 Rev.
el im in ar SANbox-16HA Fibre Channel Switch 1-1 Segmented Loop Topology Example 1-4 SCSI Example 1-6 TCP/IP Example 1-7 Chassis Front 1-17 Typical GBIC 1-18 Right Power Switch and Test Mode Switch 1-19 Chassis Back 1-23 Cabinet Mounting Bracket 2-3 IEC Class 1 Laser Information Label 2-4 Extending Buffer Credits by Chaining Ports 2-11 Cabling 2-13 Variety of Public Connections 2-14 Private Segmented Loop Connections 2-15 Private Translated Loop Connections 2-16 Test Mode Switch 3-6 Fuse Holder Removal
y Preface ar How to Use This Manual This manual has five sections and two appendixes: Section 1 is an overview of the Switch. It describes indicator lights and all user controls and connections. • Section 2 explains how to install the Switch. • Section 3 contains troubleshooting procedures, explains the Power-On-SelfTest (POST). • Section 4 contains removal/replacement procedures for all field replaceable units (FRUs).
Related Materials y The following manuals and materials are referenced in the text and/or provide additional information. Switch Management Installer’s/User’s Manual, Publication Number 59010. Available from QLogic Corporation. • Fibre Channel-Arbitrated Loop (FC-AL-2) Rev. 6.8 • Fibre Channel-Private Loop SCSI Direct Attach (FC-PLDA) NCITS TR-19:1998 • Fibre Channel-10-bit Interface Rev. 2.
Safety Notices y A Danger notice indicates the presence of a hazard that has the potential of causing death or serious personal injury. Danger notices appear on the following pages: ar 2-5, 2-6, 4-6 A Warning notice indicates the presence of a hazard that has the potential of causing moderate or minor personal injury. A Warning notice appears on page: 4-7 Sicherheitshinweise in A Caution notice indicates the presence of a hazard that has the potential of causing damage to the equipment.
Communications Statements y The following statements apply to this product. The statements for other products intended for use with this product appear in their accompanying manuals. in ar Federal Communications Commission (FCC) Class A Statement This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
CE Statement y The CE symbol on the equipment indicates that this system complies with the EMC (Electromagnetic Compatibility) directive of the European Community (89/ 336/EEC) and to the Low Voltage (Safety) Directive (73/23/EEC). Such marking indicates that this system meets or exceeds the following technical standards: EN60950/A11:1997 “Safety of Information Technology Equipment, Including Electrical Business Equipment”. • EN60825-1:1997 “Safety of Laser Products, Part 1.
ar y VCCI Class A Statement Translation: Pr el im in This is a Class A product based on the standard of the Voluntary Control Council For Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio disturbance may arise. When such trouble occurs, the user may be required to take corrective actions. 6 Preface 59005-03 Rev.
Laser Safety Information ar y This product may use Class 1 lasers to communicate over the fiber optic conductors. The U.S. Department of Health and Human Services (DHHS) does not consider Class 1 lasers to be hazardous. The International Electrotechnical Commission (IEC) requires labeling information that states that the lasers are Class 1.
Accessible Parts y The only Field Replaceable Units (FRUs) in the SANbox-16HA Fibre Channel Switch are: Fuses associated with the AC power input, • Power supply(s), and • Interfaces to the interconnection media called GBICs. ar • Pièces Accessibles in Other than these FRUs, there are no accessible parts in the Switch chassis. Removal of the top of the Switch chassis will void the warranty. Refer to Section 3 Diagnostics/Troubleshooting for more information.
QLogic Customer Support Fax: (952) 932-4018 Attn: Customer Support E-Mail: support@QLogic.com ar Web: www.QLogic.com y Phone: (952) 932-4040 Pr el im in Please refer Appendix B QLogic Customer Support for an explanation of QLogic Customer Support. SANbox-16HA Fibre Channel Switch Installer’s/User’s Manual 59005-03 Rev.
Notes Preface 59005-03 Rev.
Section 1 y General Description ar Introduction Pr el im in The SANbox™-16HA High Availability Fibre Channel (FC) Switch is the Fabric component of a Fibre Channel compliant network. Figure 1-1 is an illustration of the Switch. This manual describes the Switch as a full-featured fabric Switch unless otherwise specified. Figure 1-1 SANbox-16HA Fibre Channel Switch SANbox-16HA Fibre Channel Switch Installer’s/User’s Manual 59005-03 Rev.
Major Fibre Channel Port Features Major Fibre Channel Port Features Major Fibre Channel port features include: Each Switch chassis has 16 Fibre Channel ports. Each port operates at 1062.5 megabaud. • Any or all 16 ports may be: ar y • Fabric ports connect to fibre channel public devices and device loops. A fabric port is self configuring as an F_Port for a public device or as an FL_port for a loop of public devices. Refer to “Fabric Port Overview” on page 1-3.
Major Fibre Channel Port Features • You may populate 2 to 16 ports with GBICs. The choice of ports and GBICs is yours. y The Switch has been validated with GBICs that support a variety of interconnection media. Refer to “Fibre Channel Ports” on page 1-17 for more information. in ar Fabric Port Overview All ports on the SANbox-16HA chassis are “Loop-aware” FL_Ports.
Major Fibre Channel Port Features Private Loop Segment SL_Port Switch SL_Port Private Loop Segment Hub in Hub ar y Figure 1-2 shows a possible topology of a Segmented Loop. In this figure, there are three distinct loop segments that have been linked (placed in the same segmented loop zone) together by the Switch as a single Segmented Loop. This means that all three loop segments share the same address space (same set of Arbitrated Loop Physical Addresses (AL_PAs)).
Major Fibre Channel Port Features Devices in the same segmented loop zone communicate with one another as though they were on the same physical loop. • Devices on SL_Ports cannot communicate with devices on F, FL or TL_Ports. They also cannot communicate with devices on SL_Ports which are not in the same segmented loop zone. • Devices connected to SL_Ports are not registered with the Name Server. • Each loop segment may have a Fibre Channel Frame in process.
Major Fibre Channel Port Features ar y Translated Loop Port (TL_Port) Overview You may use Switch management to configure any or all ports on the SANbox-16 chassis as Translated Loop ports (TL_Ports). TL_Ports connect to devices which conform to the Fibre Channel-Private Loop SCSI Direct Attach (FC-PLDA) standard.
Major Fibre Channel Port Features TCP/IP protocols are also supported. Figure 1-4 shows possible topologies for TCP/IP: Server 1 to and from Server 2 (Public device to/from Private device) • Server 3 to and from Server 4 (Private device through fabric to/from Private device on different loop).
Major Fibre Channel Port Features The set of off-loop devices that a single TL_Port may proxy may overlap or exclude the devices accessed by other TL_Ports in the same fabric. • The set of off-loop devices proxied by a TL_Port is contained in its translation entries list. y • in ar The translation entries list for a TL_Port connected to Private targets will contain the initiators (both Public and Private) that try to communicate with those targets.
Major Switch Chassis Features TL_Port Management y Refer to the Switch Management manual for more information. SANsurfer Switch management provides the following: The user may choose which ports (if any) are TL_Ports. • The user may use Name Server Zoning or Hard Zoning to limit the number of Public devices that have access to a particular TL_Port to 31 devices or less. • The user may disable the Auto Learning feature for any TL_Port. The default for each TL_Port is Auto Learning enabled.
Major Switch Chassis Features Each chassis has two separate AC power inputs, one for each power supply. The left AC power input provides input power to the left power supply. The right AC power input provides input power to the right power supply. • The Switch performs Power-On-Self-Tests (POSTs) each time it is poweredup. POST provides one pass through the battery of tests, but does not test the GigaBit Interface Converters (GBICs).
Major Switch Management Features Major Switch Management Features Switch management allows you to: Manage multiple fabrics • Select a fabric and set up the connection to the Ethernet port on the Switch chassis through-which the selected fabric is managed • Configure the Switch Management interface with its IP network configuration parameters and SNMP configuration parameters • For fabrics which contain multiple Switch chassis, you may view the topology of the selected fabric including the T_Port conn
Major Switch Management Features Perform Trace operations to follow selected operations through the selected chassis • Read and write memory locations on the selected chassis • Update the Flash memory on the selected chassis • Divide the ports or devices into zones for more efficient and secure communication among functionally grouped nodes.
Major Switch Management Features Name Server Zoning by World Wide Name Segmented Loop Zones ar y Name server zoning by world wide name (WWN) allows the division of the fabric into as many as 256 zones that define which devices receive Name Server information. A particular device may be defined in one or more Name Server zones. A device will receive Name Server information for all Name Server zones of which it is a member.
Major Switch Management Features Configure Loop Devices including: Place any NL_Port into Loop Bypass Mode - Place any or all NL_Ports back into normal Loop Mode - Reset the Loop - Re-initializing the Loop y - ar • Configure the translation entries list for TL_Ports and control the TL_Port Auto Learning feature • Archive all configurable chassis parameters for all the chassis in a fabric • Restore all configurable chassis parameters for all chassis in a fabric by using the archived configura
Switch Management Tools Switch Management Tools The SANsurfer Switch management application • Telnet • A Trivial File Transfer Protocol (TFTP) • A built-in SNMP Agent ar • y The Switch supports switch management primarily through the following tools. Refer to the Switch Management Manual for information about these tools.
• Set or read the IP network configuration • Read the SNMP configuration information • Online testing y Switch Management Tools • Load switch firmware • Modify configuration parameters ar Trivial File Transfer Protocol (TFTP) The following functions are available in TFTP: Pr el im in Simple Network Management Protocol (SNMP) SNMP enables you to read management information from the switch. 1-16 General Description 59005-03 Rev.
Fibre Channel Ports Fibre Channel Ports Over Temperature LED (Red) 1 Rx in im Fibre Channel Port RX TX 8 Logged-In LED (Green) Power Switch 4 6 5 3 Right AC Power Supply Switch Management Connector (RJ45) Tx 2 Tx Traffic LED (Yellow) Switch Logic Power Good LED (Green) el Rx Port Number Heartbeat LED (Yellow) Power Supply Fail LED (Red) Left AC Power Supply ar y Figure 1-5 identifies the parts of the chassis front. Port numbers are marked on the front of the chassis.
Fibre Channel Ports GigaBit Interface Converters (GBICs) Currently, the following GBICs are certified for use: Short-wavelength fiber optic GBICs 100-M5-SN-I or 100-M6-SN-I without OFC to support connection to non-OFC Fibre Channel components. • Long-wavelength fiber optic GBICs 100-SM-LC-L. • Copper Inter-Enclosure GBIC (Active) 100-TW-EL-S or 100-TP-EL-S with either DB-9 or HSSDC connectors. • Copper Inter-Enclosure GBIC (Passive) 100-TW-EL-S or 100-TP-EL-S with either DB-9 or HSSDC connectors.
Front Panel Controls Front Panel Controls ar y Power Switches There are two Power Switches and Figure 1-5 shows their location. Figure 1-7 shows the right Power Switch. The left Power Switch controls the left Power Supply and the right power Switch controls the right Power Supply. Each Power switch is a rocker switch (press the right side (labeled 1) to turn it ON, press the left side (labeled 0) to turn it OFF).
Front Panel LEDs Front Panel LEDs ar y Refer to Figure 1-5. LEDs visible through lenses in the front of the chassis indicate chassis and port status. During a Reset operation (for about two seconds at the beginning of power-up) all LEDs are forced ON. The following definitions are valid following the Power-On-Self-Test (POST) when the POST finds no errors.
Front Panel LEDs y Over Temperature LED (Red) This LED is normally OFF. The over temperature LED illuminates to indicate that the air temperature inside the switch has exceeded a certain limit. If this LED illuminates, inspect the following: Ambient air temperature: maximum 40°C (104°F) • Proper clearance: 163mm (6.
AC Input Power Connectors and Fuses AC Input Power Connectors and Fuses ar y Traffic LED (Yellow) Each port has its own Port Activity LED. The Port Activity LED for a particular port is ON when Class 2, or 3 frames are entering or leaving the port. The Switch turns the LED ON for 50 msec. for each frame, so you should be able to see it for one frame. This LED will not light for frames following an arbitrated loop in bypass mode. im in Refer to Figure 1-5.
Chassis Back Chassis Back ar y Refer to Figure 1-8. The back of the chassis contains bays for two Power Supplies. The fan is part of the power supply. Air enters the front of the chassis and exits the back of the chassis. Power Good Light (Green) Over Temperature Light (Red) im in Fan Cover Plate (no second power supply) el Power Supply Optional Power Supply Bay Pr Locking Screws Figure 1-8 Chassis Back SANbox-16HA Fibre Channel Switch Installer’s/User’s Manual 59005-03 Rev.
Chassis Back y Power Supply(s) The chassis has bays for two power supplies. When there is only one supply, it can operate from either bay and the unused bay is covered with a plate. ar The fan on a Power Supply also furnishes cooling for the Switch chassis. A Power Supply fan draws air from the front of the chassis and expels it from the back of the chassis. One Power Supply with its cooling fan is sufficient to operate the Switch.
Section 2 Introduction ar y Installation There are nine basic steps required to install the Switch. 2. Place or Mount the Equipment 3. Apply the IEC Laser Safety Label (If the installation contains fiber optic GBICs and is in Europe) 4. Install the GBICs 5. Connect the Switch to AC power 6. Check the Power-On-Self-Test (POST) results 7. Cable Fibre Channel Devices to the Switch 8. Configure the chassis 9. Configure the ports im in Unpack el Unpack 1. 1.
Place or Mount the Equipment Place or Mount the Equipment ar y NOTE: If this chassis is part of a Multistage Switch please read Section 5 Multi-Chassis Fabrics. It may affect the way you place or mount this chassis. The Switch may be placed on a flat surface and stacked, or mounted in a 19” EIA rack. The Switch comes with rubber feet on the bottom for placing it on a flat surface. in Air flow is front-to-back. The top of each chassis has dimples for the rubber feet of a chassis stacked on top.
Place or Mount the Equipment The following steps describe how to mount the chassis in a rack: Mount the Brackets. The chassis must sit on rails or a shelf in the rack or cabinet. Refer to Figure 2-1. The Switch is shipped with a package containing cabinet mounting brackets. The screws are already in the chassis so you must remove them and reuse them to mount the brackets. Mount these brackets on either the front or back corners of the chassis. 2.
Apply the IEC Class 1 Laser Information Label (If the installation is in Europe) Apply the IEC Class 1 Laser Information Label (If the installation is in Europe) CLASS 1 LASER PRODUCT LASER KLASSE 1 in LUOKAN 1 LASERLAITE APPAREIL A LASER DE CLASSE 1 ar y Refer to Figure 2-2. When a Switch using fiber optic GBICs is installed in Europe, IEC regulations require that a Class 1 laser information label be placed where it is clearly visible whenever access to the optical ports is possible.
Install GBICs Install GBICs y You may populate your Switch with 2 to 16 GBICs. The choice of ports and GBICs is yours. The Switch has been validated with GBICs that support a variety of interconnection media. ar If this chassis is part of a Multi-Chassis fabric, please read Section 5 MultiChassis Fabrics. It may effect the way you install the GBICs in this chassis.
Connect to AC Power DANGER: y This product is supplied with a 3-wire power cable and plug for the user’s safety. Use this power cable in conjunction with a properly grounded outlet to avoid electrical shock. ar You may require a different power cable in some countries because the plug on the cable supplied with the equipment will not fit your electrical outlet. In this case you must supply your own power cable.
Switch Logic Power Good LED Refer to Appendix A Reference Information for Switch power requirements. Connect the power cable to the front of the chassis. 2. Connect the other end of the power cable to a 3 wire, grounded, AC outlet that delivers power in accordance with the power requirements specified in Appendix A Reference Information. Press the Power Switch to the ON position. Refer to Figure 1-5 for its location. ar y 1.
Cable Fibre Channel Devices to the Switch Cable Fibre Channel Devices to the Switch • ar y NOTE: • If this chassis is part of a Multistage Switch, please read Section 5 MultiChassis Fabrics and follow the cabling instructions in that section before cabling the Fibre Channel Devices to the Switch. If this chassis is an SL Private Loop chassis, refer to “SL Private Loop Stage Type” on page 1-5. in There are two types of Fibre Channel devices, Public and Private.
Cable Fibre Channel Devices to the Switch y Private devices connect to Segmented Loop Ports (SL_Ports) or Translated Loop Ports (TL_Ports). Use Switch Management to configure SL or TL_Ports. Refer to Section 1 General Description for a description of SL and TL_Ports. Refer to “Configure the Ports” on page 2-18. ar Mixing Public and Private Devices on the Same Loop. You may place a Private device on a Public loop but the Private device will not be able to communicate outside the loop.
Cable Fibre Channel Devices to the Switch Distance ar y The maximum distance between each adapter and the Switch depends on the type of GBICs and the type of cable installed. Refer to Appendix A Reference Information for this information. Also, the speed and Fibre Channel Revision Level of each adapter must be compatible with the Switch and the type of I/O media of each adapter must be compatible with the particular GBIC on the Switch. in Port Buffer Credits Each port has eight buffer credits.
Cable Fibre Channel Devices to the Switch y Figure 2-3 shows a server connected to a switch that is cabled for 24 credits through port 5. Tx 1 F_Ext24 3 Rx Tx Rx 5 7 10 8 6 Donor Donor Tx 9 12 11 Rx im Tx 4 in Rx 2 ar Internal Connections Rx Tx Pr el AA AA AAA Figure 2-3 Extending Buffer Credits by Chaining Ports Hot-Pluggable All GBICs and cables are “hot-pluggable”.
Cable Fibre Channel Devices to the Switch Fiber Optic Connections y Keys on “Duplex” cable assemblies (a connector-pair containing both transmit and receive fastened together in one unit), prevent you from connecting them incorrectly. ar On the Switch end of the connection, on the top row of ports, the transmit connector is the right-hand connector of each pair. On the bottom row of ports, the transmit connector is the left-hand connector of each pair.
Cable Fibre Channel Devices to the Switch Public Loop Storage Devices Connected to Public Servers ar y Figure 2-4 shows Public Loop storage devices connected to FL_Ports. The servers may be able to attach to either F or FL_Ports. If this is the case, use Switch Management to force the FL_Ports to function as F_Ports. If the servers will only attach to F_Ports, the ports will “self discover and function as F_Ports. Refer to “Configure the Ports” on page 2-18.
Cable Fibre Channel Devices to the Switch Variety of Public Device Connections y Figure 2-5 shows a variety of Public device connections.
Cable Fibre Channel Devices to the Switch Private Segmented Loop Connections ar y Figure 2-6 shows the connection of Private Loop servers and Private Loop storage units. Each SL_Port is one segment of a segmented loop. Each segmented loop may be divided into a maximum of 33 segments. Use Switch management to configure the appropriate ports to SL mode and to link SL_Ports (segments) into segmented loops.
Cable Fibre Channel Devices to the Switch Private Translated Loop Connections y Figure 2-7 is an example of Translated Loop ports (TL_Ports) used in conjunction with each other and with F and FL_Ports. Use Switch management to configure the appropriate TL_Ports and to identify the “off loop” initiators and targets for devices on each TL_Port. in ar Note in Figure 2-7 that Public Server 1 (a Public device) is an initiator for RAID 1 on Private Loop 1.
Configure the Chassis Configure the Chassis y If this chassis is part of a Multi-Chassis fabric, follow the instructions in “Chassis Configuration” on page 5-18. 1. ar If this is a single chassis switch, the only configuration necessary is the Ethernet port. To configure the chassis, do the following: Physically connect a management station to the ethernet port of the chassis through which the fabric will be managed. 2.
Configure the Ports Configure the Ports Use Switch Management for all port configuration. y Fabric Ports ar The default mode of each Switch port is FL. That is, each port can automatically discover that it must operate as an F_Port if it is connected to an N_Port device adapter or operate as an FL_Port if it is connected to an NL_Port device adapter. Some device adapters are N_Port only, other device adapters are NL_Port only, and the F_Port has no problem discovering its proper mode.
Configure the Ports TL_Ports y The set of off-loop devices proxied by a TL_Port is contained in its translation entries list. ar The translation entries list for a TL_Port connected to Private initiators will contain the targets (both Public and Private) that you want the Private initiator to communicate with. Auto Learning is not able to enter these targets into the translation entry list. Switch management allows you to manage the translation entries list for these TL_Ports.
Configure the Ports el im in ar y Tuning Ports for Multi-Frame Sequences In most circumstances, tuning of an individual port is not desirable, and the default setting (Normal) should be left unchanged. However, certain Host-Bus-Adapters (HBA) perform better with tuning. To support optimum performance with these HBAs, the Switch allows individual ports to be tuned based on the characteristics of a particular HBA.
Zoning Zoning • Hard zones • Name Server zones • Segmented loop zones • Broadcast zones ar y SANbox switches use the following types of zoning to restrict or extend access to devices in the fabric: in Refer to Section 5 Multi-Chassis Fabrics for information about zoning and multichassis fabrics.Refer to the Switch Management manual for information about creating zones. Hard Zones Name Server Zones im Hard zones provide security by allowing access only among hard zone member devices.
Rack and Shelf Administration Broadcast Zones y Broadcast zones focus the distribution of broadcast messages to only those devices that need to receive them. This reduces traffic on the fabric and eliminates unnecessary message processing. Broadcast zones can overlap and are also assigned by port. ar Rack and Shelf Administration im Operating the Switch in Switch management uses racks and shelves to organize the fabric topology display for easier monitoring. A rack consists of one or more shelves.
Section 3 y Diagnostics/Troubleshooting ar Introduction This section contains information to help you diagnose and troubleshoot problems with your Switch. Power Supply Troubleshooting helps you solve AC power and Power Supply problems. • Power-On-Self-Test (POST) checks the condition of the Switch with the exception of the GBICs. • Fiber Continuity tests for open fibers in the cable network. Pr el im in • SANbox-16HA Fibre Channel Switch Installer’s/User’s Manual 59005-03 Rev.
Power Supply Troubleshooting Power Supply Troubleshooting y Table 3-1 and Table 3-2 are troubleshooting matrixes for finding AC source power and Power Supply problems. They use indications such as LEDs and fan rotation to find problems. Use Table 3-2 for chassis that contain one Power Supply. Use Table 3-1 for chassis that contain two Power Supplies.
Power Supply Troubleshooting O n ar O n O ff O n Y e s Replace Power Supply/Fan Power Switches ON Fan O n in Over Temperature LED (Red) O ff Power Supply Good Light O ff Fan Over Temperature LED (Red) O ff im Power Supply Good Light) Lights on Back of Power Supply Over Temperature LED (Red) O n Lights on Back of Power Supply Corrective Action O n O ff O ff O n O n O n O ff O n Y e s Fix cause of overheat, else replace faulty Power Supply Pr Power Supply overheat O n Su
Power Supply Troubleshooting Table 3-2 Troubleshooting Matrix (Single Power Supply) Power Supply Fail LED (Red) Over Temperature LED (Red) Power Supply Good Light Over Temperature LED (Red) Fan Power Switch ON Corrective Action Chassis OFF Off NA* Off Off Off Off No Press the appropriate Power Switch to 1 (ON) ON - OK On NA* Off On Off On Yes None Off NA* Off Off Off Off Yes Check AC source, plug, and fuse Off NA* Off Off Off On Yes Replace Power Supply/Fan Power S
Power Supply Troubleshooting For example: Note in Table 3-1 that when you have a Switch chassis with two power supplies and the Power Supply Fail LED lights, you should look at the back of the chassis to see the condition of the Power Good and Over Temperature LEDs and the Fan for each power supply to find the problem. 2.
Power-On-Self-Test (POST) Power-On-Self-Test (POST) Overview y The Switch checks the state of the Test Mode switch as part of its power-up procedure. Refer to Figure 3-3 for the location of the Test Mode switch. ar 16 14 in Dot on the faceplate Dot on the switch 15 im Test Mode Switch Figure 3-1 Test Mode Switch el The normal setting of this switch (note the location of the dot on the switch relative to the dot on the faceplate) instructs the Switch to run the diagnostics one time at startup.
Power-On-Self-Test (POST) ar y NOTE: In the following POST error descriptions you will note that some errors result in a Switch that is operable, but in a degraded way (non-fatal errors), other errors result in a Switch that is not operable (fatal errors).Whether the problem is fatal or nonfatal, please contact QLogic Customer Support or your authorized maintenance provider. If the problem is non-fatal, you should be able to run in a degraded mode until the problem is fixed.
Power-On-Self-Test (POST) • Switch Management port logic • Arbitrated Loop tests y Heartbeat LED Blink Patterns Normal (all pass) ar If all POST diagnostics pass, the Switch will go to normal operation and the Heartbeat LED will blink at a steady rate of one (1) blink per second. in 1 Second Failure Blink Patterns 3 Seconds el 1 Second im The Heartbeat LED indicates the error by blinking a series of blinks, pausing for three seconds, then repeating the blinks.
Power-On-Self-Test (POST) Flash Checksum Failure/Switch Management Port (Ethernet) Tests Good (3 Blinks) The Switch is not operable The Flash checksum test verifies the integrity of the Flash ar y data. If the Flash data is corrupt, the POST next checks the Switch Management port to find out if it is functional. It does this because the Switch Management port is the load path for loading new Flash data.
Power-On-Self-Test (POST) Fibre Channel Port Loop-back Test Failure (8 Blinks) y This test runs in Continuous Test only. Continuous Test is controlled by the Test Mode switch. Use this test only under the direction of QLogic Customer Support or your authorized maintenance provider. They will tell you how to activate this test.
Power-On-Self-Test (POST) Switch Auto-Route Test Failure (10 Blinks) The Switch is operable. ar y The Switch Auto-Route Test verifies the auto-route capability of individual ports to automatically route frames to the other ports in the chassis. A failure indicates an inability to successfully route frames between a port pair and blinks the Heartbeat LED ten times between three-second pauses. The Switch disables the failing ports or port-pairs and blinks their Logged-in LEDs. 11 Blinks— Not used.
Cable Continuity Tests Cable Continuity Tests Did this correct the problem? Replace the faulty cable. No Contact your support representative. Pr el im in Yes ar If possible, swap another set of cables into the faulty link. y When there is a problem communicating over a particular link and both the Switch and the N_Port adapter pass their respective tests, check the continuity of the cables. 3-12 Diagnostics/Troubleshooting 59005-03 Rev.
Removal/Replacement Procedures y Section 4 ar Introduction The only Field Replaceable Units (FRUs) in the Switch are the Input Fuses, GBICs, and the Power Supply(s). Input Fuse in Removal Turn OFF the Power Switch. 2. Unplug the AC Power Cable from the appropriate AC Power Plug Assembly. 3. Refer to Figure 4-1. Insert a thin-blade screwdriver into the slot behind the tab and use it to pull the Fuse Holder out the front of the AC Power Plug Assembly. 4. Pull the Fuse from the Fuse Holder.
Input Fuse Replacement Insert the Fuse into the Fuse Holder. Refer to Appendix A Reference Information for fuse-type information. 2. Refer to Figure 4-2. Insert the Fuse Holder into the right side of the AC Power Plug Assembly and press it in until it clicks flush with the front surface of the assembly. 3. Plug the AC Power Cable into the AC Power Plug Assembly. 4. Press the Power Switch to the ON position. ar y 1.
GBIC GBIC y GBICs may be removed and replaced with the Switch power on without disrupting traffic on other ports. Removal Disconnect the cable (if one is connected) from the GBIC you are removing. 2. Remove GBICs. Some GBICs have individual latches; others are operated by a built-in bail. To remove GBICs that have individually operated latches, as shown in Figure 4-3, do the following: ar 1.
GBIC y To remove GBICs that have bail-operated latches, as shown in Figure 4-4, use your finger-tip to rotate the bail outward, then pull on the bail to remove the GBIC. ar Connector in Keyway Latch Bail Replacement im Figure 4-4 Removing GBICs that have bail-operated latches GBICs may be removed and replaced with the Switch power on without disrupting traffic on other ports. Orient the GBIC as shown in Figure 4-5.
GBIC Slide the GBIC into the port opening (the spring-loaded door will open as you push the GBIC in). If you can only slide the GBIC in about an inch (2.5 cm) before it stops, you have the Keyway in the wrong position; flip the GBIC over and try it again. 3. Push the GBIC in until the GBIC Latches snap into place. If you have a GBIC that has bail-operated latches, make sure that the bail is rotated to the latched position. This allows the latches to latch (refer to Figure 4-4). 4. Cable the port.
Power Supply Power Supply y DANGER: Do not attempt to open the covers of the power supply. Power supplies are not serviceable and must be replaced as a unit. ar GEFAHR: Versuchen Sie auf keinen Fall, die Abdeckung des Netzteils zu entfernen. Die Netzteile sind nicht wartbar. Sie müssen als ganze Einheit ersetzt werden. DANGER: in L’alimentation électrique ne se répare pas. En cas de panne, la remplacer au complet. Ne pas essayer d’en ouvrir le boîtier.
Battery Replacement If you are placing a Power Supply in a Power Supply Bay that currently has a Cover Plate on it, first remove the Cover Plate. Use a large flat-blade screwdriver to turn each of the two Locking-Screws 1/4 turn counterclockwise. ar 1. y If the Switch contains two Power Supplies, either supply is “Hot-Pluggable”. That is, one supply can be replaced while the Switch is powered-up and operating as long as the other supply is operating properly.
Battery Notes Removal/Replacement Procedures 59005-03 Rev.
Section 5 y Multi-Chassis Fabrics ar Introduction in You may use SANbox Switch chassis as building blocks to build a multiple-chassis fabric that will expand the number of user ports beyond the number in any one chassis. Also, the cables used for interconnecting chassis in this multiple-chassis fabric allow you to distribute the network in a campus environment, placing the user ports near to where you need them. The actual cable length is given in Appendix A Reference Information. .
Introduction y Three Multi-Chassis Topologies There are three basic multi-chassis topologies for SANbox Switches: Cascade, Mesh, and Multistage™. ar NOTE: Use your SANbox Switch chassis in any of these topologies, but do not mix the topologies in the same fabric. That is, use your chassis in a Cascade, or Mesh, or Multistage but do not use a combination of topologies in the same fabric. im in The term “cascade” indicates that chassis are connected in a row “one-to-thenext”.
Introduction Choosing a Topology The topology you choose depends on the following major fabric requirements: The size of the fabric (number of user ports required), • The amount of latency the users can tolerate (number of chassis hops and interconnection media delay between the source port and the destination port), • The bandwidth between chassis (the number of T_Port paths between interconnected chassis), • The physical distances required between users in a “campus” distributed fabric verses a cen
Introduction Bandwidth Between Chassis ar y Each T_Port link between directly connected chassis contributes 100 megabytes of bandwidth between those chassis. Devoting half of the chassis ports to T_Ports may provide as much bandwidth between directly connected chassis as there is to user ports on the chassis (no bottleneck between chassis). One T_Port interconnection between chassis is the minimum. Fabric topology also affects bandwidth between chassis.
Cascade Topology Cascade Topology ar y The term “cascade” indicates that chassis are connected in a line “one-to-thenext”. You may optionally have chassis interconnections from the last chassis back to the first chassis (Loop). The loop provides better latency because any chassis can route traffic in the shortest direction to any another chassis in the loop. The loop also provides failover when only one chassis interconnection is used. Figure 5-1 shows an example of Cascade-with-a-loop interconnection.
Cascade Topology ar y Cascade Fabric Size SANbox-16 chassis connected in Cascade topology expand from two chassis to a maximum of eight chassis. If you use Cascade-with-a-loop topology and cable eight T_Ports on each chassis for chassis interconnection (four to each adjacent chassis), this results in a maximum of 64 user ports. If you cable two T_Ports on each chassis for chassis interconnection (one to each adjacent chassis), this results in a maximum of 112 user ports.
Cascade Topology ar y Cascade Bandwidth A chassis in a Cascaded topology divides its chassis interconnection bandwidth between adjacent chassis. That is, half of the T_Ports connect one direction around the loop and the other half connect the other direction around the loop. Even if you cable half of the chassis ports to T_Ports, you will only have one quarter of the chassis bandwidth connected in the direction of the least number of chassis hops to the destination chassis.
Cascade Topology y Cascade Zoning Sanbox Switch chassis support fabric-wide zones for all zone types. Broadcast Zones and Name Server Zones require no special consideration in a cascade fabric. That is, you may assign these zones on a user-port-by-user-port basis and T_Ports are not zoned. in ar Hard Zones, however, require zoned T_Port interconnections between chassis which contain ports in the same Hard Zone.
Mesh Topology Mesh Topology y The term “mesh” indicates that each chassis has at least one T_Port directly connected to each other chassis. im in ar In fabrics containing two or three chassis, Cascade-with-a-loop topology and Mesh topology are exactly the same. Note in Figure 5-2 that you could take any three chassis and their interconnections and draw them in a row with a loop back from the last chassis to the first chassis (the same as Cascade-with-a-loop).
Mesh Topology ar y Mesh Bandwidth A chassis in a Mesh topology divides its chassis interconnection bandwidth among the other chassis in the fabric. That is, each chassis has at least one T_Port connection to each other chassis in the fabric. In small fabrics of two or three chassis, you could have two or more connections to each other chassis. In fabrics of four or five chassis you should connect only one T_Port to each other chassis. Otherwise you will use more than half of your ports as T_Ports.
Mesh Topology Mesh Zoning y Sanbox Switch chassis support fabric-wide zones for all zone types. Broadcast Zones and Name Server Zones require no special consideration in a mesh fabric. That is, you may assign these zones by port or by device. T_Ports are not zoned. in ar Hard Zones, however, require zoned T_Port interconnections between chassis which contain ports in the same Hard Zone.
Multistage Topology Multistage Topology ar y A Multistage Switch consists of chassis configured in two different Stage Types, an Input-Output/Transfer (IO/T) stage type, and a Cross-Connect (CC) Stage Type. Two or more chassis with the IO/T Stage Type supply user ports to connect to the users, and T_Ports that connect to one or more chassis with the CC Stage Type. The chassis with the CC Stage Type supply interconnections for the T_Ports.
Multistage Topology ar y Multistage Bandwidth Multistage topology has the best bandwidth. All T_Ports from each IO/T chassis connect to all other IO/T chassis in the same number of chassis hops (three) no matter how large the fabric is. Thus the useful interconnection bandwidth from each IO/T chassis to any other IO/T chassis increases by 100MBs per T_Port.
Multistage Topology Pr el im in ar y Multistage Examples Figures 5-3 through 5-5 are examples of Multistage topology using SANbox-16 Switch chassis. Figure 5-3 SANbox-16 Multistage with one T_Port link from each IO/T chassis Figure 5-3 shows a Multistage Switch built from SANbox-16 chassis. One T_Port on each IO/T chassis (the minimum) connects to the CC chassis. This provides 100 MBytes of bandwidth between each IO/T chassis and no failover in case a T_Port fails.
y Multistage Topology ar 2 2 im 2 in 2 2 2 el 2 2 Figure 5-4 SANbox-16 Multistage with two T_Port links from each IO/T chassis Pr Figure 5-4 shows a Multistage Switch built from SANbox-16 chassis. Two T_Ports on each IO/T chassis connect to the CC chassis. This provides 200 MBytes of bandwidth between each IO/T chassis and failover in case a T_Port fails. Each IO/ T chassis distributes the available T_Port access among its user ports.
Pr el im in ar y Multistage Topology Figure 5-5 SANbox-16 Multistage with eight CC chassis Figure 5-5 shows a Multistage Switch built from SANbox-16 chassis. One T_Port on each IO/T chassis (the minimum) connects to each CC chassis. This provides 800 MBytes of bandwidth between each IO/T chassis and failover in case T_Ports or CC chassis fail. Each IO/T chassis distributes the available T_Port access among 5-16 Multi-Chassis Fabrics 59005-03 Rev.
Cabling y its user ports. In this case there is a T_Port for each user port. If a T_Port or CC chassis fails, the chassis re-assigns the user port from the failed path to another T_Port/CC that is good. Note that any IO/T chassis can communicate with any other IO/T chassis with just three chassis hops (counting the source and destination chassis). ar There are eight user ports remaining on each IO/T chassis. All user ports may be F, FL, SL, or TL_Ports.
Chassis Configuration Chassis Configuration y There are two parameters that control the role that each chassis plays in a multichassis fabric: Stage Type and Chassis Number. ar Assign the Stage Type and Chassis Number for the selected chassis using the SANsurfer Switch management application. Refer to“Chassis Configuration Process” on page 5-19 for an explanation of this process.
Chassis Configuration Process Chassis Configuration Process Physically Connect a Management Station directly to the Ethernet port of the chassis through which the fabric will be managed. y 1. 2. in ar Follow the Ethernet Cabling instructions in the Switch Management manual to install the Switch (any Switch chassis in the fabric) temporarily on an isolated Ethernet network with the subnet address 10.x.x.x (By default, the Switch’s IP address is 10.0.0.1.).
Chassis Configuration Process The Fabric Topology window will display all the Switch chassis in the fabric and show the T_Port interconnections. Initially, all chassis will be IO/T chassis. Double click a chassis that you want to configure. The application will jump to the Switch Faceplate display for the selected Switch chassis. d. Just below the faceplate is the Chassis Parameters/Switch Statistics area.
Appendix A y Reference Information ar Appendix A contains the specifications for the SANbox-16 Fibre Channel Switch. Refer to “Fibre Channel Ports” on page 1-17 for the location of all connections, switches, and components. QLogic Customer Support in Phone: ................................................(952) 932-4040 Fax:.....................................................(952) 932-4018 Attn: Customer Support E mail:................................................support@QLogic.com Web: .........
SANbox-16HA Fibre Channel Switch Specifications SANbox-16HA Fibre Channel Switch Specifications Switch ar y Fibre Channel Protocols:....................FC-PH Rev. 4.3 FC-PH-2 (selected features) FC-PH-3 (selected features) FC-GS-2 (selected features) FC-AL-2 (compliant) FC-FLA (compliant) FC-SW (in development) FC-GS-2 (selected features) in Fibre Channel Classes of Service: .....Class 3, Class 2 Modes of Operation: ..........................
SANbox-16HA Fibre Channel Switch Specifications ar y Media Type:........................................Industry standard Gigabit Interface Converter (GBIC). Hot pluggable. Media supported by the Standard: Shortwave 100-M5-SN-I Shortwave with OFC 100-M5-SL-I Longwave 100-SM-LL-L Copper 100-TW-EL-S Any type in any fabric port. in Media Transmission Ranges: .............See GBIC specifications on pages A-6 through A-8. Fabric Port Speed: .............................1.
SANbox-16HA Fibre Channel Switch Specifications y Switch Maintainability Maintenance Strategy: .......................
SANbox-16HA Fibre Channel Switch Specifications Switch Mechanical Chassis Dimensions: .......................... Refer to Figure A-1 and Figure A-2. ar y Enclosure Types: ................................The chassis is shipped with four rubber feet on the bottom for secure stacking. Cabinet Mounting Brackets are also shipped with the chassis.
SANbox-16HA Fibre Channel Switch Specifications Non-Operating Altitude: ....................0 to 15240m (0 to 50,000 feet) y Non Operating Vibration:...................(In any axis): 5-500 Hz, random, 2.09 G rms, 10 minutes ar Non Operating Shock:........................(In any axis): 30g, 292 ips, 13 ms, 3 repetitions. Switch Regulatory Certifications Safety Standards: ...............................UL1950 CSA 22.2 No. 950 EN60950 in Emissions Standards: .........................
SANbox-16HA Fibre Channel Switch Specifications Receiver Sensitivity: ..........................-16dBm average y Distance: ............................................500 meters maximum using 50 micron fiber 300 meters maximum using 62.5 micron fiber ar Safety: ................................................DHHS 21 CFR(J), IEC 825-1, CENELEC EN 60825-1, VDE Longwave Laser GBIC (single-mode) Connector:..........................................Duplex SC in Color coding: ..............................
SANbox-16HA Fibre Channel Switch Specifications y Copper Intra-Enclosure GBIC (passive) Connector:..........................................Style 1 (9 pin D-subminiature, DB-9) Style 2 (HSSDC, looks like wide phone jack or RJ45) ar Cable: .................................................Fibre Channel 100-TW-EL-S (shielded dual parallel pair cable) Fibre Channel 100-TP-EL-S (shielded dual twisted pair cable) Differential Impedance: .....................150 ohms +/- 10 ohms in Transmitted Signal: ......
SANbox-16HA Fibre Channel Switch Specifications Rx Tx 1 Tx 2 4 6 5 3 10 8 9 7 Rx 12 11 in 85.34 (3.36") ar y 444.5 (17.5") 14 13 16 15 17.78 (.7") Pr el im Front Back Figure A-1 SANbox-16HA Switch Front/Back Dimensions in Millimeters (Inches) SANbox-16HA Fibre Channel Switch Installer’s/User’s Manual 59005-03 Rev.
SANbox-16HA Fibre Channel Switch Specifications in ar y 17.78 (.7”) im 552.45 (21.75”) Pr el 508 (20.00”) 444.5 (17.5”) 38.1 (1.5”) Figure A-2 SANbox-16HA Switch Top View Dimensions in Millimeters (Inches) A-10 Reference Information 59005-03 Rev.
Appendix B y QLogic Customer Support ar This appendix describes the basic warranty and customer support. Customers who purchased directly from QLogic may contact Customer Support as described in this appendix. We encourage other customers to contact their reseller or authorized maintenance provider. Description: Consists of: in Help Desk Assistance related to questions about QLogic products. • Diagnostic assistance. • Providing information about available fixes and workarounds.
Software Support Software Support y QLogic actively supports the current software/firmware release and the prior release for 6 months following the general availability date for the current release. You are encouraged to keep your software/firmware levels current. ar For supported software: • QLogic will attempt to isolate and verify the reported problem. • If applicable, QLogic will give you a software/firmware fix or work around along with descriptive documentation.
y Index C el backup components A-4 bandwidth between chassis 5-4 cascade 5-7 mesh 5-10 multistage 5-13 battery 4-7 broadcast zone 1-12, 2-22 buffer credits 1-2, 2-10, A-2 im B Pr cable continuity tests 3-12 length 5-4, 5-17, A-2 cabling incorrect 2-11 multi-chassis 5-17 private devices 2-8 public devices 2-8 cascade bandwidth 5-7 definition 5-2 distance between chassis 5-7 example 5-5 fabric size 5-6 latency 5-6 MKII compatibility 5-8 topology 5-5 with-a-loop 5-5 zoning 5-8 caution notice 1-3 CC - Se
Index y port features 1-2 protocols A-2 Fibre Channel Port Loop-back Test Failure 3-10 Fibre Channel-Private Loop SCSI Direct Attach 1-4 Field Replaceable Unit 1-8, 4-1, A-4 FL_Port configuration 2-18 description 1-2 topology example 2-14 Flash Checksum Failure/Ethernet Failure 3-9 Flash Checksum Failure/Ethernet Tests Good 3-9 Force PROM Mode in Effect 3-9 frame limit tuning 2-20 size 1-2, A-3 front panel controls 1-19 LEDs 1-20 FRU - See Field Replaceable Unit.
Index MKII compatibility cascade 5-8 mesh 5-11 multistage 5-13 mounting brackets 2-3 multi-chassis topologies 5-2 multi-frame sequence 2-20 multistage 5-1 bandwidth 5-13 definition 5-2 distance between chassis 5-13 examples 5-14 fabric size 5-12 latency 5-12 MKII compatibility 5-13 T_Port 5-12 topology 5-4, 5-12 zoning 5-13 Hung Flash Control Code 3-11 I ar y IEC regulations 2-4 immunity A-6 in order delivery 5-4 Input-Output/Transfer stage type 1-9, 5-2 installation 2-1 IO/T - See Input-Output/Transfe
Index ar el im rack administration 2-22 mount 2-2 RAID 2-16 RAM Failure 3-8 reference information A-1 regulatory certifications A-6 related materials 1-2 removal/replacement procedures 4-1 rubber feet 1-10, 2-3 in R S Pr safety notices 1-3 standards A-6 SANsurfer 1-5, 1-9, 1-15 scalability A-2 SCSI 1-4 segmented loop example 1-4, 2-15 features 1-4 overview 1-3 zone 1-13, 2-18, 2-21 Segmented Loop Port - See SL_Port.
Index unpack 2-1 user interface A-4 V ar in im U y private targets 1-8, 2-19 public initiator 1-6 public targets 1-8 topologies supported 1-6 translation entries list 1-8, 2-19 zoning 1-8 topology cascade 5-5 choosing 5-3 mesh 5-9 mixing 5-4, 5-8, 5-11 Multistage 5-12 Traffic LED 1-22 translated loop example 2-16 Translated Loop Port - See TL_Port. translation 1-6 Trivial File Transfer Protocol 1-16 troubleshooting cable continuity 3-12 power supply 3-6 Trunk Port - See T_Port.
Notes Index 59005-03 Rev.
