Cisco 12016, Cisco 12416, and Cisco 12816 Router Clock and Scheduler, Switch Fabric, and Alarm Card Replacement Instructions Document Order Number: DOC-OL-13811-01, May 30, 2008 Product Numbers: 12016E-CSC=, 12016E-SFC=, 12416E-CSC=, 12416E-SFC=, 12816E-CSC, GSR16/80-CSC=, GSR16/80-SFC=, GSR16/320-CSC=, GSR16/320-SFC=, 12816-CSC=, 12816-SFC=, GSR16-ALRM= This publication contains removal and installation procedures for the clock and scheduler card (CSC), the switch fabric card (SFC), and the alarm card use
Contents Contents • Switch Fabric Overview, page 2 • Alarm Card Overview, page 6 • Preparing for Installation, page 8 • Removing and Installing Switch Fabric Cards, page 11 • Removing and Installing an Alarm Card, page 17 • Upgrading the Switch Fabric, page 23 • Troubleshooting the Switch Fabric, page 27 • Regulatory, Compliance, and Safety Information, page 33 • Obtaining Documentation and Submitting a Service Request, page 35 Switch Fabric Overview The heart of Cisco 12016, Cisco 12416,
Switch Fabric Overview card, wait for approximately 1 minute, and then remove the card. Primary CSC OIR results in traffic loss regardless of the line cards installed in chassis. Redundant CSC OIR should not cause traffic loss regardless of the line cards installed in chassis. A CSC can be removed and replaced with the router powered up only if there is a redundant CSC installed. If your system is running with only one CSC, you must power down the router before removing the CSC.
Switch Fabric Overview There are currently six switch fabric options: Note • Enhanced 2.5-Gbps switch fabric (80-Gbps switching system bandwidth) used in the Cisco 12016 Router—Consists of the 12016E-CSC and the 12016E-SFC fabric sets. Each SFC or CSC card provides a 2.5-Gbps full-duplex connection to each line card in the system. Thus, for a Cisco 12016 Router with 16 line cards with 2 x 2.5 Gbps (full duplex), the system switching bandwidth is 16 x 5 Gbps = 80 Gbps.
Switch Fabric Overview • Switch fabric—Carries the user traffic between line cards or between the RP and a line card. The switch fabric on the CSC is identical to the switch fabric on the SFC. • Scheduler—Handles requests from the line cards for access to the switch fabric and determines when to allow the line cards access to the switch fabric. • System clock—Sent to all SFCs, line cards, and the RP.
Alarm Card Overview The second CSC in the router provides data path, scheduler, and reference clock redundancy. The interfaces between the line cards and the switch fabric are monitored constantly. If the system detects a loss of synchronization (LOS), it automatically activates the data paths of the redundant CSC, and data flows across the redundant path. The switch to the redundant CSC occurs within sub-seconds (the actual switch time depends on your configuration and its scale).
Alarm Card Overview Monitoring Critical, Major, and Minor Alarm Status The alarm card faceplate is equipped with three pairs of LEDs—labeled Critical, Major, and Minor—that are used to identify system-level alarm conditions detected through the MBus. Note The LEDs are paired for redundancy to protect against a single failed LED. The critical and major alarm LED pairs are red; the minor alarm LED pair is yellow.
Preparing for Installation Monitoring Alarm Card, CSC, and SFC Status The alarm card faceplate has one pair of LEDs that provides a visual status of the alarm card, and five pairs of LEDs that provide a visual status of the two CSCs and the three SFCs in the switch fabric card cage (see Figure 2 on page 6). The LED pair representing the alarm card itself is not labeled, and consists of one green LED labeled ENABLED and one yellow LED labeled FAIL.
Preparing for Installation Safety with Electricity • Before beginning any procedures requiring access to the interior of the router, locate the emergency power-off switch for the room in which you are working. • Disconnect all power and external cables before installing or removing a router. • Never assume that power has been disconnected from a circuit; always check. • Do not perform any action that creates a potential hazard to people or makes the equipment unsafe.
Preparing for Installation Figure 3 • Always place a card component-side-up on an antistatic surface, in an antistatic card rack, or in a static shielding bag. If you are returning the item to the factory, immediately place it in a static shielding bag. • When installing a line card or route processor (RP), use the ejector levers to seat the card connectors in the backplane, then tighten both captive screws on the faceplate of the card.
Removing and Installing Switch Fabric Cards Required Tools and Equipment The following tools and equipment are required to remove and install a CSC, SFC, or alarm card: • ESD-preventive wrist strap • Flat-blade screwdriver Related Documentation The following publications contain additional information: • Cisco 12016, Cisco 12416, and Cisco 12816 Router Installation and Configuration Guide • Regulatory Compliance and Safety Information for the Cisco 12000 Series Internet Router Removing and Installi
Removing and Installing Switch Fabric Cards Procedures for removing and installing a CSC and SFC are described in the following sections: • Removing a Card from the Switch Fabric Card Cage, page 12 • Installing a Card into the Switch Fabric Card Cage, page 13 • Verifying the Installation, page 16 These procedures apply to all available switch fabric card sets (2.5-, 10-, and 40-Gbps). When removing and replacing cards, pay close attention to the ejector levers on the cards.
Removing and Installing Switch Fabric Cards Caution On routers with the bezel extender kit installed on the line card and RP card cage front covers, you must remove the extended front cover from the lower line card and RP card cage before attempting to open the air filter door. When the extended front cover is mounted on the chassis, the air filter door does not have adequate free space to open completely.
Removing and Installing Switch Fabric Cards Step 1 Attach an ESD-preventive wrist strap to your wrist and connect the leash to one of the ESD connection sockets on the front of the chassis or to a bare metal surface on the chassis (see Figure 3 on page 10). Step 2 Grasp the card carrier handle with one hand and place your other hand under the carrier to support and guide it into the correct slot. Slide the card halfway into the slot. Avoid touching the card circuitry or any connectors.
Removing and Installing Switch Fabric Cards Step 6 Close and fasten the air filter door as follows: a. Caution All four sides of the air filter door are lined with EMI-preventive gaskets consisting of many raised, conductive contacts. Align and seat the door carefully to avoid damaging the EMI-preventive gasket contacts. A damaged gasket can result in reduced EMI performance. b.
Removing and Installing Switch Fabric Cards Verifying the Installation To verify that the new CSC or SFC is working properly, follow these steps: Step 1 Step 2 Check the following components to make sure they are secure: • The cards in the switch fabric card cage are fully seated in their slots, and the card ejector levers are flush with the front edge of the card carriers. • The air filter door is up and seated in the switch fabric card cage opening, and the four captive screws are tightened.
Removing and Installing an Alarm Card Removing and Installing an Alarm Card The router is equipped with two alarm cards. One card occupies the dedicated far left slot of the upper card cage; the second occupies the dedicated far right slot of the lower card cage (see Figure 8). In both card cages, the alarm card slot differs from the rest of the card cage slots in that it is labeled as an alarm card slot, is physically narrower, and has a different backplane connector.
Removing and Installing an Alarm Card Figure 8 Alarm Card Locations in the Upper and Lower Card Cages DOWN CDHNT CDHNT RA RA LOOP LOOP DOWN CD CD LA LA Upper card cage TX TX 0 0 RX RX TX TX 0 1 1 RX RX TX TX 2 2 R VE IE T TI RR PK AC CA RX T EC EJ RX RX 3 TX TX R VE IE LL TI RR CE AC CA RX 4 4 RX RX R VE IE T TI RR PK AC CA RX X AU T SE RE RX RX L R R CA JO NO ITI MA MI CR 0 R E IE T TIV RR PK AC CA RX 3 -1 OT SL -0 OT SL TX TX 1 TX TX 5 2 5 RX RX LT O/
Removing and Installing an Alarm Card Step 3 Disconnect any external alarm cable attached to the alarm card connector. Step 4 Loosen the two captive screws at the top and bottom of the alarm card faceplate (see Figure 9a). Note Step 5 Caution Step 6 Unlike line cards and the RP, the alarm card does not have card ejector levers. The alarm card backplane connector is smaller, has fewer pins, and is easier to seat and unseat than line cards and the RP.
Removing and Installing an Alarm Card Installing an Alarm Card into the Upper Card Cage To install an alarm card into the upper card cage, use Figure 10 as a reference and follow these steps: Step 1 Attach an ESD-preventive wrist strap to your wrist and connect the leash to one of the ESD connection sockets on the front of the chassis or to a bare metal surface on the chassis (see Figure 3 on page 10).
Removing and Installing an Alarm Card Removing an Alarm Card from the Lower Card Cage The alarm card in the lower card cage occupies the dedicated far right slot labeled Alarm 1. Except for the head-down orientation in the lower card cage (see Figure 11), the alarm card in the lower card cage is removed in exactly the same way as described in the “Removing an Alarm Card from the Upper Card Cage” section on page 18.
Removing and Installing an Alarm Card Installing an Alarm Card into the Lower Card Cage Except for the head-down orientation in the lower card cage (see Figure 11), the alarm card is installed in the lower card cage in exactly the same way as described in the “Installing an Alarm Card into the Upper Card Cage” section on page 20. Check to be sure that all slots are filled, especially slot 15 beside the alarm card.
Upgrading the Switch Fabric Checking the Replacement Alarm Card To check the replacement alarm card installation, follow these steps: Step 1 Step 2 Verify that each of the following conditions is true: • The replacement alarm card is fully seated in its slot and both captive screws are tightened. • If an external alarm cable is connected to the alarm card, the connector is completely seated and held in place by the hold-down hardware. Visually check the LEDs on the two alarm cards.
Upgrading the Switch Fabric Upgrade Requirements Before proceeding, review the following upgrade requirements: 1. You must have a complete switch fabric card set. You cannot intermix 2.5-, 10-, and 40-Gbps CSCs and SFCs. 2. When upgrading to a 10-Gbps switch fabric with a GRP installed, the Flash memory card must be loaded with Cisco IOS Release 12.0(16)S or later. 3. When upgrading to a 10-Gbps switch fabric with a PRP installed, the Flash memory card must be loaded with Cisco IOS Release 12.
Upgrading the Switch Fabric Upgrade Procedures To upgrade the switch fabric, follow these steps: Step 1 Turn off power to the router. Step 2 Remove all CSCs and SFCs. See the “Removing a Card from the Switch Fabric Card Cage” section on page 12. Step 3 Install the new CSCs and SFCs. See the “Installing a Card into the Switch Fabric Card Cage” section on page 13. Note Although they perform similar functions, you cannot intermix SFCs and CSCs. The switch fabric is a card set.
Upgrading the Switch Fabric Note Step 3 The show gsr command output varies slightly between each switch fabric card set. See the “Troubleshooting the Switch Fabric” section on page 27 if you encounter problems. Also review the next section, Post-Upgrade Considerations.
Troubleshooting the Switch Fabric Post-Upgrade Considerations After performing an upgrade and verifying its installation, there are some post-upgrade considerations. • Cisco 12000 Series routers include a label on the side of the chassis that indicates the model of the router. The switch fabric upgrade kit does not include a new label to identify the upgraded router model.
Troubleshooting the Switch Fabric Step 5 Gather the output and proceed to the Analyzing the Data section. Analyzing the Data Switch fabric problems can occur due to failures in any of the following components: • RP • Line card hardware • Backplane • CSCs/SFCs When troubleshooting switch fabric errors, you need to look for patterns with regard to which components are reporting errors.
Troubleshooting the Switch Fabric In the example output below, you can see the status of the line card in slot 2. The crc16 data line is underlined and is showing errors from sfc1. Remember to use the attach command and not the execute-on command to access the line cards.
Troubleshooting the Switch Fabric Once you have gathered the show controllers fia command data from the RPs and line cards, you can create a table similar to Table 3. Table 3 Card Slot Error Data Collection Table CSC 0 CSC 1 SFC 0 0 SFC 1 SFC 2 SFC 3 SFC 4 ERROR 1 2 ERROR 3 ERROR 4 5 ERROR 6 7 ERROR 8 This table indicates that more than one line card is reporting errors coming from SFC 1. Therefore, the first step is to change this SFC.
Troubleshooting the Switch Fabric Router#show controllers fia Fabric configuration: Full bandwidth, redundant fabric Master Scheduler: Slot 17 Backup Scheduler: Slot 16 From Fabric FIA Errors ----------------------redund FIFO parity 0 redund overflow 0 crc32 lkup parity 0 cell parity 0 Switch cards present 0x001F Slots Switch cards monitored 0x001F Slots Slot: 16 17 18 Name: csc0 csc1 sfc0 ---------------------Los 0 0 0 state Off Off Off crc16 876 257 876 To Fabric FIA Errors ----------------------sca no
Troubleshooting the Switch Fabric %MBUS-0-NOCSC: Must have at least 1 CSC card in slot 16 or 17 %MBUS-0-FABINIT: Failed to initialize switch fabric infrastructure Note You may also get this error message if there are only enough CSCs and SFCs seated for quarter bandwidth configurations. Quarter bandwidth configurations are no longer supported on Cisco 12000 Series Routers.
Regulatory, Compliance, and Safety Information Regulatory, Compliance, and Safety Information This section includes regulatory, compliance, and safety information in the following sections: • Translated Safety Warnings and Agency Approvals • Electromagnetic Compatibility Regulatory Statements Translated Safety Warnings and Agency Approvals The complete list of translated safety warnings and agency approvals is available in the Regulatory Compliance and Safety Information for Cisco 12000 Series Internet
Regulatory, Compliance, and Safety Information Canada English Statement of Compliance This class A digital apparatus complies with Canadian ICES-003. French Statement of Compliance Cet appareil numérique de la classe A est conforme à la norme NMB-003 du Canada.
Regulatory, Compliance, and Safety Information Class A Notice for Taiwan and Other Traditional Chinese Markets Warning This is a Class A Information Product, when used in residential environment, it may cause radio frequency interference, under such circumstances, the user may be requested to take appropriate countermeasures. Statement 257 Class A Notice for Korea Warning This is a Class A Device and is registered for EMC requirements for industrial use. The seller or buyer should be aware of this.
Regulatory, Compliance, and Safety Information Cisco 12016, Cisco 12416, and Cisco 12816 Router Clock and Scheduler, Switch Fabric, and Alarm Card Replacement Instructions 36 OL-13811-01
