Cisco 10000 Series Router Performance Routing Engine Installation Product Numbers: ESR-PRE, ESR-PRE1, and ESR-PRE2 Document Version History This is the third version of this document. The document version history beginning with this online part number is in Table 1.
Related Documentation • Managing PRE Redundancy, page 20 • Upgrading Software, page 21 • Managing System Boot Parameters, page 22 • Upgrading from an ESR-PRE or ESR-PRE1 to an ESR-PRE2, page 25 • Managing the Router Using the Network Management Ethernet Port, page 31 • Analyzing and Troubleshooting Packets, page 34 • Obtaining Documentation, page 40 • Documentation Feedback, page 41 • Cisco Product Security Overview, page 42 • Obtaining Technical Assistance, page 43 • Obtaining Additio
Product Overview Figure 1 Distributed Processing Architecture in the PRE Performance routing engine Route processor PXF network processor Forwarding engine ASICs Packet buffers 33359 Backplane ASIC Line card Line card Line card Redundant PREs You can configure two PREs in a single chassis for redundancy. If the primary PRE fails, the secondary PRE automatically takes over operation of the router.
Product Overview Within the Cisco 10000 series ESR, two PXF network processor ASICs are used, yielding four parallel processing pipelines, each containing eight processors in a row.
Product Overview PRE Faceplates The faceplates of the PRE, PRE-1, and PRE-2 are shown in this section. Performance Routing Engine, Product Number ESR-PRE, Front Panel OT 1 0 SL ST AT US FA IL R MI NO IT IC AL MA JO R CR AC O 87348 OT SL ALARMS AC T ET IV IT Y HE R LIN NE T K PERFORMANCE ROUTING ENGINE CISCO 10000 CO AU X NS OL E Figure 3 Figure 3 shows the front panel of the Performance Routing Engine, product number ESR-PRE.
Prerequisites and Preparation LED Indicators and Switches LEDs on the front panel of the PRE provide a visual indication showing the status of PRE operation. The LEDs are separated into three categories: alarms, status, and failure. • Alarm LEDs—Indicate any critical, major, or minor alarms generated by the Cisco 10000 router. Alarm relay contacts can be used to connect the router to an external visual or audio alarm system.
Software Compatibility Warning Note This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents. To see translations of the warnings that appear in this publication, refer to the Regulatory Compliance and Safety Information document that accompanied this device.
Installation Guidelines The Cisco 10000 router is hot-swappable which means you can remove and replace a PRE while the system is operating—if you have a secondary (redundant) PRE installed in the chassis. This feature allows you to add, remove, or replace a PRE while the system maintains all routing information and ensures session preservation. Caution Replacing the primary PRE in a non-redundant chassis (no secondary PRE) causes a system shutdown and stops all traffic.
Installation Guidelines Figure 6 Inserting a Screwdriver Blade Into a Bezel Latch FANS OK FAN FAILURE MULTI-FAN FAILURE Cisco 10000 30038 POWER FAULT MISWIRE POWER POWER FAULT FAULT MISWIRE MISWIRE Figure 7 Unlocking the Bezel Latch FANS OK FAN FAILURE MULTI-FAN FAILURE Cisco 10000 POWER POWER FAULT FAULT MISWIRE MISWIRE Step 1 30039 POWER FAULT MISWIRE Unlock each bezel latch by inserting the tip of a flat-blade screwdriver between the top and bottom sections of the latch (Figure 6), and th
Installation Guidelines Figure 8 Removing the Front Cover from the Cisco 10008 Router FANS OK FAN FAILURE MULTIFAN FAILURE When hot CAUTION removal swapping this fan be done and replaceme tray, system in under two nt must shutdown minut will occures or .
Installation Guidelines Powering Off the System If you are installing or replacing a system with a single PRE, you must power down the system. Figure 9 Setting DC Power Switch to the Off Position FANS OK FAN FAILUR E MULTI FAN FAILUR E When hot CAUTION removal swapping this fan be done and replacement tray, must system in under two shutdo wn will minutes or occur.
Installing or Replacing the PRE Figure 10 Setting AC Power Switch to the Off Position FANS OK FAN FAILUR E MULTI FAN FAILUR E When hot CAUTION removal swapping this fan be done and replacement tray, must system in under two shutdo wn will minutes or occur.
Installing or Replacing the PRE Installing a PRE Use the following procedure to install the PRE into slot 0A or slot 0B in the Cisco 10000 chassis. Note If you are replacing a PRE, see the “Removing a PRE” section on page 17 before you begin this procedure.
Installing or Replacing the PRE Figure 12 Inserting the PRE FANS OK FAN FAILURE MULTIFAN FAILURE When hot CAUTION removal swapping this fan be done and replacem tray, system in under two ent must shutdow minu n will occutes or r.
Installing or Replacing the PRE Figure 13 Closing the Ejector Levers FANS OK FAN FAILURE MULTIFAN FAILURE When hot CAUTION removal swapping this fan be done and replaceme tray, system in under two nt must shutdown minu will occutes or r.
Installing or Replacing the PRE Figure 14 Captive Screw Locations FANS OK FAN FAILURE MULTIFAN FAILURE When hot CAUTION removal swapping this fan be done and replacem tray, system in under two ent must shutdow minu n will occutes or r.
Installing or Replacing the PRE Removing a PRE Use the following procedure to remove a PRE from the chassis: Figure 15 ESD Chassis Connection 5 5 5 5 CISCO 10000 5 IT IC A L A JO R M O R C R IT IC A M L A JO R M IN O TA TU S FA 6XCT3–DS0 S 6XCT3–DS0 R 6XCT3–DS0 FAULT MISWIR E AC O OC–12/STM–4 POS SM–IR IN PERFORMANCE ROUTING ENGINE R M PERFORMANCE ROUTING ENGINE C 6XCT3–DS0 6XCT3–DS0 CH OC-12-DSO SM-IR POWER AC O S TA TU IL S FA IL PROC ESSO 1 1 S
Installing or Replacing the PRE Figure 16 Captive Screw Locations FANS OK FAN FAILURE MULTIFAN FAILURE When hot CAUTION removal swapping this fan be done and replacem tray, system in under two ent must shutdow minu n will occutes or r.
Installing or Replacing the PRE Figure 17 Opening the Ejector Levers FANS OK FAN FAILURE MULTIFAN FAILURE When hot CAUTION removal swapping this fan be done and replaceme tray, system in under two nt must shutdown minu will occutes or r.
Managing PRE Redundancy Managing PRE Redundancy This section explains how to manage redundant PRE failover methods. Synchronizing PRE Configurations You do not need to specify redundancy between PREs. If two PREs are installed in the Cisco 10000 series router, they automatically act as a redundant pair. In the default state, redundant PREs are configured to automatically synchronize all critical files. You can use the auto-sync command to specify which files should be synchronized.
Upgrading Software Forcing Failover in a Redundant Pair To manually force the primary and secondary devices in a redundant pair to failover, use the redundancy force-failover command. Manually force the primary and secondary PREs to reverse roles if you need to replace the primary one. You can then replace the PRE while causing only minimal disruption of traffic. Router# redundancy force-failover main-cpu This command does not generate an alarm as a hardware reset does.
Managing System Boot Parameters Upgrading Software on Redundant PREs This section tells you how to upgrade software on redundant PREs. For the procedure described here to work, PRE redundancy should be configured as auto-sync standard (the default). See the “Synchronizing PRE Configurations” section on page 20. Step 1 Copy the IOS image from a TFTP server to the Flash disk in slot 0. Router# copy tftp disk0: Address or name of remote host [172.31.53.
Managing System Boot Parameters • The behavior of the Break function By modifying the boot parameters, you can customize your Cisco 10000 series router. For example, a common configuration register setting in some lab environments is 0x2100. Using this setting, the system boots to the ROM monitor prompt, where a technician can load a specific image by entering the boot command at the rommon prompt. (For more information, see the Cisco IOS Configuration Fundamentals Configuration Guide.
Managing System Boot Parameters Table 3 Definition of Bits in the Software Configuration Register Bit No. Hex Value Meaning/Function 00 to 03 0x0000 to 0x000F Defines the source of a default Cisco IOS software image required to run the router: • 00—At power-on, the system remains at the ROM monitor prompt (rommon>), awaiting a user command to boot the system manually by means of the rommon boot command.
Upgrading from an ESR-PRE or ESR-PRE1 to an ESR-PRE2 Upgrading from an ESR-PRE or ESR-PRE1 to an ESR-PRE2 This section describes the procedures for upgrading the Performance Routing Engine from an ESR-PRE or ESR-PRE1 to an ESR-PRE2. Procedures for downgrading from an ESR-PRE2 to an ESR-PRE1 or ESR-PRE are also described.
Upgrading from an ESR-PRE or ESR-PRE1 to an ESR-PRE2 Upgrade Procedures This section contains several upgrade procedures: • Upgrading the Primary PRE to an ESR-PRE2, page 26 • Upgrading the Secondary PRE of a Redundant Pair of PREs to an ESR-PRE2, page 28 • Reversing an Upgrade to an ESR-PRE2, page 29 Upgrading the Primary PRE to an ESR-PRE2 Follow this procedure to upgrade: • A single PRE in a Cisco 10000 chassis that does not have a redundant, secondary PRE.
Upgrading from an ESR-PRE or ESR-PRE1 to an ESR-PRE2 Note Step 8 The config-register of a new ESR-PRE2 (shipped from the factory) is set to 0x0. If your ESR-PRE2 is not new from the factory, and the config-register is not set to 0x0, it may behave differently while booting up. From the console in ROM monitor mode, enter the appropriate boot command, depending on whether you saved the ESR-PRE2 image to a TFTP server or a flash-based media card, or whether you did not save the ESR-PRE2 image.
Upgrading from an ESR-PRE or ESR-PRE1 to an ESR-PRE2 The router is available for normal operations and the upgrade is complete. Saved the Configuration on a TFTP Server If you booted the c10k2-p11-mz image, and you saved the previous configuration to a TFTP server: a. Enter the initial configuration dialog, and enter all required information to allow access to the TFTP server. b. Assign the correct IP address for the Fast Ethernet interface to become active and for the TFTP server to become reachable.
Upgrading from an ESR-PRE or ESR-PRE1 to an ESR-PRE2 b. Boot the image from the flash-based media card in the ESR-PRE2 in slot B. The redundant ESR-PRE2 in slot B comes up as the secondary PRE, and the configuration synchronizes automatically between the two PREs. If you do not have any removable media devices, then you upgrade this redundant ESR-PRE2 as if it was a single ESR-PRE2: a. Remove the ESR-PRE2 from slot A and go to Step 7 of the “Upgrading the Primary PRE to an ESR-PRE2” section on page 26.
Upgrading from an ESR-PRE or ESR-PRE1 to an ESR-PRE2 Table 4 PRE LED Status and Descriptions LED Status Description LED Status Description Ethernet port: ACTIVITY Green Packets are being transmitted and received. Off No activity. Ethernet port: LINK Green Carrier detected, the port is able to pass traffic. Off No carrier detected, the port is not able to pass traffic. PCMCIA slot 0 Green Slot 0 is active. PCMCIA slot 1 Green Slot 1 is active.
Managing the Router Using the Network Management Ethernet Port Table 5 PRE Installation Troubleshooting (continued) Symptom The Fail LED does not light during the power-on self-test PRE does not operate properly Possible Cause 1. The PRE is not properly seated. 2. Bad PRE slot or backplane connector. 1. Bad PRE slot or backplane connector. 2. Bad PRE. Corrective Action 1. Be sure the ejector levers are fully closed and that the captive screws have been tightened. 2.
Managing the Router Using the Network Management Ethernet Port When you manually configure duplex mode, the NME port can experience problems such as flapping. If this occurs, disable duplex mode by entering the no full-duplex or no half-duplex command. When you enter the no duplex command, the operational mode reverts to autonegotiation mode.
Managing the Router Using the Network Management Ethernet Port To configure the NME port, perform the following optional configuration tasks: • Manually Setting the Duplex Mode for the NME Port—ESR-PRE2, page 33 • Manually Setting the Speed of the NME Port—ESR-PRE2, page 33 Manually Setting the Duplex Mode for the NME Port—ESR-PRE2 To manually configure the duplex mode of the NME port for ESR-PRE2, enter the following command in interface configuration mode: Command Purpose Router(config-if)# duplex
Analyzing and Troubleshooting Packets Analyzing and Troubleshooting Packets The Parallel eXpress Forwarding (PXF) engine of the Performance Routing Engine (PRE) is responsible for processing and forwarding packets. As processing occurs, PXF counters increment to reflect the internal behavior of the PRE. The router collects this statistical information from the counters and appropriately displays it when you enter specific show pxf cpu commands.
Analyzing and Troubleshooting Packets For example, the router processes the following ACL from top to bottom as follows: access-list 108 permit udp any host 10.68.1.10 range 0 5000 log access-list 108 permit udp host 10.1.1.10 range 0 5000 any log • Statement 1—Allows any UDP packet to access host 10.68.1.10 if the UDP destination port of the packet is between 0 and 5000. The router logs packet information to the console if a match is made. • Statement 2—Allows any UDP packet from host 10.1.1.
Analyzing and Troubleshooting Packets The following are examples of packets that can cause feedbacks to occur: • Packets that are forwarded and logged to the console • ICMP packets that are sent • Packets that require both input and output quality of service (QoS) The feedback counter reflects the total number of feedbacks through the PXF by all packets. The counter increments one time for each additional pass a packet makes.
Analyzing and Troubleshooting Packets Sample Case Study For the purposes of this case study, assume that the following ACL is configured on the router’s outbound serial 1/0/0 interface: access-list 108 permit udp any host 10.68.1.10 range 0 5000 log access-list 108 permit udp host 10.1.1.l0 range 0 5000 any log A traffic simulator is used to send 100 UDP packets to the Cisco 10000 router with the source and destination ports of the packets set to 6000.
Analyzing and Troubleshooting Packets The following example output provides packet information before sending the 100 packets. Notice that the Packets Denied field indicates that no packets have been denied by ACL 108. The Denied and Log field indicates that no denied packets have been logged. Router# show pxf cpu statistics security ACL PktsPktsDeniedPermit NameDeniedPermitted& Log& Log 108 0 0 0 0 The following example output results after sending the 100 packets.
Analyzing and Troubleshooting Packets Displaying Drop Statistics The show pxf cpu statistics drop command provides information about dropped packets and ICMP packets. The following example output indicates the count of the icmp_unrch_interval counter before sending the 100 packets. Notice that the count is zero.
Obtaining Documentation icmp_frag00 macr_bad_tag_num00 . . . Displaying Feedback Counts The show pxf cpu context command provides statistical information about the number of feedbacks occurring and new packets being processed. The following example output indicates the count of the feedback counter before sending the 100 packets. Notice that the count is 1027 feedbacks.
Documentation Feedback You can access international Cisco websites at this URL: http://www.cisco.com/public/countries_languages.shtml Product Documentation DVD Cisco documentation and additional literature are available in the Product Documentation DVD package, which may have shipped with your product. The Product Documentation DVD is updated regularly and may be more current than printed documentation.
Cisco Product Security Overview Cisco Product Security Overview Cisco provides a free online Security Vulnerability Policy portal at this URL: http://www.cisco.com/en/US/products/products_security_vulnerability_policy.html From this site, you can perform these tasks: • Report security vulnerabilities in Cisco products. • Obtain assistance with security incidents that involve Cisco products. • Register to receive security information from Cisco.
Obtaining Technical Assistance Obtaining Technical Assistance Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. The Cisco Technical Support & Documentation website on Cisco.com features extensive online support resources. In addition, if you have a valid Cisco service contract, Cisco Technical Assistance Center (TAC) engineers provide telephone support. If you do not have a valid Cisco service contract, contact your reseller.
Obtaining Additional Publications and Information For a complete list of Cisco TAC contacts, go to this URL: http://www.cisco.com/techsupport/contacts Definitions of Service Request Severity To ensure that all service requests are reported in a standard format, Cisco has established severity definitions. Severity 1 (S1)—Your network is “down,” or there is a critical impact to your business operations. You and Cisco will commit all necessary resources around the clock to resolve the situation.
Obtaining Additional Publications and Information • Internet Protocol Journal is a quarterly journal published by Cisco Systems for engineering professionals involved in designing, developing, and operating public and private internets and intranets. You can access the Internet Protocol Journal at this URL: http://www.cisco.com/ipj • Networking products offered by Cisco Systems, as well as customer support services, can be obtained at this URL: http://www.cisco.com/en/US/products/index.
Obtaining Additional Publications and Information Cisco 10000 Series Router Performance Routing Engine Installation 46 OL-3971-03
