HP ProCurve 6600 Switch Series Technical Overview v1.0 Table of contents Table of contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 List of figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 List of tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6600 series system overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Chassis layout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 System elements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 HP ProCurve 6600 Switch Power Supply (J9269A) . . . . . . . . . . . . . . .
6600 series accessories . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 HP ProCurve 6600 Switch Premium License (J9305A) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 HP ProCurve 6600 Switch Power Supply (J9269A) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 HP ProCurve 6600 Switch Fan Tray (J9271A) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Appendix A: out-of-band management port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 OOBM availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 Applications supported with OOBM port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 OOBM limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
List of figures Figure 1: Top-of-rack use model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 Figure 2: HP ProCurve 6600 Switch Series (power supply side view) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 Figure 3: HP ProCurve 6600 Switch Power Supply (J9269A) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Figure 4: Default airflow direction and connectivity side view of the 6600-24XG switch . . . . . .
Executive summary HP ProCurve Networking has an extensive line of networking products built around the concept of the ProCurve Adaptive Network vision that provides the security, mobility, and convergence capabilities businesses demand while giving technology administrators the ability to adapt to the changing needs of their organizations and control their infrastructure centrally.
common code image that enables consistency and scalability throughout the portfolio from data center core to edge. The ProVision ASICs are aimed at achieving several technology and business imperatives.
The 6600 series (specifically the 6600-24XG switch) is also ideal for end-of-row Layer 2 and Layer 3 aggregation, as the 6600-24XG switch provides the highest-density 10-Gb per rack unit in ProCurve’s product line. The advanced Layer 3 features provided in the Premium License make the 6600-24XG switch an ideal candidate for aggregation and distribution in the data center.
• 1 power supply (J9269A) −−The 6600 series has two power supply bays to support power redundancy. −−The power supplies are hot-swappable and allow for tool-less serviceability. −−The 6600 power supplies leverage the 1200 W ProLiant G6 “common-slot” supply to simplify sparing. • Rack ears for mounting in a two-post telco rack −−For mounting in a four-post network/server rack, the 6600 rack mount kit (J9469A) that includes telescoping rails is highly recommended.
Efficiency calculations include internal fans and line filter. The power supply size is 4.4 inch x 63 inch x 8 inch (57 inch) with an output power density of ~9.6W/inch. The power supply ships with two W40S12BUA5-01 40 mm^2 x 28 mm NIDEC fans or equivalent, producing 36 CFM (18 CFM each) at .5 INWG using 13.2 W (6.6 W each). In terms of the power supply load-sharing algorithm when two supplies are installed, the power load is shared equally across both supplies to improve longevity.
In the event of an individual fan failure, an SNMP trap and event log entry is generated. A system can typically operate for quite a long time with a single fan failure (out of the eight), as the remaining fans can increase speed to compensate for the loss of airflow. The fan tray replicates the Power, Fan, Fault, and Locator LEDs found on the connectivity side of the 6600 switch.
If everything matched properly (as they would from the factory), the output of the “show system fans” would simply be as follows, with no warnings or messages: ProCurve Switch 6600ml-24G# sh system fans Fan Information: Num Sys-1 State Fan Ok Airflow Direction Power To Port Failures 0 ProCurve Switch 6600ml-24G# sh system fan-pref-airflow-dir Preferred fan airflow direction: Power To Port Imagine if someone wanted their ports mounted in the front/cold aisle and they had a warranty replacement of the
Figure 6: Closeup view of the HP ProCurve 6600 Switch Series LEDs Processor The CPU processor is a Freescale PowerPC 8540 operating at 667 MHz. Memory SDRAM Synchronous Dynamic RAM (SDRAM) is used for the storage of uncompressed executable code and data structures. The SDRAM consists of a 256 MB DDR-1 DIMM in the base module, expandable up to 1 GB. The DDR-1 interface is 64 bits running at 166-MHz bus speed (333-MHz data rate).
The system also allows you to hold up to three copies of configuration files, associating them to a particular flash image (primary => Config1, secondary => Config2, Active Running session => Config3). Console port The console port allows for RS-232 serial connectivity for local management and configuration. For the 660048G, 6600-48G-4XG, and 6600-24XG switches, the console port is an RJ-45 connector.
6600 series system architecture The following section provides an architectural review of each of the HP ProCurve 6600 switches. HP ProCurve 6600-24G Switch (J9263A) Based on 3500yl design Management function (on motherboard) Mgmt. to N-chip comm. 48.0-Gbps* switching capacity 14.4-Gbps HSL 14.4-Gbps HSL F1 F1 * 48.0 Gbps = 24*2(Fdx), although F1 has a full capability of 172.
HP ProCurve 6600-24G-4XG Switch (J9264A) Based on 3500yl design Management function (on motherboard) Mgmt. to N-chip comm. 105.6-Gbps* switching capacity 14.4-Gbps HSL 14.4-Gbps HSL F1 F1 Hi- Speed 66High-speed * 105.6 Gbps = (24+28.8)*2(Fdx), although F1 has a full capability of 172.8-Gbps switching 14.4-Gbps HSL 14.4-Gbps HSL links Links • Based on 3500yl-24G design • 4 ports are dual personality (Gig-T or Gigabit fiber) NG ASIC • NGX ASIC with 18-MB packet buffer (3500yl series has 4.
2910al-24G 6600-24G 6600-24G-4XG 3500yl-24G Rack height 1U 1U 1U 1U 1-Gb RJ-45 24 24 24 24 1-Gb SFP 4* 4* 4* 4* 10-Gb SFP+ 4 (2 X2/2 CX4) – 4 4 (2 X2/2 CX4) Max. 1-Gb wire-speed ports 24 24 24 24 Max. 10-Gb wire-speed ports 4 – 2 2 Management console port RJ-45 Serial DB-9 Serial DB-9 Serial DB-9 10-Gb port buffering 6 MB** – 18 MB 4.5 MB Out-of-band mgmt.
HP ProCurve 6600-48G Switch (J9451A) Based on 5400zl design Management function (on motherboard) Mgmt. to N-chip comm. Ethernet out-of-band management port 10/100 Out - of- Band Ethernet Management port NG ASIC ASIC 96.0-Gbps* switching capacity F2 14.4-Gbps HSL * 96.0 Gbps = (24+24)*2(Fdx), although F2 has a full capability of 345.6-Gbps switching 12 High-speed 14.4-Gbps HSL links SL sH L bp HS -G ps 4 . b G 14 .
HP ProCurve 6600-48G-4XG Switch (J9452A) Based on 5400zl design Management function (on motherboard) Mgmt. to N-chip comm. 10/100 Out Ethernet out-of-band management port port 10/100 - of- Band Ethernet Management NG ASIC 24-Gb MACs 24 gig MACs * 176.0 Gbps = (24+24 + 20+20)*2(Fdx), although F2 has a full capability of 345.6-Gbps switching 176.0-Gbps* switching capacity 14.4-Gbps HSL 14.4-Gbps HSL SL sH SL bp sH -G 4 . bp G 14 .
2910al-48G 6600-48G 6600-48G-4XG 3500yl-48G Rack height 1U 1U 1U 1U 1-Gb RJ-45 48 48 48 48 1-Gb SFP 4* 4* – 4* 10-Gb SFP+ 4 (2 X2/2 CX4) – 4 4 (2 X2/2 CX4) Max. 1-Gb wire-speed ports 48 48 48 48 Max. 10-Gb wire-speed ports 4 – 4 2 10-Gb port buffering 6 MB** – 36 MB 4.5 MB Management console port RJ-45 RJ-45 RJ-45 Serial DB-9 Out-of-band mgmt.
For high-availability configurations with the 6600-48G-4XG switch, users should considerer trunking the 10-Gb uplinks across odd and even ports to take advantage of the dual paths to separate NGX chips, as show in Figure 11. NGX 49 50 51 Trunk 1 52 Trunk 2 Figure 11: Recommended trunking uplink configuration for the 6600-48G-4XG switch HP ProCurve 6600-24XG Switch (J9265A) Management function (on motherboard) Based on 5400zl design * 345.6 Gbps = (12*14.4)*2(Fdx) 345.6.
features, such as QoS and security, to be implemented in a scalable yet granular fashion. With a variety of connectivity interfaces and expanded buffering, the 6600 switches offer excellent investment protection, flexibility, and scalability, as well as ease of deployment and reduced operational expense. From a design standpoint, the 6600-24XG model is essentially the equivalent of a 5406zl chassis configured with six 4 x 10-Gb modules.
Policy Enforcement Engine The ProVision network ASICs contain the Policy Enforcement Engine. This engine provides fast packet classification to be applied to ACLs, QoS, rate limiting, and some other features through an onboard Ternary Content Addressable Memory (TCAM). Some of the variables that can be used include source and destination IP addresses (which can follow specific users), TCP/UDP port numbers, and ranges (apply ACLs to an application that uses fixed-port numbers or ranges).
ProVision ASIC CPU Each ProVision ASIC contains its own CPU for learning Layer 2 nodes, packet sampling for the XRMON/ sFlow function, handling local MIB counters, and running other module-related operations. Overall, the local CPU offloads the master CPU by providing a distributed approach to general housekeeping tasks associated with every packet. MIB variables, which need to be updated with each packet, can be done locally. The Layer 2 forwarding table is kept fresh through the use of this CPU.
HP ProCurve 6600 Switch Premium License (J9305A) With a flexible approach to upgradability and licensing, the 6600 switches can run the base feature group initially, and then be upgraded later to run the Premium License feature group. The Premium License offers advanced Layer 2 and 3 capabilities, including Q-in-Q, VRRP, PIM-SM, PIM-DM, and OSPF-ECMP. The Premium License can be transferred to another switch, as long as the license remains in the 6600 family.
10K rail kit contents 10K rails x 2 M6 screw x 12 M6 cage nut x 12 Captive washer for M6 x 12 x 4 to attach rail to rack x 2 to attach bracket to rack M4x0.7 8 mm FH screw x 4 Rack bracket x 2 (5003-1452) Hold-down brackets x 2 Figure 14: HP 10K Rack Kit (5070-0145) 6600 series air plenums The HP ProCurve 6600 Series Air Plenum is designed to help preserve cold-aisle/hot-aisle separation for improved cooling efficiency when the 6600 switch is collocated with top-of-rack servers.
Note: For use with the 6600-48G, 6600-48G-4XG, and 6600-24XG switches Figure 16: HP ProCurve 6600 Series Air Plenum Kit (J9480A) HP ProCurve 6600-24G/24G-4XG Air Plenum (J9481A) The 6600-24G/24G-4XG air plenum is used with 6600-24G and 6600-24G-4XG switches that require a longer plenum due to shorter product depth.
10-Gb SFP+ transceivers • J9150A—HP ProCurve 10-GbE SFP+ SR Transceiver • J9151A—HP ProCurve 10-GbE SFP+ LR Transceiver • J9152A—HP ProCurve 10-GbE SFP+ LRM Transceiver 10-Gb SFP+ direct attach cables • J9281B—HP ProCurve 10-GbE SFP+ 1m Direct Attach Cable • J9283B—HP ProCurve 10-GbE SFP+ 3m Direct Attach Cable • J9285B—HP ProCurve 10-GbE SFP+ 7m Direct Attach Cable Because SFP+ is a relatively new optical form factor for ProCurve, Table 5 provides a comparison between SFP and X2 for those more familiar wi
Feature Benefits Performance ProVision ASIC technology Powered by the ProVision ASICs, the switch families offer state-of-the-art, high capacity, switch fabric performance. Selectable queue configurations Increase performance by selecting the number of hardware-forwarding queues and associated memory buffer that best meet the requirements of network applications.
Feature Benefits Supports standard protocols IP Routing Supports RIPv1, RIPv2, OSPF, OSPF-ECMP, and static routes. OSPF requires the Premium License for the 6600, 5400zl, and 3500yl switches. Is standard on the 8200zl and 6200yl series switches. VLANs Supports IEEE 802.1Q with 2,048 concurrent VLANs, Group VLAN Registration Protocol (GVRP). IP Multicast Supports PIM-SM, PIM-DM, and IGMP data-driven snooping.
• IEEE 802.
Layer 3 services • Loopback interface address: defines an address in RIP and OSPF that can always be reachable, improving diagnostic capability • UDP helper function: UDP broadcasts can be directed across router interfaces to specific IP unicast or subnet broadcast addresses and prevent server spoofing for UDP services such as DHCP Layer 3 routing • RIP: provides RIPv1 and RIPv2 routing • Static IP routing: provides manually configured routing; includes ECMP capability • OSPF (requires Premium License): in
• Multiple user authentication methods: −−Multiple IEEE 802.1X users per port: provides authentication of multiple IEEE 802.1X users per port; prevents user “piggybacking” on another user’s IEEE 802.1X authentication −−Web-based authentication: authenticates from Web browser for clients that do not support IEEE 802.
Capacity, performance, and features 6600 series comparison Table 6 provides a comparison of several categories of capacity and performance levels for the ProCurve 6600 Switch Series. These include the routing and switching capacity (Gbps), switch fabric speed (Gbps), maximum number of 1 Gbps that can operate concurrently at wire speed, the maximum number of 10-Gbps ports that can operate concurrently at wire speed, and the size of the routing table (entries).
As illustrated in Figure 18, internally, there are two 14.4-Gbps channels between each four-port 10-GbE block and the switch fabric. Fabric modules Modules 14.4-Gbps 14.4 Gbps channel Channel 1 2 Fabric modules Modules or 14.4-Gbps 14.4 Gbps channel Channel 14.4-Gbps 14.4 Gbps channel Channel 14.4-Gbps 14.4 Gbps channel Channel 1 3 4 3 10-GbE 10 GbEports ports 2 4 10-GbE 10 GbEports ports Figure 18: 4-port 10-GbE blocks showing how ports are grouped to a 14.
Fabric F2 ChipModules 14.4-Gbps 14.4 Gbps channel Cha nnel 1 Port 1 can provide 10-Gbps because it does not need to share the channel with port 4 14.4-Gbps 14.4 Gbps channel Channel 2 4 14.4-Gbps 14.4 Gbps channel Channel 6600-24G switch ………………………………… 3 10-GbE ports 14.4-Gbps 14.4 Gbps channel Channel 21 1 24 4 22 3 10-GbE ports Ports 2 and 3 share this channel and the trunked link balanced the 14.
• Average per-packet latency in microseconds when performing Layer 2 switching and Layer 3 routing. These values shown are listed for both First-In-First-Out (FIFO) and Last-In-First-Out (LIFO) processing. The LIFO values represent the packet transmit time, whereas the FIFO values include the switch decision time and the packet transmit time. • Percentage of packets dropped in a full mesh configuration; 0% in all cases.
Throughput test A fully meshed performance test sends packets from each port to every other port during the test. This type of test exercises both the modules and the backplane. These tests show the ProCurve 6600 Switch Series to achieve wire speed on all ports simultaneously. Latency measurements Latency is commonly measured as the amount of time it takes for a byte inside a packet to enter and then leave the switch.
6600-24XG Power Save mode Power domain Port range Power savings 1 01–08 70 W 2 09–16 70 W 3 17–24 70 W 6600-48G-4XG Power Save mode Power domain Port range Power savings 1 01–24 35 W 2 25–48 35 W 3 49–52 (SFP+) 50 W 6600-48G Power Save mode Power domain Port range Power savings 1 01–24 35 W 2 25–48 35 W Note: The Power Save mode configured with the savepower command is only a temporary setting, and is not retained after a power cycle or reboot.
HP also can provide more broad-based services such as site surveys, installation services, and actual management of the network, depending on customer needs. More information can be found at www.hp.com/rnd/services/index.htm or by contacting a local ProCurve sales office. Appendix A: out-of-band management port The out-of-band management (OOBM) interface provides an 10/100 Ethernet-based isolated management interface to access the switch via SNMP, HTTP, SSH, and Telnet.
Appendix B: Policy Enforcement Engine The ProVision ASIC architecture used in the ProCurve 6600 Switch Series, 8200zl, 5400zl, 3500yl, and 6200yl Series brings a number of advanced capabilities to the network that offer a highly reliable, robust environment that leads to increased network uptime, keeping overall network costs down. One major feature is the ProVision Policy Enforcement Engine, which is implemented in the ProVision ASIC of each interface module.
Appendix C: PIM-Sparse Mode In Protocol Independent Multicast-Sparse Mode (PIM-SM), the assumption is that no hosts want the multicast traffic unless they ask for it specifically. In contrast, PIM-Dense Mode (PIM-DM) assumes downstream router membership unless it receives an explicit prune message. PIM-SM is appropriate for wide-scale deployment for both densely and sparsely populated groups, and is the best choice for all production networks, regardless of size and membership density.
Virus throttle works by intercepting IP-routed connection requests—connections crossing VLAN boundaries—in which the source subnet and destination subnet are different. The virus throttle tracks the number of recently made connections. If a new, intercepted request is to a destination to which a connection was recently made, the request is processed as normal.
Sensitivity The ability of connection-rate filtering to detect relatively high instances of connection-rate attempts from a given source can be adjusted by changing the global sensitivity settings. The sensitivity can be set to low, medium, high, or aggressive, as described below. • Low: Sets the connection-rate sensitivity to the lowest possible sensitivity, which allows a mean of 54 routed destinations in less than 0.
The virtual IP address shared by a group of VRRP routers on a given network segment functions as the nexthop IP address used by neighboring hosts. The VRRP Master router simply forwards packets that have been received from hosts using the VRRP Master as the next-hop gateway. The existence of a VRRP master and of one or more VRRP Backups is transparent to the neighboring hosts.
Appendix G: troubleshooting LED status indicators for 6600 series The ProCurve 6600 Switch Series management module has various LED status indicators that are described in Table G-1. LED State Indication Power On (green) The switch is receiving power. Off The switch is NOT receiving power. On (orange) On briefly at the beginning of switch self-test, after the switch is powered on or reset. If on for a prolonged time, the switch has encountered a fatal hardware failure, or has failed its self-test.
LED State Indication LED Mode Select Act (green) Flickers to show relative activity. FDx (green) Flickers to show relative activity. PoE (green) Indicates which ports are supplying power. • If • If • If • If • If Spd (green) the the the the the Mode LED Mode LED Link LED is Link LED is Link LED is is on, the port is providing PoE power. is off, the port is not providing PoE power. on, the port is enabled for PoE. off, the port is disabled for PoE.
Technology for better business outcomes To learn more, visit www.hp.com/go/procurve © Copyright 2009 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty.