HP Networking 6600 Switch Series Technical Overview v1.0 Table of contents Table of contents. . . . . . . . . . . . . . . . . . . . . . . . . . . . Table of figures and tables. . . . . . . . . . . . . . . . . . . . . Executive summary. . . . . . . . . . . . . . . . . . . . . . . . . . Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . HP ProCurve 6600 Switch Series . . . . . . . . . . . . . . .
Console port. . . . . . . . . . . . . . . . . . . . . . . . . . . . Ethernet out-of-band management (OOBM) port. . . . Auxiliary (USB) port. . . . . . . . . . . . . . . . . . . . . . . 6600 series system architecture. . . . . . . . . . . . . . . . . . HP ProCurve 6600-24G Switch (J9263A). . . . . . . . . . Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ports. . . . . . . . . . . . . . . . .
HP ProCurve 6600 Switch Power Supply (J9269A). . . . . . . HP ProCurve 6600 Switch Fan Tray (J9271A). . . . . . . . . . Rack mounting options. . . . . . . . . . . . . . . . . . . . . . . . . . 2-post telco racks. . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-post racks: HP ProCurve 6600 Series Rack Mount Kit (J9469A). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Latency measurements. . . . . . . . . . . . . . . . . . . . . . . . . . Power consumption measurements. . . . . . . . . . . . . . . . . . . Power Save mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . Services and support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . Lifetime warranty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Table of figures and tables Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Table 1: Figure 7: Figure 8: Table 2: Figure 9: Figure 10: Table 3: Figure 11: Figure 12: Table 4: Figure 13: Figure 14: Figure 15: Figure 16: Figure 17: Top-of-rack use model. . . . . . . . . . . . . . . . . . . . HP ProCurve 6600 Switch Series (power supply side view). . . . . . . . . . . . . . . . . . . . . . . . . . . . HP ProCurve 6600 Switch Power Supply (J9269A). . .
Table 5: Table 6: Figure 18: Figure 19: Figure 20: Figure 21: Table 7: Table 8: Table 9: Figure A-1: Figure C-1: Figure D-1: Figure E-1: Figure F-1: Table G-1: Table G-2: SFP+ vs. X2 optics . . . . . . . . . . . . . . . . . . . . . . Capacity, performance, and features comparison of the 6600 series products . . . . . . . 4-port 10-GbE blocks showing how ports are grouped to a 14.4-Gbps channel. . . . . . . . . . . .
Executive summary HP networking has an extensive line of networking products built around the concept of the ProCurve Adaptive Network vision that provides the security, mobility, and convergence capabilities businesses demand while giving technology administrators the ability to adapt to the changing needs of their organizations and control their infrastructure centrally.
Product positioning Overview The intelligence, throughput, scalability, and physical connectivity options of the 6600 series make them suitable for applications at the server edge or aggregation/distribution layer of a compute network. The 6600 switch series leverages the same ProVision ASIC and software found in the widely deployed 8200zl, 5400zl, 6200yl, and 3500yl products.
Figure 1 provides an example of a three-tiered networking model with top-of-rack networking components.
6600 series system overview The HP ProCurve 6600 Switch Series was designed to be co-located with data center servers for both top-ofrack edge access and end-of-row aggregation and distribution deployment models. To support high availability in a 1U form factor, all 6600 series products allow for redundant hot-swappable power supply options, hotswappable fan tray, and front-to-back (reversible) airflow, along with out-of-band Ethernet management ports.
supports only the 1200 W AC supply, although the 6600 series is capable of supporting DC and other common-slot supplies. Two AC-to-12-V DC power supplies can be configured as 1+1 redundant supplies. The system is fully powered with either power supply, and either power supply (but not both) can be removed and replaced while the system is still racked, and the switch will continue to operate. Each power supply input is C14 with proper safety ground. Current 110–120 VAC 200–240 VAC < 7.5 A < 3.
Figure 4: Default airflow direction and connectivity side view of the 6600-24XG switch In the event of an individual fan failure, an SNMP trap and event log entry is generated. A system can typically operate for quite a long time with a single fan failure (out of the eight), as the remaining fans can increase speed to compensate for the loss of airflow. The fan tray replicates the Power, Fan, Fault, and Locator LEDs found on the connectivity side of the 6600 switch.
switches would more likely have their network ports facing toward the back (hot aisle) of the cabinet to facilitate server connectivity. With this intention, the default configuration for the command is, “Power-to-Port”, so the “fan-pref-airflow-dir” command will not show up in the configuration file—it is the default.
Figure 6: Closeup view of the HP ProCurve 6600 Switch Series LEDs Processor The CPU processor is a Freescale PowerPC 8540 operating at 667 MHz. Memory SDRAM Synchronous Dynamic RAM (SDRAM) is used for the storage of uncompressed executable code and data structures. The SDRAM consists of a 256 MB DDR-1 DIMM in the base module, expandable up to 1 GB. The DDR-1 interface is 64 bits running at 166-MHz bus speed (333-MHz data rate).
Console port The console port allows for RS-232 serial connectivity for local management and configuration. For the 660048G, 6600-48G-4XG, and 6600-24XG switches, the console port is an RJ-45 connector. To connect to the console, an RJ-45–to–DB-9 cable is provided with each switch to connect to the serial port on a laptop. The 6600-24G/6600-24G-4XG products offer a DB-9 serial console port for management access, and a DB-9–to– DB-9 cable is provided.
Description The HP ProCurve 6600-24G Switch is a data center optimized, advanced Layer 3 1U stackable switch with 20 10/100/1000Base-T ports and 4 dual-personality ports. The 6600 series 1U form factor switches are enhanced for server edge connectivity with front-to-back cooling, redundant hot-swappable power, and redundant hot-swappable fans.
The ASIC layout shown in Figure 8 for the data center focused 6600-24G-4XG switch adds an NGX ASIC to provide a 10-Gb uplink capability to this switch model. Unlike the 3500yl-24G switch, where the yl 10‑Gb module is rear mounted, the 6600-24G-4XG switch moves the 10-Gb ports to the front of the switch for simplified cabling. Examining the Gigabit ports, the last four ports are dual personality, meaning they can be used as RJ-45 copper ports or mGBIC (or SFP) fiber ports.
HP ProCurve 6600-48G Switch (J9451A) Based on 5400zl design Management function (on motherboard) Mgmt. to N-chip comm. Ethernet out-of-band management port 10/100 Out - of- Band Ethernet Management port NG ASIC ASIC 96.0-Gbps* switching capacity F2 14.4-Gbps HSL * 96.0 Gbps = (24+24)x2(Fdx), although F2 has a full capability of 345.6-Gbps switching 12 High-speed 14.4-Gbps HSL links L HS ps SL Gb sH p 4 . b 14 -G 4 .
HP ProCurve 6600-48G-4XG Switch (J9452A) Based on 5400zl design Management function (on motherboard) Mgmt. to N-chip comm. 10/100 Out Ethernet out-of-band management port port 10/100 - of- Band Ethernet Management NG ASIC 24-Gb MACs 24 gig MACs * 176.0 Gbps = (24+24 + 20+20)x2(Fdx), although F2 has a full capability of 345.6-Gbps switching 176.0-Gbps* switching capacity 14.4-Gbps HSL 14.4-Gbps HSL SL sH SL bp G sH .4 bp 14 -G 4 .
Table 3 details the comparison of the 6600-48G/48G-4XG switches, the 2910al-48G, and the 3500yl-48G switches in more detail. 2910al-48G 6600-48G 6600-48G-4XG 3500yl-48G Rack height 1U 1U 1U 1U 1-Gb RJ-45 48 48 48 48 1-Gb SFP 4* 4* – 4* 10-Gb SFP+ 4 (2 X2/2 CX4) – 4 4 (2 X2/2 CX4) Max. 1-Gb wire-speed ports 48 48 48 48 Max. 10-Gb wire-speed ports 4 – 4 2 10-Gb port buffering 6 MB** – 36 MB 4.
For high-availability configurations with the 6600-48G-4XG switch, users should consider trunking the 10-Gb uplinks across odd and even ports to take advantage of the dual paths to separate NGX chips, as shown in Figure 11. NGX 49 50 51 Trunk 1 52 Trunk 2 Figure 11: Recommended trunking uplink configuration for the 6600-48G-4XG switch HP ProCurve 6600-24XG Switch (J9265A) Management function (on motherboard) Based on 5400zl design * 345.6 Gbps = (12x14.4)x2(Fdx) 345.6.
features, such as QoS and security, to be implemented in a scalable yet granular fashion. With a variety of connectivity interfaces and expanded buffering, the 6600 switches offer excellent investment protection, flexibility, and scalability, as well as ease of deployment and reduced operational expense. From a design standpoint, the 6600-24XG model is essentially the equivalent of a 5406zl chassis configured with six 4 x 10-Gb modules.
Policy Enforcement Engine The ProVision network ASICs contain the Policy Enforcement Engine. This engine provides fast packet classification to be applied to ACLs, QoS, rate limiting, and some other features through an onboard Ternary Content Addressable Memory (TCAM). Some of the variables that can be used include source and destination IP addresses (which can follow specific users), TCP/UDP port numbers and ranges (apply ACLs to an application that uses fixed-port numbers or ranges).
Layer 2 forwarding table is kept fresh through the use of this CPU. Other per-port protocols, such as Spanning Tree Protocol and LACP, also are run on this CPU. The local CPU, being a full-function microprocessor, allows functionality updates through future software releases. Fabric ASIC The Fabric ASIC provides the crossbar fabric for interconnecting the modules together. The use of a crossbar allows wirespeed connections simultaneously from any module to any other module.
HP ProCurve 6600 Switch Fan Tray (J9271A) See reference in earlier text to HP ProCurve 6600 Switch Fan Tray (J9271A). Rack mounting options 2-post telco racks As part of the 6600 series package, each switch ships with rack ears for mounting in 2-post telco racks. Additional rack mount options and accessories are available detailed subsequently below.
6600 series air plenums The HP ProCurve 6600 Series Air plenum is designed to help preserve cold-aisle/hot-aisle separation for improved cooling efficiency when the 6600 switch is co-located with top-of-rack servers. In typical top-of-rack server connectivity environments, the Ethernet ports face the hot aisle to align with server I/O.
servers at the top of rack. The air plenum prevents cold air from leaking around sides of the 6600 switch to promote more efficient cooling and is recommended with installations where the 6600 switch is mounted with Ethernet ports facing the hot aisle. Figure 17 details this particular air plenum.
Overview of features and benefits The ProCurve 6600 Switch Series, like the 8200zl, 5400zl, 6200yl, and 3500yl series switches, uses the same software image base (letter designated K-code, for example, K.14.xx). The 6600 switch series offers a premium software license for advanced Layer 2 and Layer 3 services: Q-in-Q, PIM-SM, PIM-DM, OSPFv2, OSPFv3, and VRRP.
Feature Benefits Multiple user authentication methods Client-based access control using IEEE 802.1X, Web-based, MAC-based authentication, RADIUS, and TACACS+. Secure management access SSH, SSL, TACACS+, and Secure FTP encryption of switch management and configuration traffic—secures the network infrastructure from unauthorized access. At initial release, the combinations of authentication methods allowed simultaneously on a port are IEEE 802.1X/ Web and 802.1X/MAC.
Feature set summary Additional details about the ProCurve 6600 Switch Series and 8200zl, 5400zl, 6200yl, and 3500yl series features include the following: Data center optimized • Front-to-back airflow: designed to be co-located at the top of a server rack, the 6600 series supports front-toback airflow (mechanically reversible) to support hot-aisle/cold-aisle configurations; the N+N fan tray is also hot-swappable, allowing easy replacement in the rack • Modular internal power supplies: supports redundant, ho
Performance • High-speed/-capacity architecture: based on the purpose-built ProVision ASICs to provide superior system performance and scalability • Selectable queue configurations: increase performance by selecting the number of queues and associated memory buffering that best meet the requirements of network applications Resiliency and high availability • IEEE 802.
• ICMP throttling: defeats ICMP denial-of-service attacks by enabling any switch port to automatically throttle ICMP traffic • Virus throttling: detects traffic patterns typical of WORM-type viruses and either throttles or entirely prevents the ability of the virus to spread across the routed VLANs or bridged interfaces, without requiring external appliances • STP BPDU port protection: blocks Bridge Protocol Data Units (BPDUs) on ports that do not require BPDUs, preventing forged BPDU attacks • Dynamic IP l
Warranty and support • ProCurve Lifetime Warranty♦: for as long as you own the product, with next-business-day advance replacement (available in most countries) • Electronic and telephone support: limited electronic and telephone support is available from HP; refer to the HP website at www.procurve.com/support for details on the support provided and the period during which support is available • Software releases: refer to the HP website at www.procurve.
Routing and forwarding tables The ProCurve 6600 Switch Series has several routing and forwarding table features that enhance routing and switching performance. Every NG/NGX interface has its own “best-match prefix” routing table that contains IP routes and is used for determining how to route the vast majority of incoming packets. Using the best-match prefix routing table is extremely fast and enables wire-speed routing to be achieved.
However, when more than two ports per 4-port 10-GbE block are in a linked state, ports 1 and 4 are statically mapped to share one 14.4-Gbps channel, while ports 2 and 3 are statically mapped to share the other 14.4-Gbps channel. Thus, if only one port in a given channel is in a linked state, then that port operates at wire speed and the other port uses no bandwidth. However, if both ports in a given channel are in a linked state, then the 14.4 Gbps of bandwidth is balanced fairly between the two ports.
Throughput and latency performance data Tables 7 through 9 describe the performance capabilities of the 10-Gbps, 1-Gbps, and 100-Mbps interface module ports of the ProCurve 6600 Switch Series. Over a range of packet sizes from 64 bytes to 1518 bytes, the performance levels achieved are described in terms of the following metrics: • Throughput-level percentage achieved when performing Layer 2 switching and Layer 3 routing; 100% in all cases.
In the unlikely case where the average packet size is consistently smaller, the throughput will be less than wire speed. For example, consider a worst-case scenario, where the average packet size is 64 bytes. This would result in a throughput of approximately 70% to 80% of the rated wire-speed capacity. HP networking considers such minimum-sized packet-traffic scenarios being realized over an extended period of time to be extremely atypical and unlikely to be experienced by customers in the field.
Power Save mode Certain models of the 6600 series switches have implemented advanced power-saving capabilities to reduce power consumed by unused or idle ports. The 6600-24XG, 6600-48G, and 6600-48G-4XG switches allow users to turn off groups of ports to save power by entering the CLI savepower command at the global configuration level. Ports are grouped into power domains on each 6600 switch. To enable Power Save mode, you must enter a power domain number with the savepower command.
Optional support services In addition to free support services such as the warranty and telephone support, HP networking offers an extensive range of fee-based support services to meet more specialized needs.
OOBM limitations • sFlow: It is not possible to send sFlow samples to a collector over the OOBM port; sFlow must be captured and sent in-band. • OOBM futures: Features to be implemented in the future, though no time frame has been committed, include IPv6 host capabilities, LLDP discovery, and ACLs. • DNS resolution: Because the OOBM supports a separate IP stack, DNS resolution is separated from the inband plane.
The TCAM can support approximately 3,000 data entries that may be used to represent various traffic controls, including ACLs. For most customers, this quantity of entries will be more than adequate to provide wire-speed performance for ACL processing. Keep in mind that each ACL entry may consist of multiple criteria, such as a specific IP address and TCP or UDP port number.
Appendix D: virus throttle security Virus throttle is based on the detection of anomalous behavior of network traffic that differs from a normal activity. Under normal activity, a server will make fairly few outgoing connections to new clients or servers, but instead, is more likely to connect regularly to the same set of end nodes. This is in contrast to the fundamental behavior of a rapidly spreading worm, which will attempt many outgoing connections to new computers.
Response options The response behavior of connection-rate filtering can be adjusted by using filtering options. When a worm-like behavior is detected, the connection-rate filter can respond to the threats on the port in the following ways: • Notify only of potential attack: While the apparent attack continues, the switch generates an Event Log notice identifying the offending host source address (SA) and (if a trap receiver is configured on the switch) a similar SNMP trap notice.
VRRP is an election protocol that dynamically assigns responsibility for a virtual router on a LAN. It provides high availability for a default gateway without the need to reconfigure end hosts Intranet and/or Internet Router A Router B Multiple router interfaces comprise a virtual router configured with a common virtual IP address: 10.1.10.1 Figure E-1: VRRP example topology Host: 10.1.10.10/24 Default Gateway: 10.1.10.
Figure F-1 shows that there are three equal-cost, next-hop paths from Router A to the destination subnets with load-sharing across redundant links. At any point in time, Router A’s routing table could have information indicating the following: Destination subnet Next hop 10.1.0.0/16 Router C 10.2.0.0/16 Router D 10.3.0.0/16 Router B 10.32.0.0/16 Router B 10.42.0.
LED State Indication PS On (green) A power supply is installed in the position in the back of the switch, and the supply is plugged into an active AC power source. As shipped, the switch has a single power supply in position 1. Blinking (orange) One of the switch’s redundant power supplies has failed. The switch Fault LED will be blinking simultaneously. Blinking (orange) The external power supply has a fault or is connected but not plugged into AC power.
Share with colleagues Get connected www.hp.com/go/getconnected Current HP driver, support, and security alerts delivered directly to your desktop © Copyright 2009–2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty.