Stacking Dell Force10 MXL 10/40G Blade Switches Victor Teeter Network Enabled Solutions Team
Stacking Dell Force10 MXL 10/40G Blade Switches v1.1 This document is for informational purposes only and may contain typographical errors and technical inaccuracies. The content is provided as is, without express or implied warranties of any kind. © 2012 Dell Inc. All rights reserved. Dell and its affiliates cannot be responsible for errors or omissions in typography or photography. Dell, the Dell logo, and PowerEdge are trademarks of Dell Inc.
Stacking Dell Force10 MXL 10/40G Switches Contents Introduction ............................................................................................................. 3 Redundancy ........................................................................................................... 4 Failover roles ......................................................................................................... 4 Stacking LAG ..............................................................................
Stacking Dell Force10 MXL 10/40G Switches 2
Stacking Dell Force10 MXL 10/40G Switches Introduction Numerous Dell™ switches include a stacking feature that allows multiple physical switches to operate as a single logical switch, providing a consolidated interface for management. The Dell Force10 MXL 10/40Gb switch is the latest Dell switch with this feature. Up to six Dell Force10 MXL switches can be connected in a single stack using QSFP+ (40Gb) ports.
Stacking Dell Force10 MXL 10/40G Switches Additional stack members can immediately utilize existing configuration information such as routing and switching configurations, VLANs, ACLs, port profiles, and security certificates. Redundancy By connecting a cable from the last switch in a stack back to the first switch, the operator ensures that a stack has the protection of redundant paths for control and data traffic.
Stacking Dell Force10 MXL 10/40G Switches Another way to completely wipe out all configurations and return to factory defaults is to erase the meta-data (NVRAM) and delete the startup configuration by following the instructions in Restoring factory defaults below. Restoring factory defaults Usually a standalone MXL can be set to factory defaults simply by deleting the startup configuration and reloading the switch (Step 2).
Stacking Dell Force10 MXL 10/40G Switches no ip address shutdown ! interface TenGigabitEthernet 0/2 no ip address --More-Additional stack-unit lines like the one below may be found in an unstacked MXL if one or more expansion modules are present. In order to use these ports for stacking the quad mode will need to be removed. stack-unit 0 port (41, 43, 49, 53) portmode quad Bare Metal Provisioning The system is configured for Bare Metal Provisioning (BMP) mode when it leaves the factory.
Stacking Dell Force10 MXL 10/40G Switches Port numbering When installed in a PowerEdge™ M1000e Enclosure, the MXL 10/40GbE external switch ports are numbered 33 to 56 from the bottom to the top of the switch (ports 1-32 are internal 10G ports): • 40GbE base-module (built-in) ports: In 2x40GbE mode of operation (default), the ports are numbered 33 and 37. • In 8x10GbE mode of operation, the ports are numbered 33 through 40. The 40GbE mode of operation is required for stacking.
Stacking Dell Force10 MXL 10/40G Switches Combining split 10GbE SFP+ ports into a single 40GbE QSFP+ port The MXL 10/40GbE Switch supports splitting each 40GbE port on the base module or a 2-Port 40GbE QSFP+ expansion module into eight 10GbE SFP+ ports using a breakout cable. However, ports must be combined into single 40Gbe QSFP+ ports to operate in Stacking mode. Note: By default, the 40GbE ports on a 2-Port 40GbE QSFP+ expansion module come up in 8x10GbE (quad) mode as eight 10GbE ports.
Stacking Dell Force10 MXL 10/40G Switches listed here when in port mode. If there is no “stack-unit” listing for the first port number, then the ports are not split and are running at 40GbE. 2. interface fortyGigE 0/33 : interface TenGigabitEthernet 0/41 Each individual port mode is listed further down in the configuration. If the interface is listed as fortyGigE then it may be used for stacking. If it is TenGigabitEthernet, then it may not be used for stacking.
Stacking Dell Force10 MXL 10/40G Switches Status : online Next Boot : online Required Type : MXL-10/40GbE - 34-port GE/TE/FG (XL) Current Type : MXL-10/40GbE - 34-port GE/TE/FG (XL) Master priority : 0 Hardware Rev : X00 Num Ports : 56 Up Time : 1 wk, 3 day, 23 hr, 5 min FTOS Version : 8.3.16.
Stacking Dell Force10 MXL 10/40G Switches QSFP+ built-in ports are set to 40Gb by default while expansion module QSFP+ ports are set to 10Gb ports by default. To change a port from 10Gb mode to 40Gb mode, use the command FTOS(conf)#no stack-unit 0 port p portmode quad Please save and reload for the changes to take effect. where p is the port to be converted. Refer to the section Combining split 10GbE SFP+ ports into a single 40GbE QSFP+ port for more details on how to use this command.
Stacking Dell Force10 MXL 10/40G Switches Figure 5.
Stacking Dell Force10 MXL 10/40G Switches The Dell M1000e Server Chassis includes a management console port on the CMC that allows allows management of each module from a single serial connection to the chassis. For more information, see the Dell Blade Server CMC User's Guide at http://support.dell.com/support/edocs/software/smdrac3/cmc/index.htm. For this example the expansion ports 41, 45, 49, and 53 are used as shown in the above figure.
Stacking Dell Force10 MXL 10/40G Switches FTOS#show inventory optional-module Unit Slot Expected Inserted Next Boot Power ----------------------------------------------------------------0 0 QSFP+ QSFP+ AUTO Good 0 1 QSFP+ QSFP+ AUTO Good In this example, stack-groups 2 thru 5 correspond to two 40G QSFP+ expansion modules inserted in slots 0 and 1. Since stacking MXL switches does not use 10Gig Interfaces, there are never stack-groups associated with SFP+ or 10GbaseT ports that may be installed.
Stacking Dell Force10 MXL 10/40G Switches Note: When creating stack ports on an MXL, all ports must be fixed or on the expansion module. Mixing fixed and expansion module ports in order to stack is not supported. Maximum stack-group per unit A maximum of 4 stack-groups per unit can be configured. In a ring topology, that would be 2 stackgroups in each direction, i.e 80Gbps stacking bandwidth. In a two unit stack, a maximum of 4 stackgroups between the two units (i.e 160Gbps stacking bandwidth) is allowed.
Stacking Dell Force10 MXL 10/40G Switches 1 2 3 4 5 Standby Member Member Member Member online online online online online MXL-10/40GbE MXL-10/40GbE MXL-10/40GbE MXL-10/40GbE MXL-10/40GbE MXL-10/40GbE MXL-10/40GbE MXL-10/40GbE MXL-10/40GbE MXL-10/40GbE 8.3.16.0E0 8.3.16.0E0 8.3.16.0E0 8.3.16.0E0 8.3.16.0E0 56 56 56 56 56 Issue show system stack-port status command to see the topology and link status for each port.
Stacking Dell Force10 MXL 10/40G Switches FTOS(conf)#stack-unit 1 provision ? MXL-10/40GbE 34-port GE/TE/FG (XL) FTOS(conf)#stack-unit 1 provision MXL-10/40GbE Certain configuration changes on the unit such as “fanout” and “stack-groups” may require saving and reloading the entire stack. Refer to the MXL User Guide for more information on provisioning.
Stacking Dell Force10 MXL 10/40G Switches the downloaded image is distributed to all member units of the stack. The instructions below will guide the user through these steps. Note: When upgrading a stack of switches, allow extra time between upgrade steps for files and configurations to be copied from the Master to each member unit. It is possible for the process of upgrading a switch stack to take a few minutes longer than upgrading a single switch. 1.
Stacking Dell Force10 MXL 10/40G Switches Image upgraded to all 4. Verify the new firmware was copied to all stack members. FTOS#show boot system stack-unit all Current system image information in the system: ============================================= Type Boot Type A B ---------------------------------------------------------------Stack-unit 0 FLASH BOOT 8.3.15.0[boot] 8-3-16-0 Stack-unit 1 FLASH BOOT 8.3.15.0[boot] 8-3-16-0 Stack-unit 2 FLASH BOOT 8.3.15.0[boot] 8-3-16-0 Stack-unit 3 FLASH BOOT 8.3.
Stacking Dell Force10 MXL 10/40G Switches FTOS#show boot system stack-unit all Current system image information in the system: ============================================= Type Boot Type A B ---------------------------------------------------------------Stack-unit 0 FLASH BOOT 8.3.15.0 8-3-16-0[boot] Stack-unit 1 FLASH BOOT 8.3.15.0 8-3-16-0[boot] Stack-unit 2 FLASH BOOT 8.3.15.0 8-3-16-0[boot] Stack-unit 3 FLASH BOOT 8.3.15.0 8-3-16-0[boot] Stack-unit 4 FLASH BOOT 8.3.15.
Stacking Dell Force10 MXL 10/40G Switches FTOS(conf)#no FTOS(conf)#no FTOS(conf)#no FTOS(conf)#no stack-unit stack-unit stack-unit stack-unit 2 2 2 2 stack-group 0 stack-group 1 stack-group 2 stack-group 3 : : FTOS(conf)#no stack-unit 5 stack-group 2 FTOS(conf)#no stack-unit 5 stack-group 3 FTOS(conf)#exit Save the configuration and reload. FTOS#copy running-config startup-config File with same name already exist.
Stacking Dell Force10 MXL 10/40G Switches FTOS#stack-unit 1 renumber 5 % ERROR: stack unit 5 already exists. If the new number assignment is already used by a logically provisioned unit in the stack, the below confirmation message to overwrite is displayed. FTOS#stack-unit 1 renumber 5 Stack unit 5 has configuration data. Overwrite? [confirm yes/no]: Caution: Renumbering stack units may hinder management scripts and monitoring software that collects data based on particular port traffic.
Stacking Dell Force10 MXL 10/40G Switches Appendix A – Stacking scenarios When creating stack ports on an MXL, all ports must be fixed or on the expansion module. Mixing fixed and expansion module ports in order to stack is not supported. * When there are six QSFP+ ports available on the switch, a maximum of 4 ports may be used for stacking on that switch.
Stacking Dell Force10 MXL 10/40G Switches Appendix B – Port mapping 24
Stacking Dell Force10 MXL 10/40G Switches Appendix C - Network switch versions Version information for the network switches used in creating this document are as follows: Network switch Dell Force10 XML Software version 8.3.16.0, E8.3.16.163, E8.3.16.
