Dell Networking S4820T and Dell Force10 S4820T Switch Configuration Guide for PS Series SANs Dell Storage Engineering February 2016 A Dell Deployment and Configuration Guide
Revisions Date Description February 2013 Initial release September 2013 Updated to firmware 9.2.0.0 January 2014 Updated for firmware 9.3.0.0 April 2014 Minor update February 2016 Updated for FTOS v9.9.0.0 THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS IS, WITHOUT EXPRESS OR IMPLIED WARRANTIES OF ANY KIND. © 2013–2016 Dell Inc. All rights reserved.
Table of contents 1 2 Introduction ................................................................................................................................................................................ 5 1.1 Audience ........................................................................................................................................................................... 5 1.2 Switch details .......................................................................................
5 4.4 Save configuration ........................................................................................................................................................ 16 4.5 Reload ............................................................................................................................................................................. 16 4.6 Verify DCB status ...................................................................................................................
1 Introduction This document illustrates how to configure Dell Networking or Dell™ Force10 S4820T switches for use with Dell PS Series storage using Dell best practices. The recommended configuration uses link aggregation groups (LAGs) for inter-switch connections. Optional steps are provided in section 3 to enable Data Center Bridging (DCB). If you are following the Rapid EqualLogic Configuration steps at http://en.community.dell.com/techcenter/storage/w/wiki/3615.
Note: FTOS v9.3.0.0 incorporates new command line syntax for DCB configuration. To configure a new switch for DCB operation, follow the configuration steps in this Software Configuration Guide as outlined below. If you are upgrading from an FTOS version prior to v9.3.0.0, your DCB settings in the running configuration file will be preserved and you may continue to use the original DCB command line syntax.
1.3 Cabling diagram The cabling diagram shown below represents the Dell recommend method for deploying your servers and PS arrays.
2 Dell recommended switch configuration These steps show you how to configure two Dell Networking or Force10 S4820T switches with a Link Aggregation Group (LAG). The switches are interconnected using two of the 40 GbE Quad Small Formfactor Pluggable (QSFP) uplink ports, and the LAG is configured for Dynamic Link Aggregation Control Protocol (LACP). 2.1 Hardware configuration 1. 2. 3. 4. 5. 2.2 Power on the two switches. Connect a serial cable to the serial port of the first switch.
FTOS(conf-if-ma-0/0)#no shutdown FTOS(conf-if-ma-0/0)#ip address ipaddress mask FTOS(conf-if-ma-0/0)#exit 2.4 Configure route for OOB management port (optional) FTOS (conf)#management route X.Y.Z.0 /24 A.B.C.1 Note: X.Y.Z.0 is the network your management system is connecting from and A.B.C.1 is the gateway for the switch. If your management system is on the same subnet as the switch, the previous step may be omitted. The example above assumes a class C subnet mask. 2.
FTOS(conf-if-range-te-0/0-47)#exit 2.7 Enable Jumbo Frames FTOS#configure FTOS(conf)# interface range tengigabitethernet 0/0 – 47 FTOS(conf -if-range-te-0/0-47)#mtu 12000 2.8 Configure flow control FTOS(conf)#interface range tengigabitethernet 0/0 – 47 FTOS(conf-if-range-te-0/0-47)#flowcontrol rx on tx off 2.
FTOS(conf-if-range-fo-0/48,fo-0/52)#no shutdown FTOS(conf-if-range-fo-0/48,fo-0/52)#flowcontrol rx on tx off FTOS(conf-if-range-fo-0/48,fo-0/52)#port-channel-protocol lacp FTOS(conf-if-range-fo-0/48,fo-0/52-lacp)#port-channel 1 mode active FTOS(conf-if-range-fo-0/48,fo-0/52-lacp)#exit FTOS(conf-if-range-fo-0/48,fo-0/52)#exit FTOS(conf)#exit 2.12 Save configuration FTOS#copy running-config startup-config 2.13 Configure additional switch Repeat the commands from section 2 to configure the second switch.
3 Configure Data Center Bridging (DCB) (optional) To enable DCB mode on the switch, use the following commands. Note: You must complete the Dell recommended switch configuration steps in sections 2.1 to 2.13 before configuring the switch for DCB mode. 3.1 Disable 802.3x flowcontrol on SFP+ ports FTOS#configure FTOS(conf)#interface range tengigabitethernet 0/0 - 47 FTOS(conf-if-range-te-0/0-47)#no flowcontrol rx on tx off FTOS(conf-if-range-te-0/0-47)#exit 3.2 Disable 802.
FTOS (conf-if-vl-vlan-id*)#no shutdown FTOS (conf-if-vl-vlan-id*)#tagged tengigabitethernet 0/0-47 FTOS (conf-if-vl-vlan-id*)#tagged port-channel 1 FTOS (conf-if-vl-vlan-id*)#exit 3.5 Configure DCB policies FTOS(conf)#dcb-map profile-name FTOS(conf-dcbmap-profile-name*)#priority-group 0 bandwidth 50 pfc off FTOS(conf-dcbmap-profile-name*)#priority-group 1 bandwidth 50 pfc on Note: The sum of the bandwidth-percentages must be equal to 100. The bandwidth percentage used in this section is just an example.
3.8 Configure additional switches Repeat the commands from section 3 to configure DCB on additional switches.
4 Reverting from DCB to non-DCB configuration (optional) One method to revert from a DCB configured switch to a non-DCB configured switch is to delete the current configuration (startup-config) and follow the steps in section 2. If deleting the current configuration is not an option, then use the following procedure to unconfigure DCB and enable standard flow control. Note: This is a disruptive operation that requires down time. The arrays will temporarily lose communication with each other.
native VLAN ID (typically 0 or 1) or a specific VLAN can be configured (for example, VLAN 100). If a nondefault VLAN is configured, then any ports connected to the arrays must be configured as “untagged”. Use the steps below to configure the native VLAN on the switch. FTOS#configure FTOS(conf)#no interface vlan vlan-id 4.4 Save configuration FTOS#copy running-config startup-config 4.5 Reload FTOS#reload System configuration has been modified.
5 Optional stack configuration Note: If you wish to use a stack configuration instead of LAG, follow the instructions below instead of section 2. One advantage of stacked switches is that they can be managed as a single switch; however firmware updates will update all members of the stack simultaneously and therefore should only be done during planned downtime. 5.
5.3 Delete startup configuration on the second switch FTOS>enable FTOS#delete startup-config Proceed to delete startup-config [confirm yes/no]yes FTOS#reload System configuration has been modified. Save? [yes/no]no Proceed with reload [confirm yes/no]yes Note: The switch will reboot. 5.4 Configure stack on the second switch FTOS>enable FTOS#stack-unit 0 renumber 1 Note: The switch will reboot.
5.6 Configure out of band (OOB) management port FTOS#config FTOS(conf)#interface ManagementEthernet 0/0 FTOS(conf-if-ma-0/0)#no shutdown FTOS(conf-if-ma-0/0)#ip address ipaddress mask FTOS(conf-if-ma-0/0)#no shutdown FTOS(conf-if-ma-0/0)#exit 5.7 Configure route for OOB management port (optional) FTOS(conf)#management route X.Y.Z.0 /24 A.B.C.1 Note: X.Y.Z.0 is the network your management system is connecting from and A.B.C.1 is the gateway for the switch.
FTOS(conf-if-range-te-1/0-47)#switchport FTOS(conf-if-range-te-1/0-47)#spanning-tree rstp edge-port FTOS(conf-if-range-te-1/0-47)#flowcontrol rx on tx off FTOS(conf-if-range-te-1/0-47)#no shut FTOS(conf-if-range-te-1/0-47)#exit FTOS(conf)#exit FTOS(conf)#protocol spanning-tree rstp FTOS(conf-rstp)#no disable FTOS(conf-rstp)#exit FTOS(conf)#exit 5.
Additional resources Dell.com/support is focused on meeting your needs with proven services and support. DellTechCenter.com is an IT Community where you can connect with Dell Customers and Dell employees for the purpose of sharing knowledge, best practices, and information about Dell products and your installations. Referenced or recommended Dell publications: Dell PS Series Configuration Guide: http://en.community.dell.
