Cisco Nexus 5548UP Switch Configuration Guide for Dell PS Series SANs Dell Storage Engineering October 2015 A Dell Deployment and Configuration Guide
Revisions Date Description February 2013 Initial release October 2013 Updated for firmware 6.0(2)N1(2) March 2014 Updated for firmware 7.0(0)N1(1) and added DCB with iSCSI TLV configuration. May 2014 Updated DCB bandwidth, jumbo frames configuration October 2015 Added entry to now properly disable DCB THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES.
Table of contents Revisions ............................................................................................................................................................................................. 2 1 2 Introduction ................................................................................................................................................................................ 5 1.1 Document conventions ....................................................................
3.3 Configure the vPC domain .......................................................................................................................................... 13 3.4 Configure Port Channel ............................................................................................................................................... 13 3.5 Configure portfast on edge ports .............................................................................................................................
1 Introduction This document illustrates how to configure Cisco® Nexus 5548UP switches for use with Dell™ PS Series storage using Dell best practices. The recommended configuration uses link aggregation groups (LAGs) and Virtual Port Channel (vPC) for inter-switch connections. For information on PS Series SAN design recommendations, see the EqualLogic Configuration Guide. 1.1 Document conventions Table 1 lists the formatting conventions used in this document. Table 1 1.
1.4 Cabling diagram The cabling diagram shown below represents the Dell recommend method for deploying your servers and PS Series arrays.
2 Dell recommended switch configuration Follow the steps in this section to configure two Cisco Nexus 5548UP switches with a vPC interconnect. The switches are interconnected using four of the 10Gb ports configured as the vPC link. Note: The configuration steps in this section are only recommended when the switch is used as a dedicated SAN for iSCSI traffic (not shared with LAN traffic). 2.1 Hardware configuration 1. 2. 3. 4. 5. 2.2 Power on both switches. Connect a serial cable to the management port.
---- Basic System Configuration Dialog ---This setup utility will guide you through the basic configuration of the system. Setup configures only enough connectivity for management of the system. Please register Cisco Nexus 5000 Family devices promptly with your supplier. Failure to register may affect response times for initial service calls. Nexus devices must be registered to receive entitled support services. Press Enter at anytime to skip a dialog. Use ctrl-c at anytime to skip the remaining dialogs.
2.4 Disabling Data Center Bridging (DCB) Note: All steps in this section are required in order to properly disable DCB. These steps are also required when upgrading from previous versions to this new version v7.1(0)N1(1b).
switch(config)# interface port-channel 1 switch(config-if)#priority-flow-control mode off switch(config-if)# flowcontrol send on switch(config-if)# flowcontrol receive on switch(config-if)# exit 2.7 Enable link level flow control (802.3x) You must perform this step for each individual port that is connected to a storage controller or a host interface port, or you can specify a range of ports to configure.
2.10 Enable switch ports The following example enables a range of ports. If preferred, you may enable individual ports as needed. switch(config)# interface ethernet 1/1-32 switch(config-if-range)# shutdown switch(config-if-range)# no shutdown switch (config-if-range)# exit 2.11 Configure the Nexus policy engine The following example configures iSCSI traffic for Class of Service (CoS) 4 and Quality of Service (QoS) group 3. 2.11.
switch(config-pmap-nq-c)# exit Note: The following steps are optional and will enable jumbo MTU for the default class (non-iSCSI traffic). switch(config-pmap-nq)#class type network-qos class-default switch(config-pmap-nq-c)#mtu 9216 switch(config-pmap-nq-c)# exit switch(config-pmap-nq)# exit 2.11.6 Define a queuing class-map switch(config)# class-map type queuing class-iscsi switch(config-cmap-que)# match qos-group 3 2.11.
3 Configure Data Center Bridging (DCB) (optional) To enable DCB mode on the switch, use the procedures in this section. Note: This section assumes a new switch that has a default startup configuration file. Always back up the startup configuration file prior to making any configuration changes. Note: This section enables Data Center Bridging for implementing a converged network (LAN and SAN traffic sharing the same switch fabric).
switch(config-if)# switchport trunk allowed vlan 100,200 switch(config-if)# spanning-tree port type network switch(config-if)# vpc peer-link Please note that spanning tree port type is changed to “network” port type on vPC peer-link. This will enable spanning tree Bridge Assurance on vPC peer-link provided the STP Bridge Assurance (which is enabled by default) is not disabled.
3.6.1 Define a QoS map for iSCSI switch(config)# class-map type qos match-all class-iscsi switch(config-cmap-qos)# match protocol iscsi switch(config-cmap-qos)# match cos 4 switch(config-cmap-qos)# exit 3.6.2 Define a QoS policy map for iSCSI switch(config)# policy-map type qos iscsi-in-policy switch(config-pmap-qos)# class class-iscsi switch(config-pmap-c-qos)# set qos-group 4 switch(config-pmap-c-qos)#exit switch((config-pmap-qos)# exit 3.6.
Note: The following steps are optional and will enable jumbo MTU for the default class (non-iSCSI traffic). switch(config-pmap-nq)#class type network-qos class-default switch(config-pmap-nq-c)#mtu 9216 switch(config-pmap-nq-c)# exit switch(config-pmap-nq)# exit 3.
Additional resources Dell.com/support is focused on meeting your needs with proven services and support. Support.cisco.com provides support and information regarding Cisco networking products. DellTechCenter.com is an IT Community where you can connect with Dell customers and Dell employees for the purpose of sharing knowledge, best practices, and information about Dell products and your installations. Referenced or recommended Dell publications: Dell EqualLogic Configuration Guide: http://en.community.
