Dell EMC PowerStore Networking Guide for PowerStore X Models Version 1.x December 2020 Rev.
Notes, cautions, and warnings NOTE: A NOTE indicates important information that helps you make better use of your product. CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. © 2020 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries.
Contents Additional Resources.....................................................................................................................5 Chapter 1: Overview...................................................................................................................... 6 PowerStore overview......................................................................................................................................................... 6 Using this guide.................................
Discovery with a direct connection.............................................................................................................................. 44 Discovery with a remote connection............................................................................................................................45 Remote discovery using Discovery Tool................................................................................................................
Preface As part of an improvement effort, revisions of the software and hardware are periodically released. Some functions that are described in this document are not supported by all versions of the software or hardware currently in use. The product release notes provide the most up-to-date information about product features. Contact your technical support professional if a product does not function properly or does not function as described in this document.
1 Overview The following information is included in this chapter. Topics: • • • PowerStore overview Using this guide Hardware overview PowerStore overview The different PowerStore models support different types of storage. Table 1. PowerStore deployment models Deployment Model numbers Supported configuration PowerStore X model appliance ● ● ● ● ● 1000X 3000X 5000X 7000X 9000X Supports block (SAN-only), and vVol workloads with a hypervisor installed on the system.
Hardware overview While there are different deployment options, this guide describes the requirements to deploy PowerStore X model with a single cluster consisting of one appliance with a single base enclosure. PowerStore appliance nodes PowerStore appliances are deployed with a minimum of one base enclosure. Each base enclosure consists of two nodes. A base enclosure consists of two nodes. Node A is the bottom node and Node B is the top node (flipped upside down in enclosure).
● S4148T-ON ● S5248F-ON For further information about the Dell PowerSwitch Series running Operating System 10 Enterprise Edition (OS10EE) refer to the following documents. Table 2. PowerSwitch documentation resources Document Reference Location Dell EMC PowerSwitch S4100ON Series Installation Guide PowerSwitch site preparation requirements, step-by-step procedures for rack mounting and desk mounting, inserting modules, and connecting to a power source.
Dell EMC PowerSwitch S4148T-ON Connectivity to PowerStore nodes is through the ports on the front panel of the switch. Front panel of the switch Figure 5. S4148T-ON switch front panel For switch and switch port details, see the Dell Technologies S4100 Spec Sheet at: https://www.delltechnologies.com/ resources/en-us/asset/data-sheets/products/networking/dell-networking-s4100-series-spec-sheet.pdf.
Management Port Serial Console Port Figure 8.
2 Prepare to configure switches and networks This chapter contains the following information. Topics: • • PowerStore X model Network Setup Preparation Worksheet Initial Configuration Worksheet PowerStore X model Network Setup Preparation Worksheet Work with your network administrator to complete the Network Setup Preparation Worksheet to reserve the necessary information to configure the switches.
Table 3. PowerStore X model Network Setup Preparation Worksheet (blank) (continued) Step Step details Notes Storage network (tagged) vMotion (tagged) Internal (untagged) 7. Reserve and record the IP addresses necessary to configure the switch below: Management IP address for switch 1 Management IP address for switch 2 Default gateway NTP server 8. Dell EMC supports deploying PowerStore X model with two Top-of-Rack (ToR) switches with a layer 2 interconnect link.
Table 3. PowerStore X model Network Setup Preparation Worksheet (blank) (continued) Step Step details Notes 13. As a best practice it is recommended to add a spanning tree protocol to the ToR switches. Record the spanning tree protocols to set on each switch. Spanning tree protocol for ToR switch 1 Spanning tree protocol for ToR switch 2 14. Once you have completed steps above, you have the necessary information to configure the switches.
Table 4. Initial Configuration Worksheet (blank) (continued) If you are deploying into a single VLAN, ensure that you configure a unique subnet for each type of network. Cluster IP Address Management Network Connects the cluster to services such as DNS and NTP. The IP addresses in the management network are used to address the cluster, appliances, controllers, and internal hosts.
Table 4. Initial Configuration Worksheet (blank) (continued) Physical/Top-of-Rack Switch Information (Optional) Record the switch IP addresses to validate the cabling and switch settings before the cluster is configured. To ensure a strong layer of redundancy, it is required that you connect your appliance to at least two switches. You can provide read-only credentials for the switches.
3 PowerStore X model: Network configuration requirements This chapter includes the following information. Topics: • • • • Top-of-Rack (ToR) switch connectivity options and requirements PowerStore X model networks PowerStore X model networks VLAN options IP addresses for network configuration Top-of-Rack (ToR) switch connectivity options and requirements PowerStore requires connectivity to a pair of Top-of-Rack (ToR) switches.
Layer 3 – Core Uplinks Uplink A Uplink B Port Channel Layer 2 – ToR Switches MC-LAG Interconnect Figure 9. ToR switches with MC-LAG interconnect NOTE: Port location for the reliable high speed uplinks may change depending on switch vendor or model. MC-LAG is a switch interconnection technology that joins a number of independent Top-of-Rack (ToR) switches into a single virtual chassis.
Layer 3 – Core Uplinks Uplink A Layer 2 – ToR Switches Port Channel Uplink B Port Channel Figure 10. ToR switches with a non-MC-LAG L2 interconnect NOTE: Port location for the reliable high speed uplinks may change depending on switch vendor or model. Non-MC-LAG L2 connectivity requires redundant, high speed connections.
Node to Top-of-Rack (ToR) switch connectivity Deploying with Top-of-Rack (ToR) switches requires that each of the base enclosure appliance nodes have at least one connection to each of the ToR switches to provide redundancy at the NIC and switch levels. Figure 11.
PowerStore X model networks PowerStore X model requires all networks to be unique. It is highly recommended to deploy PowerStore X model with multiple and unique VLANs to separate the traffic. However, if only one VLAN is available, you have the option to deploy PowerStore X model with a single VLAN and multiple unique subnets as demonstrated below. Figure 12.
Network configuration in PowerStore All PowerStore networks must be configured on the switch. Management, Storage, and vMotion networks are configured in PowerStore the first time you create a cluster through the PowerStore Initial Configuration Wizard (ICW).
PowerStore X model networks VLAN options The following table shows an example of the different type of networks with sample VLAN IDs in a PowerStore X model appliance. Table 8. PowerStore X model VLAN configuration Sample VLAN ID Network VLAN Ports Subnet example 1 Remote Discovery (runs over the Native VLAN) Untagged 169.254.x.x/16 100 Management Tagged y.y.y.y/24 200 Storage Tagged y.y.x.y/24 400 vMotion Tagged y.y.a.
Table 9. Initial configuration IP address requirements (continued) Network Number of IP Addresses Per Cluster vMotion Network ESXi Node B iSCSI Initiator 2 (optional) Global Storage Discovery IP Address (Storage Network) 1 Total Required Per VLAN or Subnet for vMotion 2 Per Appliance Node A 1 Node B 1 You can choose to assign either IPv4 or IPv6 addresses to the management, storage, or vMotion networks.
4 Configuring PowerStore X model with EMC Dell PowerSwitch Series This chapter includes the following information.
PowerStore X model example of completed Network Setup Preparation Worksheet The network resources provided in this worksheet are used in the steps to configure the Dell PowerSwitch Series Top-of-Rack switches in this guide. Table 10. PowerStore X model Network Setup Preparation Worksheet completed example Step Step details Notes 1. Print this table to record the reserved resources. 2.
Table 10. PowerStore X model Network Setup Preparation Worksheet completed example (continued) Step Step details Notes Switch to switch port pair 2 26 to 26 Alternatively, L2 uplinks without MC-LAG N/A 9. If using MC-LAG, enter the Domain ID. VLT domain ID 1 10 If using VLT for the Layer 2 interconnect, record the: VLT MAC address to use for both switch 1 and switch 2. 00:00:00:00:00:01 Use the same VLT MAC address for switch 1 and switch 2.
Example of a completed Initial Configuration Worksheet for PowerStore X model The network resources provided in this worksheet are used in the steps to configure the PowerStore X model networks on the Dell PowerSwitch Series Top-of-Rack switches. . The resources provided in the Initial Configuration Worksheet are also required the first time you launch PowerStore and run the Initial Configuration Wizard. Table 11.
Table 11. Initial Configuration Worksheet completed example for PowerStore X model (continued) VLAN Netmask/Prefix Length Gateway IP Addresses 255.255.255.0/24 192.168.2.1 192.168.2.10-19 (Optional, Defaults to 0) 200 Global Storage Discovery IP Address 192.168.2.20 The last IP address you specify here is used as the Global Storage Discovery IP address. It is recommended that you choose to create this IP address.
Table 11. Initial Configuration Worksheet completed example for PowerStore X model (continued) Existing vCenter User Credentials administrator@vsphere.local/Password123! New Datacenter Name DataCenter-PowerStoreXCluster New ESXi Cluster Name Cluster-PowerStoreXCluster SupportAssist (Optional) SupportAssist is a secure, automated health and system monitoring capability. It sends notifications to Dell EMC, enables remote support, and sends data to CloudIQ.
7. Enter global configuration mode. configure terminal 8. It is recommended that you change the password after logging into the switch for the first time. Use the following command to change the switch password. username admin password role sysadmin Validate the switch version and licensing Before you configure the switch and networks, check the switch operating system version and licensing.
Configure general settings on the Top-of-Rack (ToR) switches Perform the following steps to configure general settings on the ToR switches. In OS10EE, LLDP (Link Layer Discovery Protocol) is enabled globally on each interface by default. You can use LLDP for troubleshooting and validation. It is recommended that you enable all of the optional TLVs (type, length, value) in the LLDPU (Link Layer Discovery Protocol Data Units) on the switches. 1.
● Different rstp priority values should be used when configuring switch 1 and switch 2. ● 0 priority is typically reserved for the root bridge. 10. Repeat the above steps for the second switch (Switch2). Switch1 Switch2 configure terminal configure terminal hostname Switch1 hostname Switch2 interface ethernet 1/1/13 description discoveryWorkstation switchport access vlan 1 no shutdown interface mgmt 1/1/1 no shutdown no ip address dhcp ip address 100.0.100.
6. Create a vMotion VLAN. interface vlan 400 description vMotion_Network no shutdown exit 7. Repeat steps on Switch 2.
● For switch2, use the switch1 management IP address for the backup. backup destination 100.0.100.11 6. Enable peer-routing to prepare to configure your uplinks. Peer routing enables or disables L3 routing to peers. NOTE: Steps to configure uplinks to the customer networks are not described in this guide. peer-routing 7. Set the priority of the switch. primary-priority 1 Valid priority values range from 1 to 65535.
NOTE: For iSCSI best practices, it is recommended to disable flow control as demonstrated below. interface ethernet 1/1/1 description Node-A-Port_0 no shutdown switchport mode trunk switchport access vlan 1 switchport trunk allowed vlan 100,200,400 flowcontrol receive off flowcontrol transmit off spanning-tree port type edge exit 4. Repeat steps on switch 1 for Node B, port 1, as demonstrated below. NOTE: For iSCSI best practices, it is recommended to disable flow control as demonstrated below.
Configure the uplink ports on the Top of the Rack (ToR) switches 1. Establish a terminal session to the first ToR switch (Switch1). 2. Enter global configuration mode. configure terminal 3. Configure the port-channel for the uplinks. interface port-channel 30 description Uplink no shutdown switchport mode trunk switchport access vlan 1 switchport trunk allowed vlan 100,200,400 vlt-port-channel 30 4. Configure the uplink ports on the switch.
channel-group 30 mode active no switchport flowcontrol receive off flowcontrol transmit off copy running-configuration startup-configuration Configuring PowerStore X model with EMC Dell PowerSwitch Series 37
5 PowerStore X model: Cabling the appliance to the switches This chapter contains the following information. Topics: • • • Cable the base enclosure to the ToR switches Cable the ToR switches together Cable the Top-of-Rack switches to the core uplinks Cable the base enclosure to the ToR switches Cable the nodes to the Top of Rack (ToR) switches. 2 4 1 Figure 13.
Table 15. Steps to cable to the switches (continued) 4 Connect Port 0 of the top node (B), to Port 54 of the top switch (2). Cable the ToR switches together PowerStore dual switch deployments with VLT, requires that the two Top of Rack (ToR) switches are cabled together. 1 2 Figure 14. Switch-to-switch connectivity Use two cables that support connectivity between the high speed ports, for example 100Gbps Direct Attached Cables (DAC). Table 16.
Cable the Top-of-Rack switches to the core uplinks Cable the Top-of-Rack (ToR) switches to the core uplinks. Core uplinks Uplink A 1 3 Uplink B 4 2 Figure 15. ToR switch connections to the core uplinks Table 18. Steps to connect to the ToR switches to the core uplinks 1 Connect port 30 of the bottom ToR switch to the core Uplink A. 2 Connect port 29 of the bottom ToR switch to the core Uplink B. 3 Connect port 29 of the top ToR switch to the core Uplink A.
6 Validate switch and network configuration This chapter contains the following information. Topics: • • Validate configuration on the Top-of-Rack (ToR) switches Network Validation Tool for PowerStore Validate configuration on the Top-of-Rack (ToR) switches Once you have configured and cabled your ToR switches, validate the configuration prior to discovering yourPowerStore X model model deployment. 1. Establish a terminal session to the switch. 2. Validate the interface status.
400 Active 4094 Inactive T T T T vMotion_Network Po30 Eth1/1/1,1/1/54 Po30 Po1000 5.
VLAN mismatch: No mismatch VLT VLAN mismatch: No mismatch 9. Validate the VLT port configuration. show vlt vlt-port-detail vlt-port-channel ID : 30 VLT Unit ID Port-Channel Status Configured ports Active ports ------------------------------------------------------------------------------1 port-channel30 up 2 2 * 2 port-channel30 up 2 2 10. Review the running configuration for ToR switch 1, and repeat all validation steps for ToR switch 2.
A Discovering PowerStore Appliances Once you have configured your networks and completed installing the appliances, you can discover your PowerStore appliance and begin the initial configuration process. Topics: • • Discovery with a direct connection Discovery with a remote connection Discovery with a direct connection This is the recommended procedure and requires that you are physically present in the data center or lab where the base enclosure is installed.
Discovery with a remote connection Network Node If you do not have access to the base enclosure, deploy a workstation or virtual machine on the same network as the PowerStore system and use the PowerStore Discovery Utility to discover and create a cluster. B A Figure 16.
● (Optional) Download and run the Network Validation Tool (NVT) for PowerStore to validate that your networks are correctly configured. The NVT can be downloaded from Dell EMC Central Solutions at https://psapps.emc.com/central/solution/ NVT-PowerStore.
B Other Dell EMC PowerSwitch Series configuration operations This appendix includes the following information. Topics: • • Reset the switch to factory settings Running configuration of PowerSwitch Series used in PowerStore X model deployments Reset the switch to factory settings If necessary, you can reset the Dell PowerSwitch Series running OS10 Enterprise Edition (OS10EE) to the default factory settings.
Table 19. Example of running-configuration on ToR switches Switch1 hostname Switch1 interface breakout 1/1/25 map 100g-1x interface breakout 1/1/26 map 100g-1x interface breakout 1/1/29 map 100g-1x interface breakout 1/1/30 map 100g-1x username admin password $6$q9QBeYjZ $jfxzVqGhkxX3smxJSH9DDz7/3OJc6m5wjF8nnLD7/ VKx8SloIhp4NoGZs0I/ UNwh8WVuxwfd9q4pWIgNs5BKH. role sysadmin ntp server 100.0.10.
Table 19.
Table 19.
Table 19.
Table 19.
Table 19.
