Dell EMC XC Series Appliance and XC Core System Remote Direct Memory Access Deployment Guide August 2019 Dell EMC Reference Architecture
Revisions Revisions Date Description May 2019 Initial release August 2019 Updated the following sections: • • • • Supported platforms Supported hypervisors Supported Nutanix packages Enabling RDMA using Prism The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose.
Revisions Table of contents Revisions............................................................................................................................................................................. 2 1 Introduction ................................................................................................................................................................... 5 1.1 Remote Direct Memory Access ...................................................................................
Revisions 4 Dell EMC XC Series Appliance and XC Core System Remote Direct Memory Access Deployment Guide
Technical support and resources 1 Introduction 1.1 Remote Direct Memory Access 1.1.1 RDMA benefits 1.1.1.1 Zero-Copy This document describes the deployment of the Remote Direct Memory Access (RDMA) solution. RDMA increases bandwidth while lowering latency and CPU utilization. It sidesteps the system software stack components that process network traffic. This section describes RDMA benefits. Applications can perform data transfers without the involvement of the network software stack.
Technical support and resources 1.1.3 Supported Nutanix packages The following are supported Nutanix packages: • • AOS 5.9.2 and later Foundation 4.4.1 and later (supports rNDC and PCI) Absolutely minimum version of 4.3.2. NOTE: Prior to Foundation 4.4.1, see section Troubleshooting 1.1.8, which requires no rNDC. 1.1.4 RDMA validate switches The following switches are used to validate the RDMA Solution.
Technical support and resources rdma0 should display among the listed interfaces. Alternatively, log in to the cluster prism UI navigate to Settings>Network Configuration.
Technical support and resources 4. Enable RDMA on the cluster. 5. Click Configure rdma0 interface. 6. Input values as appropriate: • • • • IP: xxx.xx.x.x (for example:172.16.0.0) NOTE: Do not use 192.168.5.0 Netmask: xxx.xx.xxx.x (for example: 255.255.252.0) Vlan: xx (Vlan = 100) PFC: 0 – 7 (for example 3 or 4) 7. Click to verify. Successful RDMA configuration displays as Disable – meaning its enabled as shown below.
Technical support and resources 8. After the cluster is created, log in to each CVM and issue the command below to ensure the RDMA interface is created. ip a |grep rdma0 1.1.7 Troubleshooting 1.1.7.
Technical support and resources Solution: Make sure you have 2 CX4 Adapter on the supported hardware. Refer to the section for hardware requirements. 1. Check ip a |grep rdma0 to make sure that interface rdma0 is created. 2. Make sure IPs match from the RDMA interfaces; allssh ip a |grep rdma0 (check that the creation was successful and the interfaces were brought up). 3. Refer to /home/nutanix/data/logs/genesis.out for any failure. 4. For any reason RDMA is disabled, make sure it is enabled.
Technical support and resources A Technical support and resources Dell.com/support is focused on meeting customer needs with proven services and support. Dell TechCenter is an online technical community where IT professionals have access to numerous resources for Dell EMC software, hardware and services. Storage Solutions Technical Documents on Dell TechCenter provide expertise that helps to ensure customer success on Dell EMC Storage platforms. A.