Users Guide
Table Of Contents
- Table of Contents
- 1 Regulatory and Safety Approvals
- 2 Functional Description
- 3 Network Link and Activity Indication
- 4 Features
- 4.1 Software and Hardware Features
- 4.2 Virtualization Features
- 4.3 VXLAN
- 4.4 NVGRE/GRE/IP-in-IP/Geneve
- 4.5 Stateless Offloads
- 4.6 Priority Flow Control
- 4.7 Virtualization Offload
- 4.8 SR-IOV
- 4.9 Network Partitioning (NPAR)
- 4.10 Security
- 4.11 RDMA over Converged Ethernet – RoCE
- 4.12 VMWare Enhanced Networking Stack (ENS)
- 4.13 Supported Combinations
- 4.14 Unsupported Combinations
- 5 Installing the Hardware
- 6 Software Packages and Installation
- 7 Updating the Firmware
- 8 Link Aggregation
- 9 System-Level Configuration
- 10 PXE Boot
- 11 SR-IOV – Configuration and Use Case Examples
- 12 NPAR – Configuration and Use Case Example
- 13 Tunneling Configuration Examples
- 14 RoCE – Configuration and Use Case Examples
- 15 DCBX – Data Center Bridging
- 16 DPDK – Configuration and Use Case Examples
- Revision History
Broadcom NetXtreme-E-UG304-2CS
108
NetXtreme-E User Guide User Guide for Dell Platforms
a. Server Side: ib_send_bw -d <RoCE Node> --report_gbits
b. Client Side: ib_send_bw -d <RoCE Node> --report_gbits <Server IP>
NOTE: With dual-port NICs, if both ports are on the same subnet, RDMA perftest commands may fail. The is caused by
an arp flux issue in Linux. Use multiple subnets for testing or bringing the other interface down.
14.2.5 RoCE Congestion Control
Broadcom NetXtreme Congestion Control (NCC) is a standards-based congestion control mechanism for RDMA over
Ethernet v2 (RoCEv2), which utilizes Explicit Congestion Notification (RFC 3168) to signal to RoCE transmitting stations the
congestion status of the network, which is used by NetXtreme-E network interface cards (NICs) to control transmit rate,
thereby reducing congestion, reducing packet drops, and minimizing network latency by keeping switch transmit queues
minimally loaded.
NCC can work in conjunction with Flow Control including pause frames and Priority Flow Control to guarantee a lossless
network, or NCC can operate alone.