Users Guide
Table Of Contents
- Revision History
- Table of Contents
- Regulatory and Safety Approvals
- Functional Description
- Network Link and Activity Indication
- Features
- Software and Hardware Features
- Virtualization Features
- VXLAN
- NVGRE/GRE/IP-in-IP/Geneve
- Stateless Offloads
- UDP Fragmentation Offload
- Stateless Transport Tunnel Offload
- Multiqueue Support for OS
- SR-IOV Configuration Support Matrix
- SR-IOV
- Network Partitioning (NPAR)
- RDMA over Converged Ethernet – RoCE
- Supported Combinations
- Installing the Hardware
- Software Packages and Installation
- Windows Driver Advanced Properties and Event Log Messages
- Teaming
- System-level Configuration
- ISCSI Boot
- VXLAN: Configuration and Use Case Examples
- SR-IOV: Configuration and Use Case Examples
- NPAR – Configuration and Use Case Example
- RoCE – Configuration and Use Case Examples
- DCBX – Data Center Bridging
RoCE – Configuration and Use Case ExamplesNetXtreme-E User’s Manual
September 4, 2019 • NetXtreme-E-UG103 Page 73
To compile bnxt_re:
$make
• Distros that need external OFED to be installed:
SLES11SP4
Please refer OFED release notes from the following link and install OFED before compiling bnxt_re driver.
http://downloads.openfabrics.org/downloads/OFED/release_notes/OFED_3.18-2_release_notes
To compile bnxt_re:
$export OFED_VERSION=OFED-3.18-2
$make
Installation
To install RoCE in Linux:
1. Upgrade the NIC NVRAM using the RoCE supported firmware packages from Software Release
20.06.04.01 or newer.
2. In the OS, uncompress, build, and install the BCM5741X Linux L2 and RoCE drivers.
a. # tar -xzf netxtreme-bnxt_en-1.7.9.tar.gz
b. # cd netxtreme-bnxt_en-bnxt_re
c. # make build && make install
3. Uncompress, build, and install the NetXtreme-E Linux RoCE User Library.
a. # tar xzf libbnxtre-0.0.18.tar.gz
b. #cd libbnxtre-0.0.18
c. # configure && make && make install.
d. # cp bnxtre.driver /etc/libibverbs.d/
e. # echo "/usr/local/lib" >> /etc/ld.so.conf
f. # ldconfig -v
Please refer to the bnxt_re README.txt for more details on configurable options and recommendations.
Limitations
In dual port NICs, if both ports are on same subnet, rdma perftest commands may fail. The possible cause is
due to an arp flux issue in the Linux OS. To workaround this limitation, use multiple subnets for testing or bring
the second port/interface down.