User Manual
Table Of Contents
- Mellanox WinOF VPI User Manual
- Table of Contents
- List of Tables
- Document Revision History
- About this Manual
- 1 Introduction
- 2 Driver Features
- 3 Deploying Windows Server 2012 with SMB Direct
- 4 Driver Configuration
- 5 Performance Tuning
- 6 OpenSM - Subnet Manager
- 7 InfiniBand Fabric
- 7.1 Network Direct Interface
- 7.2 part_man - Virtual IPoIB Port Creation Utility
- 7.3 InfiniBand Fabric Diagnostic Utilities
- 7.4 InfiniBand Fabric Performance Utilities
- 7.4.1 ib_read_bw
- 7.4.2 ib_read_lat
- 7.4.3 ib_send_bw
- 7.4.4 ib_send_lat
- 7.4.5 ib_write_bw
- 7.4.6 ib_write_lat
- 7.4.7 ibv_read_bw
- 7.4.8 ibv_read_lat
- 7.4.9 ibv_send_bw
- 7.4.10 ibv_send_lat
- 7.4.11 ibv_write_bw
- 7.4.12 ibv_write_lat
- 7.4.13 ibaddr
- 7.4.14 ibcacheedit
- 7.4.15 iblinkinfo
- 7.4.16 ibqueryerrors
- 7.4.17 ibsysstat
- 7.4.18 perfquery
- 7.4.19 saquery
- 7.4.20 smpdump
- 8 Software Development Kit
- 9 Troubleshooting
- 10 Documentation
Driver FeaturesRev 4.3
Mellanox Technologies
13
2 Driver Features
The Mellanox VPI WinOF driver release introduces the following capabilities:
• One or two ports
• Up to 16 Rx queues per port
• Rx steering mode (RSS)
• Hardware Tx/Rx checksum calculation
• Large Send Offload (i.e., TCP Segmentation Offload)
• Hardware multicast filtering
• Adaptive interrupt moderation
• MSI-X support
• Auto Sensing
•RoCE
Ethernet Only:
• HW VLAN filtering
• Header Data Split
For the complete list of Ethernet and InfiniBand Known Issues and Limitations, see
MLNX_WinVPI_ReleaseNotes.txt.
2.1 RDMA over Converged Ethernet (RoCE)
2.1.1 RoCE Overview
Remote Direct Memory Access (RDMA) is the remote memory management capability that
allows server to server data movement directly between application memory without any CPU
involvement. RDMA over Ethernet (RoCE) is a mechanism to provide this efficient data transfer
with very low latencies on loss-less Ethernet networks. With advances in data center convergence
over reliable Ethernet, ConnectX®-2/ConnectX®-3 EN with RoCE uses the proven and efficient
RDMA transport to provide the platform for deploying RDMA technology in mainstream data
center application at 10GigE and 40GigE link-speed. ConnectX®-2/ConnectX®-3 EN with its
hardware offload support takes advantage of this efficient RDMA transport (InfiniBand) services
over Ethernet to deliver ultra low latency for performance-critical and transaction intensive
applications such as financial, data base, storage, and content delivery networks.
RoCE encapsulates IB transport and GRH headers in Ethernet packets bearing a dedicated ether
type. While the use of GRH is optional within IB subnets, it is mandatory when using RoCE.
Applications written over IB verbs should work seamlessly, but they require provisioning of
GRH information when creating address vectors. The library and driver are modified to provide
mapping from GID to MAC addresses required by the hardware.
2.1.2 Ported Applications
The following applications are ported with RoCE:
• Network Direct (ND) applications work without any change