User Manual
Table Of Contents
- Mellanox WinOF VPI User Manual
- Table of Contents
- List of Tables
- Document Revision History
- About this Manual
- 1 Introduction
- 2 Driver Features
- 3 Deploying Windows Server 2012 with SMB Direct
- 4 Driver Configuration
- 5 Performance Tuning
- 6 OpenSM - Subnet Manager
- 7 InfiniBand Fabric
- 7.1 Network Direct Interface
- 7.2 part_man - Virtual IPoIB Port Creation Utility
- 7.3 InfiniBand Fabric Diagnostic Utilities
- 7.4 InfiniBand Fabric Performance Utilities
- 7.4.1 ib_read_bw
- 7.4.2 ib_read_lat
- 7.4.3 ib_send_bw
- 7.4.4 ib_send_lat
- 7.4.5 ib_write_bw
- 7.4.6 ib_write_lat
- 7.4.7 ibv_read_bw
- 7.4.8 ibv_read_lat
- 7.4.9 ibv_send_bw
- 7.4.10 ibv_send_lat
- 7.4.11 ibv_write_bw
- 7.4.12 ibv_write_lat
- 7.4.13 ibaddr
- 7.4.14 ibcacheedit
- 7.4.15 iblinkinfo
- 7.4.16 ibqueryerrors
- 7.4.17 ibsysstat
- 7.4.18 perfquery
- 7.4.19 saquery
- 7.4.20 smpdump
- 8 Software Development Kit
- 9 Troubleshooting
- 10 Documentation
WinOF VPI for Windows User Manual Rev 4.3
Mellanox Technologies
42
To improve performance, activate the performance tuning tool as follows:
1. Start the "Device Manager" (open a command line window and enter: devmgmt.msc).
2. Open "Network Adapters".
3. Right click the relevant Ethernet adapter and select Properties.
4. Select the "Advanced" tab and select Performance Options
5. Modify performance parameters (properties) as desired.
5.2.1.1 Performance Known Issues
• On Intel I/OAT supported systems, it is highly recommended to install and enable the
latest I/OAT driver (download from www.intel.com).
• With I/OAT enabled, sending 256-byte messages or larger will activate I/OAT. This will
cause a significant latency increase due to I/OAT algorithms. On the other hand,
throughput will increase significantly when using I/OAT.
5.2.2 IPoIB Performance Tuning
The user can configure the IPoIB adapter by setting some registry keys. The registry keys may
affect IPoIB performance.
For the complete list of registry entries that may be added/changed by the performance tuning
procedure, see the IPoIB_registry_values.pdf file.
To improve performance, activate the performance tuning tool as follows:
1. Start the "Device Manager" (open a command line window and enter: devmgmt.msc).
2. Open "Network Adapters".
3. Right click the relevant IPoIB adapter and select Properties.
4. Select the "Advanced" tab
5. Modify performance parameters (properties) as desired.
5.3 Tunable Performance Parameters
The following is a list of key parameters for performance tuning.
• Jumbo Packet
The maximum available size of the transfer unit, also known as the Maximum Transmission Unit
(MTU). For IPoIB, the MTU should not include the size of the IPoIB header (=4B). For example, if
the network adapter card supports a 4K MTU, the upper threshold for payload MTU is 4092B and not
4096B. The MTU of a network can have a substantial impact on performance. A 4K MTU size
improves performance for short messages, since NDIS can coalesce a small message into a larger one.
Valid MTU values range for an Ethernet driver is between 600 and 9600.
Valid MTU values range for an IPoIB driver is between 1500 and 4092.
• Receive Buffers
All devices on the same physical network, or on the same logical network, must have
the same MTU.