HP Cluster Platform InfiniBand Interconnect Installation and User's Guide

F HCA PCI Card Specifications
Appendix F includes specifications for the following HCA PCI cards and mezzanine HCAs:
• Voltaire HCA–400 PCI Card Specifications (Section F.1).
• Topspin/Mellanox PCI-X HCA Specifications (Section F.2).
• Topspin/Mellanox PCI-Express HCA Specifications (Section F.3).
• Mellanox PCI-X HCA Specifications (Section F.4).
• Mellanox PCI-Express HCA Specifications (Section F.5).
• Mellanox Memory Free PCI-Express HCA (SDR) Specifications (Section F.6).
• Mellanox Memory Free PCI-Express HCA (DDR) Specifications (Section F.7).
• Mellanox PCI-Express DDR HCA Specifications (Section F.8).
• 4x DDR IB Mezzanine HCA Specifications (Section F.9).
F.1 Voltaire HCA–400 PCI Card Specifications
The Voltaire HCA-400 is a dual-port, 4X (10 Gb/s) InfiniBand host channel adapter that supports
the following formats:
• PCI-Express bus interface that provides over 2500 MB/sec throughput
• PCI/PCI-X bus interface provides over 800 MB/sec throughput
It provides multi-protocol support for MPI, SDP, IPoIB, DAPL and iSER (iSCSI RDMA), enabling
a variety of high performance applications.
The technical specifications of the HCA-400 are as follows:
SpecificationFeature
Dual port 4X (10 Gb/s) InfiniBand PCI-Express low profile host channel adapter,
PCI-Express 1.0 (4X or 8X).
HCA-400Ex format and bus
interface
Dual port 4X (10 Gb/s) InfiniBand PCI/PCI-X low profile host channel adapter, PCI-X
1.0 (3.3V, 64-bit 133 MHz); PCI 2.2 (32/64-bit, 33/66 MHz).
HCA-400 format and bus
interface
InfiniBand v1.1 compatible design.InfiniBand Specifications
MTU Size: 2,048 Bytes, max.
Multicast Support, up to 2048 groups.
Virtual Lanes: 8 Data and 1 Management.
Physical Partitions: up to 64 per port.
Maximum message size: 1 GByte Standard InfiniBand Agents (SMA, PMA, CM).
Two auto-sensing 1X/4X InfiniBand ports, 8-pair MicroGigaCN copper.InfiniBand Interface
128 MB, optional 256 MB.Memory
MPI Support: MPI-CH (open source), MPI-Pro, Scali-MPI, and HP-MPI (available
separately).
Protocol Software
uDAPL and kDAPL.
IP and TCP: IETF IPoIB, and IBTA Socket Direct (SDP).
Storage: IETF iSCSI/iSER (iSCSI RDMA), Lustre, PVFS2, and NFS/RDMA (through
kDAPL).
Network Booting (PXE).
Loop-back tests, host stack diagnostics and automated deployment utilities.Diagnostic Software
SNMP MIB: draft-IETF-IPoIB-IBIF-MIB, Telnet/SSH for configuration and automation.Management Interfaces
MTBF: 400,000 hours.Reliability
F.1 Voltaire HCA–400 PCI Card Specifications 125