Manualshelf

HP Fabric Clustering System for InfiniBand™ Interconnect Performance on HP-UX 11iv2

ManualsBrandsHP ManualsComputer AccessoriesHP Integrity PCIe 2-port 4X DDR Infiniband Host Channel Adapter
12345678910
Confidential Page 8 1/28/2005
VGA CONSOLE / REMOTE / UPS
LAN 10/100
LAN Gb
SCSI LV D/SE
USB
CONSOL E
SERIAL A
SERIAL B
PWR
1
PWR
2
Management Card
LAN 10/100
GSP RESETS
SOFT HARD
TOC
PCI-X 133
PCI-X 133
PCI-X 133
PCI-X 133
Infiniband
rx2600
rx2600
IB 4X Cable
VGA CONSOLE / REMOTE / UPS
LAN 10/100
LAN Gb
SCSI LVD/SE
USB
CONSOL E
SERIAL A
SERIAL B
PWR
1
PWR
2
Management Card
LAN 10/100
GSP RESETS
SOFT HARD
TOC
PCI-X 133
PCI-X 133
PCI-X 133
PCI-X 133
Infiniband
A
B
2
9
1
A
789101112
12 3 45 6
console
mgmt-eth
IB 4X Cable
AB291A - 12 port IB
Switch
VGA CONSOLE / REMOTE / UPS
LAN 10/100
LAN Gb
SCSI LVD/SE
USB
CONSOL E
SERIAL A
SERIAL B
PWR
1
PWR
2
Management Card
LAN 10/100
GSP RESETS
SOFT HARD
TOC
PCI-X 133
PCI-X 133
PCI-X 133
PCI-X 133
Infiniband
IB 4X Cable
rx2600
!
!
1
3
4
5
6
7
8
2
Sys tem Input Power
VAC 200-240 8 A ma x
50/60 Hz
01
M
P
LA
N
U
S
B
1
U
S
B
2
M
P
l
o
c
a
l
a
u
x
i
li
a
r
y
r
e
m
o
t
e
PCI -X 66
PCI -X 66
PCI -X 66
PCI -X 66
PCI- X 133
PCI- X 133
PC I- X 66 (L AN)
PC I- X 66 ( SC S I)
Dual SCSI
1000T LAN
Infiniband
IB 4X Cable
rx4640
Latency
In switched configurations, the HP-UX solution offers a 1-way latency of 4.6usec for 8-byte messages using the RDMA
programming model and 7.2usec for 1-byte messages using the Send/Receive programming model, on rx2600 node
clusters. In switch configurations, the latency remains sub-10usec for messages of length 512 bytes.
Latency
(Send/Receive programming model)
on rx2600
(2CPUs/1.5GHz/4GB RAM) - Switch Configuration
0
5
10
15
20
25
30
35
40
45
50
55
1 10 100 1000 10000 100000
Message Length (bytes)
1-way Latency (usec)
Latency (usec)
Bi-directional 1-way latencies on a rx2600 (2 CPUs/1.5GHz/4GB RAM) are 5.8usec for each stream using the
RDMA programming model, and 7.2usec for each stream using the Send/Receive programming model. The bi-
directional latencies for short messages, up to 512 bytes, remain pretty close to the respective uni-directional
latencies. On a rx2600 (2 CPUs/1.5GHz/4GB RAM) in switched configuration, bi-directional 1-way latencies for
512-byte messages are 7.7usec for each stream using the RDMA programming model, and 9.30usec for each stream
using the Send/Receive programming model.