HP Fabric Clustering System for InfiniBand™ Interconnect Performance on HP-UX 11iv2

Confidential Page 9 1/28/2005
Bandwidth
Uni-directional bandwidth on a rx2600 node cluster provides an application bandwidth of 761MB/s at 4MB
message size with 0% service demand. Bi-directional bandwidth for the same message size is 790MB/s with 0%
service demand on the server.
Bandwidth on rx2600 (2 CPUs/1.5GHGz/4GB RAM) - Switch
Configuration
200
250
300
350
400
450
500
550
600
650
700
750
800
1 10 100 1000 10000
Message Length (KB)
Ba
nd
wi
dt
h
(M
B/
s
)
0
5
10
15
20
25
30
35
CP
U
Uti
liz
ati
on
(%
)
Uni-Directional Bandwidth
(MB/s)
Bi-Directional Bandwidth
CPU
Utili ti
per-CPU
Utili
ti
In a typical application environment, the HCA will be shared by more than a single connection. HP-UX cluster
interconnect solution scales across multiple connections providing almost an equal share of the available bandwidth
for all the parallel connections. On a rx2600 (2 CPUs/1.5Gz/4GB RAM) in a switch configuration, for 32 parallel
bandwidth streams, the bandwidth offers a mean bandwidth of 23.67MB/s with a standard deviation of
0.123MB/s, resulting a cumulative bandwidth of 757MB/s.
Bandwidth Scaling Across Parallel Connections on rx2600
(2CPUs/1.5GHz/4 GB RAM) - Switch Configuration
0
100
200
300
400
500
600
700
800
0 4 8 121620242832
Number of Parallel Streams
Bandiwdth (MB/s)
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Standard Deviation from
Mean Bandwidth
Cumulative Bandwidth (MB/s)
Mean Bandwidth
Standard Deviation