Best Practices When Deploying Linux on the HP ProLiant DL980 (updated December 2012)

8
Figure 4: DL980 server architecture
XNC
IOH
CPU
0
CPU
1
IOH
CPU
2
CPU
3
IOH
CPU
4
CPU
5
CPU
6
CPU
7
XNC XNC XNC
IOH
XNC
Socket Local
Memory
I/O Hub (Boxboro)
Node Controller
QPI
Island
QPI Links
CPU
0
Processor
Slots 7-11
Optional
Slots 1-6
Optional LP
Slots 12-16
Upper processor board
Lower processor board
Displaying node distances
The distance between the local and remote node affects memory access latency. The greater the distance, the higher
are the memory access latencies. To display node memory statistics and relative distances between nodes, use the
numactl command (for more information, see the numactl(8)manpage). For example:
# numactl --hardware
available: 8 nodes (0-7)
node 0 cpus: 0 1 2 3 4 5 6 7 64 65 66 67 68 69 70 71
node 0 size: 16373 MB
node 0 free: 15548 MB
node 1 cpus: 8 9 10 11 12 13 14 15 72 73 74 75 76 77 78 79
node 1 size: 16384 MB
node 1 free: 15905 MB
node 2 cpus: 16 17 18 19 20 21 22 23 80 81 82 83 84 85 86 87
node 2 size: 16384 MB
node 2 free: 15944 MB
....
node 7 cpus: 56 57 58 59 60 61 62 63 120 121 122 123 124 125 126 127
node 7 size: 16384 MB
node 7 free: 15960 MB
node distances:
node 0 1 2 3 4 5 6 7
0: 10 12 17 17 19 19 19 19
1: 12 10 17 17 19 19 19 19
2: 17 17 10 12 19 19 19 19
3: 17 17 12 10 19 19 19 19
4: 19 19 19 19 10 12 17 17
5: 19 19 19 19 12 10 17 17
6: 19 19 19 19 17 17 10 12
7: 19 19 19 19 17 17 12 10