White Papers

ManualsBrandsDell ManualsConverged InfrastructureHigh Performance Computing Solution Resources

Dell PowerEdge C4130 Performance with

K80 GPUs - HPL

Authors: Saeed Iqbal and Mayura Deshmukh

There is an ever increasing demand for compute power. This demand has pushed server designs towards higher

hardware accelerator density. However, most such designs have a standard system configuration, which may not

be optimal for maximum performance across all application classes. The latest high density design from Dell, the

PowerEdge C4130, offers up to four GPUs in a 1U form factor. Also the uniqueness of PowerEdge C4130 is that it

offers a configurable system design, potentially making it a better fit, for the wider variety of extreme HPC

applications.

This blog is about performance characterization of the C4130 on HPL, we present data on performance achieved,

power consumption and performance per watt on various system configurations.

The latest HPC focused Tesla series General Purpose Graphic Units (GPU) released from NVIDIA is the Tesla K80,

from the HPC prospective the most important improvement is the 1.87 TFLOPs (double precision) compute

capacity, which is about 30% more than K40, the previous Tesla card. The K80 auto-boost feature automatically

provides additional performance if additional power head room is available. The internal GPUs are based on the

GK210 architecture and have a total of 4,992 cores which represent a 73% improvement over K40. The K80 has a

total memory of 24GBs which is divided equally between the two internal GPUs; this is a 100% more memory

capacity compared to the K40. The memory bandwidth in K80 is improved to 480 GB/s. The rated power

consumption of a single K80 is a maximum of 300 watts.

The C4130 offers five configurations “A” through “E”. Since GPUs provide the bulk of compute horsepower, the

configurations can be divided into groups based on expected performance, the first group of three configurations,

“A”, “B” and “C”, with four GPUs each and the second group of two configurations, “D” and “E”, with two GPUs

each. The first two quad GPU configurations have an internal PCIe switch module. The details of the various

configurations are shown in the Table 1 and the block diagram (Figure 1) below:

Table 1: C4130 Configurations

C4130

Configuration

GPUs

CPUs

Switch

Module

(SW)

GPU/CPU

ratio

Comments

Single CPU, optimized for peer to peer communication

Dual CPUs, optimized for peer to peer communication

Dual CPUs, Balanced with four GPUs

Dual CPUs, Balanced with two GPUs

Single CPU, Balanced with two GPUs

Summary of content (4 pages)

PAGE 1
Dell PowerEdge C4130 Performance with K80 GPUs - HPL Authors: Saeed Iqbal and Mayura Deshmukh There is an ever increasing demand for compute power. This demand has pushed server designs towards higher hardware accelerator density. However, most such designs have a standard system configuration, which may not be optimal for maximum performance across all application classes. The latest high density design from Dell, the PowerEdge C4130, offers up to four GPUs in a 1U form factor.
PAGE 2
Figure 1: C4130 Configuration Block Diagram Table 2 gives more information about the hardware configuration and the benchmark details used for the tests. For HPL the problem size used was ~85%-~90% of the system memory. Table 2: Hardware Configuration and benchmark details Server C4130 Prototype System Processor 1 or 2 x Intel Xeon CPU E5-2690 v3 @ 2.
PAGE 3
Figure 2: HPL performance, efficiency and acceleration on the five C4130 configurations. Figure 2 shows the HPL performance characterization of PowerEdge C4130. Configurations “A”, “B” and “C” are four GPU configurations with performance from 6.5 to 7.3 TFLOPS. The difference from “A” to “B” is due to the extra CPU in configurations “B”. Overall the “C” configuration has the highest performance of 7.3 TFLOPS.
PAGE 4
Figure 3: Total power and performance/watt on the five C4130 configurations. Figure 3 shows the power consumption data for the HPL runs in Figure 2. In general, GPUs can consume substantial power when loaded with compute intensive workloads. As shown above, the power consumption of configurations “A”,”B” and “C” is significantly higher (2.9X to 3.3X) compared to CPU-only runs; this is due to the four K80 GPUs. Power consumption of “D” and “E” is lower (1.8X to 2.0X compared to CPU-only runs).