White Papers

Dell - Internal Use - Confidential
and GPU3 and GPU 4 have peer-to-peer accesses. In the future, we will try C4130 configuration B in which
all of the four GPUs connected to one socket have peer-to-peer accesses and check the performance
impact in this configuration. We will also investigate the impact of hyperparameters (e.g. batch size and
learning rate) on both training performance and model accuracy. The reason of the slow training
performance with TensorFlow on multiple nodes will also be examined.