White Papers

39 CheXNet – Inference with Nvidia T4 on Dell EMC PowerEdge R7425
See Figure 17 the R7425-T4-16GB speedup Factor with TF-TRT versus Native
TensorFlow
Figure 17: Speedup Factor with TF-TRT versus Native TensorFlow
5.6 CheXNet Inference - TF-TRT 5.0 Integration vs Native TRT5 C++
API
We wanted to explore further and optimized the CheXNet inference using the TensorRT C++
API with the sample tool trtexec provided by Nvidia. This sample is very useful for generating
serialized engines and can be used as a template to work with our custom models.