User Guide

Jetson AGX™ Orin Developer Kit Reviewer's Guide

Running Inference Benchmarks

Download the tar ball named “benchmarks.tar.gz” required for this benchmarking from here and move

it inside the Review Directory. And untar the tar ball:

mkdir $HOME/Review

cd $HOME/Review

Move benchmarks.tar.gz to inside the $HOME/Review and then untar it:

tar -xvf benchmarks.tar.gz

Setup the requirements for running the benchmark by doing:

cd benchmarks

bash installBenchmarks.sh

The above script will download additional content from the internet. Please make sure that the devkit is

online when you run the script

For a clean measurement, please reboot the system and then start benchmarking.

Vision Model Benchmarking

Run Vision Model Benchmarks using:

bash launchVisionBenchmark.sh

You will get the output similar to below:

Model Name FPS

0 peoplenet 531.319971

1 action_recog_2d 1576.913747

2 action_recog_3d 108.784537

3 dashcamnet 1905.534769

4 bodyposenet 560.921805

5 lpr_us 4118.400131

Conversational AI Model Benchmarking

Run Vision Model Benchmarks using:

bash launchConvBenchmark.sh

You will get the output similar to below. Highlighted in yellow are the latencies of ASR, NLP and TTS.

You can convert that latency to FPS using 1000/latency.

-----------------Starting ASR Benchmark