User Guide

Jetson AGX™ Orin Developer Kit Reviewer's Guide
15
Loading eval dataset...
filename: /benchdata/1272-135031-0000.wav
Done loading 1 files
Latencies (ms):
Median 90th 95th 99th Avg
9.2084 9.3835 9.5279 14.065 9.4069
Intermediate latencies (ms):
Median 90th 95th 99th Avg
9.2061 9.3615 9.4755 9.6975 9.3387
Final latencies (ms):
Median 90th 95th 99th Avg
14.065 14.131 14.131 14.131 14.041
Run time: 54.441 sec.
Total audio processed: 54.425 sec.
Throughput: 0.99971 RTFX
-----------------Starting NLP Benchmark
Done sending 1000 requests
Done processing 1000 responses
Run time: 6.80158s
Total sequences processed: 1000
Throughput: 147.025 seq/sec
Latencies: Median 90 95 99 Avg
3.39 3.49 3.51 3.57 3.45
-----------------Starting TTS Benchmark
Latencies:
First audio - average: 0.024089 (This is in seconds. Convert to milliseconds using 1000/latency in seconds)
First audio - P90: 0.0248866
First audio - P95: 0.0249044