@@ -14,7 +14,7 @@ Learn how to use this package by watching our on-demand webinar:
1414
1515## Overview
1616
17- [ Isaac ROS DNN Inference] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_dnn_inference ) contains ROS 2 packages for performing DNN
17+ Isaac ROS DNN Inference contains ROS 2 packages for performing DNN
1818inference, providing AI-based perception for robotics applications. DNN
1919inference uses a pre-trained DNN model to ingest an input Tensor and
2020output a prediction to an output Tensor.
@@ -70,13 +70,13 @@ This package is powered by [NVIDIA Isaac Transport for ROS (NITROS)](https://dev
7070
7171## Performance
7272
73- | Sample Graph<br /><br /> | Input Size<br /><br /> | AGX Orin<br /><br /> | Orin NX<br /><br /> | Orin Nano 8GB<br /><br /> | x86_64 w/ RTX 4090<br /><br /> |
73+ | Sample Graph<br /><br /> | Input Size<br /><br /> | AGX Orin<br /><br /> | Orin NX<br /><br /> | Orin Nano Super 8GB<br /><br /> | x86_64 w/ RTX 4090<br /><br /> |
7474| --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| --------------------------| --------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -------------------------------------------------------------------------------------------------------------------------------------------------------------------------| ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
75- | [ TensorRT Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_tensor_rt_benchmark/scripts/isaac_ros_tensor_rt_dope_node.py ) <br /><br /><br />DOPE<br /><br /> | VGA<br /><br /><br /><br /> | [ 47.9 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_dope_node-agx_orin.json ) <br /><br /><br />24 ms @ 30Hz<br /><br /> | [ 18.1 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_dope_node-orin_nx.json ) <br /><br /><br />56 ms @ 30Hz<br /><br /> | [ 13.1 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_dope_node-orin_nano.json ) <br /><br /><br />81 ms @ 30Hz<br /><br /> | [ 298 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_dope_node-x86-4090.json ) <br /><br /><br />4.6 ms @ 30Hz<br /><br /> |
76- | [ Triton Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_triton_benchmark/scripts/isaac_ros_triton_dope_node.py ) <br /><br /><br />DOPE<br /><br /> | VGA<br /><br /><br /><br /> | [ 47 .2 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_dope_node-agx_orin.json ) <br /><br /><br />24 ms @ 30Hz<br /><br /> | [ 20.3 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_dope_node-orin_nx.json ) <br /><br /><br />530 ms @ 30Hz<br /><br /> | [ 14.5 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_dope_node-orin_nano.json ) <br /><br /><br />780 ms @ 30Hz<br /><br /> | [ 276 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_dope_node-x86-4090.json ) <br /><br /><br />4.6 ms @ 30Hz<br /><br /> |
77- | [ TensorRT Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_tensor_rt_benchmark/scripts/isaac_ros_tensor_rt_ps_node.py ) <br /><br /><br />PeopleSemSegNet<br /><br /> | 544p<br /><br /><br /><br /> | [ 460 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_ps_node-agx_orin.json ) <br /><br /><br />4.1 ms @ 30Hz<br /><br /> | [ 348 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_ps_node-orin_nx.json ) <br /><br /><br />6 .1 ms @ 30Hz<br /><br /> | [ 238 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_ps_node-orin_nano.json ) <br /><br /><br />7.0 ms @ 30Hz<br /><br /> | [ 685 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_ps_node-nuc_4060ti .json ) <br /><br /><br />2.9 ms @ 30Hz<br /><br /> |
78- | [ Triton Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_triton_benchmark/scripts/isaac_ros_triton_ps_node.py ) <br /><br /><br />PeopleSemSegNet<br /><br /> | 544p<br /><br /><br /><br /> | [ 304 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_ps_node-agx_orin.json ) <br /><br /><br />4.8 ms @ 30Hz<br /><br /> | [ 206 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_ps_node-orin_nx.json ) <br /><br /><br />6.5 ms @ 30Hz<br /><br /> | –<br /><br /><br /><br /> | [ 677 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_ps_node-nuc_4060ti .json ) <br /><br /><br />2.2 ms @ 30Hz<br /><br /> |
79- | [ DNN Image Encoder Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_dnn_image_encoder_benchmark/scripts/isaac_ros_dnn_image_encoder_node.py ) <br /><br /><br /><br /> | VGA<br /><br /><br /><br /> | [ 420 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_dnn_image_encoder_node-agx_orin.json ) <br /><br /><br />12 ms @ 30Hz<br /><br /> | [ 382 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_dnn_image_encoder_node-orin_nx.json ) <br /><br /><br />11 ms @ 30Hz<br /><br /> | –<br /><br /><br /><br /> | [ 574 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_dnn_image_encoder_node-x86-4090.json ) <br /><br /><br />5.2 ms @ 30Hz<br /><br /> |
75+ | [ TensorRT Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_tensor_rt_benchmark/scripts/isaac_ros_tensor_rt_dope_node.py ) <br /><br /><br />DOPE<br /><br /> | VGA<br /><br /><br /><br /> | [ 30.8 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_dope_node-agx_orin.json ) <br /><br /><br />37 ms @ 30Hz<br /><br /> | [ 15.5 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_dope_node-orin_nx.json ) <br /><br /><br />55 ms @ 30Hz<br /><br /> | [ 20.8 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_dope_node-orin_nano.json ) <br /><br /><br />51 ms @ 30Hz<br /><br /> | [ 298 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_dope_node-x86-4090.json ) <br /><br /><br />5.3 ms @ 30Hz<br /><br /> |
76+ | [ Triton Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_triton_benchmark/scripts/isaac_ros_triton_dope_node.py ) <br /><br /><br />DOPE<br /><br /> | VGA<br /><br /><br /><br /> | [ 31 .2 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_dope_node-agx_orin.json ) <br /><br /><br />340 ms @ 30Hz<br /><br /> | [ 15.5 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_dope_node-orin_nx.json ) <br /><br /><br />55 ms @ 30Hz<br /><br /> | [ 22.2 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_dope_node-orin_nano.json ) <br /><br /><br />490 ms @ 30Hz<br /><br /> | [ 277 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_dope_node-x86-4090.json ) <br /><br /><br />4.7 ms @ 30Hz<br /><br /> |
77+ | [ TensorRT Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_tensor_rt_benchmark/scripts/isaac_ros_tensor_rt_ps_node.py ) <br /><br /><br />PeopleSemSegNet<br /><br /> | 544p<br /><br /><br /><br /> | [ 489 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_ps_node-agx_orin.json ) <br /><br /><br />4.6 ms @ 30Hz<br /><br /> | [ 258 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_ps_node-orin_nx.json ) <br /><br /><br />7 .1 ms @ 30Hz<br /><br /> | [ 269 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_ps_node-orin_nano.json ) <br /><br /><br />6.2 ms @ 30Hz<br /><br /> | [ 619 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_tensor_rt_ps_node-x86-4090 .json ) <br /><br /><br />2.2 ms @ 30Hz<br /><br /> |
78+ | [ Triton Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_triton_benchmark/scripts/isaac_ros_triton_ps_node.py ) <br /><br /><br />PeopleSemSegNet<br /><br /> | 544p<br /><br /><br /><br /> | [ 216 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_ps_node-agx_orin.json ) <br /><br /><br />5.5 ms @ 30Hz<br /><br /> | [ 143 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_ps_node-orin_nx.json ) <br /><br /><br />8.2 ms @ 30Hz<br /><br /> | –<br /><br /><br /><br /> | [ 585 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_triton_ps_node-x86-4090 .json ) <br /><br /><br />2.5 ms @ 30Hz<br /><br /> |
79+ | [ DNN Image Encoder Node] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/benchmarks/isaac_ros_dnn_image_encoder_benchmark/scripts/isaac_ros_dnn_image_encoder_node.py ) <br /><br /><br /><br /> | VGA<br /><br /><br /><br /> | [ 339 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_dnn_image_encoder_node-agx_orin.json ) <br /><br /><br />13 ms @ 30Hz<br /><br /> | [ 375 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_dnn_image_encoder_node-orin_nx.json ) <br /><br /><br />12 ms @ 30Hz<br /><br /> | –<br /><br /><br /><br /> | [ 480 fps] ( https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_benchmark/blob/main/results/isaac_ros_dnn_image_encoder_node-x86-4090.json ) <br /><br /><br />6.0 ms @ 30Hz<br /><br /> |
8080
8181---
8282
0 commit comments