TRT-RTX EP support in ORT-GPU packages #25894
BLSharda
started this conversation in
Ideas / Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Requesting to support the ORT-GPU packages onnxruntime-gpu and Microsoft.ML.OnnxRuntime.Gpu to also support TensorRT-RTX EP to maintain parity with other EPs (CUDA/TRT).
ORT 1.22 python wheel size is ~200 MB (compressed). This includes below files
onnxruntime.dll – 14 MB
onnxruntime_providers_shared.dll – 22 KB
onnxruntime_providers_cuda.dll – 300 MB
onnxruntime_providers_tensorrt.dll – 803 KB
And extending this for TRT-RTX EP would only require building and packaging additional TRT-RTX EP DLL in the same packages.
onnxruntime_providers_nv_tensorrt_rtx.dll – 500 KB
Beta Was this translation helpful? Give feedback.
All reactions