What Nvidia GPUs can I use for TensorRT execution provider in ONNX runtime? #7880
Unanswered
ExecutionProvider
asked this question in
Other Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Not all Execution Providers (EP) offer the same acceleration platforms for ONNX Runtime (ORT) as for the corresponding inference engine. For instance, the Vitis AI EP only offers support for their Alveo U200 and U250 acceleration cards.
I want to know what Nvidia GPUs I can use if I choose to go with the TensorRT EP and ORT. Also, do they need CUDA support?
This is all the information the official docs provide:
The TensorRT inference engine lists the supported hardware here, but I am wondering if this list is valid for the TensorRT execution provider as well.
Beta Was this translation helpful? Give feedback.
All reactions