Official arm64 CUDA builds #24093
adamreeve
started this conversation in
Ideas / Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
We'd like to run ONNX Runtime on machines with arm64 CPUs and Nvidia GPUs. We can build ONNX Runtime ourselves, but it would be great if there were official builds published to PyPI or an Azure devops feed.
The use of arm64 for ML workloads is growing, for example AWS provides G5g instances that use arm64 Graviton2 processors and Nvidia GPUs, and Nvidia provide many systems that combine arm64 processors with their GPUs, for example Grace Hopper based systems.
I'd like to start this discussion to see if there's much more interest out there in running ONNX Runtime with CUDA on arm64.
There's a related issue for this idea at #22903. There was also a similar discussion at #11226 but that was more about building ONNX Runtime rather than providing official builds.
Beta Was this translation helpful? Give feedback.
All reactions