ARM64 CUDA #57
Si-Richards
started this conversation in
General
ARM64 CUDA
#57
Replies: 1 comment
-
|
I've tried a couple of times trying to get it to run GPU on my Jetson Orin Nano Super and just couldnt get it work. I think it has to do with the binaries of the special version of Ubuntu that NVIDIA is using being...as you said, wobbly. They had to do a special version of Ollama for their distro so. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Docker throws wobbies when trying to run on NVIDIA DGX Spark (ARM64 CUDA 13) over arch issues.
I can make it run CPU mode, anyone have any ideas
Beta Was this translation helpful? Give feedback.
All reactions