Replies: 3 comments 1 reply
-
You're kidding, there is only one CUDA in the world and it's Nvidia's, the differences you're talking about are just different versions. |
Beta Was this translation helpful? Give feedback.
-
cudnn is not the same as cuda. torch is build against specific version of cuda, but then dynamically loads cudnn.
|
Beta Was this translation helpful? Give feedback.
-
24.) Automatic1111 Web UI - PC - Free this method installs latest cuda dll files too test py
|
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
If you clone A1111, create a venv, and do a manual "pip3 install -r requirements.txt" you end up with a different setup than if you simply run webui.sh and let it install everything on the first run. In the former case the cuDNN lib's end up in:
venv/lib/python3.10/site-packages/nvidia/cudnn/lib
and in the later:
venv/lib/python3.10/site-packages/torch/lib
What's even more scary is that the libraries aren't identical for these two different 1.13.1+cu117 things.
If I'm guessing then the former comes from a nvidia repro and the later from the pytorch org and who knows if they are bug compatible, optimized the same, have the same pytorch features enabled, or even used the same compiler when built. Does it matter? I have no idea but I don't like it.
Env 1:
pip3 install torch
pip3 list | egrep "torch|cudnn"
python3 -c "import torch;print(torch.__version__)"
1.13.1+cu117
Env 2:
pip3 install torch==1.13.1+cu117 --extra-index-url https://download.pytorch.org/whl/cu117
pip3 list | egrep "torch|cudnn"
torch 1.13.1+cu117
python3 -c "import torch;print(torch.__version__)"
1.13.1+cu117
Beta Was this translation helpful? Give feedback.
All reactions