Add option for CUDA 13.1 llama.cpp in installer#7474
Open
GodEmperor785 wants to merge 1 commit intooobabooga:devfrom
Open
Add option for CUDA 13.1 llama.cpp in installer#7474GodEmperor785 wants to merge 1 commit intooobabooga:devfrom
GodEmperor785 wants to merge 1 commit intooobabooga:devfrom
Conversation
Adding new choice for NVIDIA option in installer - choose CUDA version for llama.cpp
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR adds new choice for NVIDIA option in installer - choose CUDA version for llama.cpp. Other options are unchanged.
So now choices looks like this when user selects "A) NVIDIA" when installing they have another choice:
https://github.com/oobabooga/llama-cpp-binaries already provides builds for CUDA 13.1 for llama.cpp, also portable builds provide version with CUDA 13.1.
Made this as a choice for user because some people might have old GPUs or just might want to install old builds for some reason.
For users with existing installation it doesn't reinstall anything - old installs will stay on 12.4. User can always delete installer_files and reinstall for CUDA 13.1
I verified locally that installation of CUDA 12.4/13.1 binaries works (fresh install) and that running from old install still works. Tested on Windows + Nvidia GPU.
Checklist: