Skip to content
Discussion options

You must be logged in to vote

Did you modify or replace any files when building the project? It's not detecting GGUF at all, so either this is an older version of the koboldcpp_cublas.so file or there is a problem with the gguf model. Can you make sure you've rebuilt for culbas from scratch by doing a make clean followed by a make LLAMA_CUBLAS=1 from the latest repo?

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by Weroxig
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants