Simple Tutorial for Running KoboldCPP in Docker #1295
snakewizardd
started this conversation in
Show and tell
Replies: 2 comments
-
Cool! But did you know KoboldCpp already has a proper ready-made docker on the docker hub by @henk717 which can be found at https://hub.docker.com/r/koboldai/koboldcpp But regardless, it's good to have more options! Thanks! |
Beta Was this translation helpful? Give feedback.
0 replies
-
Amazing - thank you for the reference! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I have written up a simple tutorial for getting started with KoboldCPP in Docker. I feel that it is a pretty simple point of entry for a reproducible linux-based build. source
Beta Was this translation helpful? Give feedback.
All reactions