Docker images to run on CPU or GPU

[bartowski1182]

I've made up some docker images for KoboldCPP, one for just CPU and one for both CPU and GPU (CPU only image is significantly smaller for anyone who isn't using a GPU)

Has been updated to 1.32.1

https://hub.docker.com/r/noneabove1182/koboldcpp-gpu

https://hub.docker.com/r/noneabove1182/koboldcpp

[LostRuins]

That's cool! Very nice.

[bartowski1182]

Updated to 1.32 :) https://hub.docker.com/r/noneabove1182/koboldcpp-gpu

[entmike]

Plans on updating it? Newer versions include OpenAI-compatible endpoints which is nice.

[bartowski1182]

Ah sure! kinda let this one flounder a bit, i'll update it more regularly :)

[bartowski1182]

@entmike updated :) https://hub.docker.com/r/noneabove1182/koboldcpp-gpu/tags and future ones will be faster too!

https://github.com/noneabove1182/koboldcpp-docker

[LostRuins]

I linked it on the main repo page too