Skip to content
Discussion options

You must be logged in to vote

This tool currently only focuses on CPU inference, you may want to check out this repo instead for GPU inference for llama: https://github.com/0cc4m/KoboldAI

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by LostRuins
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants