Skip to content
Discussion options

You must be logged in to vote

I'm not sure if this is still relevant, but you can follow this instruction to quantize SafeTensors models.
https://qwen.readthedocs.io/en/latest/quantization/llama.cpp.html

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by louis-jan
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants