AWQ support? #704

Closed Unanswered

ryanshrott asked this question in Q&A

ryanshrott
Oct 9, 2023

Am i able to fine tune an AWQ model like this one?
https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-AWQ

Replies: 1 comment

winglian
Oct 15, 2023
Maintainer

Sorry, only GPTQ is supported currently.

0 replies

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment