auto-gptq install may fail, solution in the description

[XmYx]

Simply use:

PYPI_RELEASE=true pip install auto-gptq

to install auto-qptq to overcome it, as per: AutoGPTQ/AutoGPTQ#730

no time to fork and pr, but intended to share, thank you

[SanDiegoDude]

Hey awesome, thanks for the heads up. Won't get the chance to add the fix until tonight, but will update the issue once fixed.

[SanDiegoDude]

Hey digging in further, looks like this is still a problem with Python 3.12, which is the reason why I added support for GPTQModel instead. Really don't recommend running autoGPTQ if you're on python 3.12, I dont' think I've seen anybody getting it working yet. Leaving this open for now since they're still actively working on the issue on that thread you linked, will update if/when they figure it out there.