Import "llmcompressor.modifiers.autoround" could not be resolved

[HobDev]

What is the URL, file, or UI containing proposed doc change
Where does one find the original content or where would this change go?

What is the current content or situation in question
from llmcompressor.modifiers.autoround import AutoRoundModifier

What is the proposed change
from llmcompressor.modifiers.quantization import GPTQModifier

[yiliu30]

Hi @HobDev, thanks for bringing this up!
This import should work on the main branch. Could you please check which version you’re using on your side, or share the code snippet you used to reproduce the issue?

[HDCharles]

Is this just a suggestion for a single line change in llm-compressor docs?

https://github.com/vllm-project/llm-compressor/blob/main/examples/autoround/README.md?plain=1#L76

changing that import would just run into an error on the next line, this doc is for autoround, not GPTQ.

if you're having trouble following getting the example to work on your system, can you let us know your environment? I would suspect you'd get that error if you are using an older version of llm-compressor before autoround was added.