Skip to content

Commit 3e69d69

Browse files
committed
enable group quant
Signed-off-by: Kyle Sayers <[email protected]>
1 parent 8abbcde commit 3e69d69

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/compressed_tensors/quantization/quant_scheme.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -63,6 +63,7 @@ def validate_model_after(model: "QuantizationScheme") -> "QuantizationScheme":
6363
if inputs.strategy not in (
6464
QuantizationStrategy.TOKEN,
6565
QuantizationStrategy.TENSOR,
66+
QuantizationStrategy.GROUP,
6667
QuantizationStrategy.TENSOR_GROUP,
6768
):
6869
raise NotImplementedError(

0 commit comments

Comments
 (0)