Skip to content

Commit f179a91

Browse files
committed
allow-group-dynamic-quantization
Signed-off-by: Kyle Sayers <[email protected]>
1 parent 5875644 commit f179a91

File tree

1 file changed

+0
-9
lines changed

1 file changed

+0
-9
lines changed

src/compressed_tensors/quantization/quant_scheme.py

Lines changed: 0 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -66,15 +66,6 @@ def validate_model_after(model: "QuantizationScheme") -> "QuantizationScheme":
6666
QuantizationStrategy.GROUP,
6767
QuantizationStrategy.TENSOR_GROUP,
6868
):
69-
if (
70-
inputs.strategy == QuantizationStrategy.GROUP
71-
and inputs.dynamic is True
72-
):
73-
raise NotImplementedError(
74-
"Static and local group-wise activation "
75-
"quantization is not supported"
76-
)
77-
7869
raise NotImplementedError(
7970
f"Using {inputs.strategy} strategy is not supported for "
8071
"activation quantization"

0 commit comments

Comments
 (0)