We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 92e6b38 commit 11d15d5Copy full SHA for 11d15d5
src/compressed_tensors/quantization/quant_scheme.py
@@ -65,6 +65,7 @@ def validate_model_after(model: "QuantizationScheme") -> "QuantizationScheme":
65
QuantizationStrategy.TENSOR,
66
QuantizationStrategy.GROUP,
67
QuantizationStrategy.TENSOR_GROUP,
68
+ QuantizationStrategy.ATTN_HEAD,
69
):
70
if (
71
inputs.strategy == QuantizationStrategy.GROUP
0 commit comments