Skip to content

Commit 4655557

Browse files
committed
add tests for attn head
Signed-off-by: Kyle Sayers <[email protected]>
1 parent f372e1a commit 4655557

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/compressed_tensors/quantization/quant_scheme.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -65,6 +65,7 @@ def validate_model_after(model: "QuantizationScheme") -> "QuantizationScheme":
6565
QuantizationStrategy.TENSOR,
6666
QuantizationStrategy.GROUP,
6767
QuantizationStrategy.TENSOR_GROUP,
68+
QuantizationStrategy.ATTN_HEAD,
6869
):
6970
if (
7071
inputs.strategy == QuantizationStrategy.GROUP

0 commit comments

Comments
 (0)