Skip to content

Commit db6ccb2

Browse files
authored
fix group quant bug (#203)
1 parent a43dad2 commit db6ccb2

File tree

1 file changed

+1
-1
lines changed
  • src/compressed_tensors/compressors/sparse_quantized_compressors

1 file changed

+1
-1
lines changed

src/compressed_tensors/compressors/sparse_quantized_compressors/marlin_24.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -238,7 +238,7 @@ def pack_scales_24(scales, quantization_args, w_shape):
238238
_, scale_perm_2_4, scale_perm_single_2_4 = get_permutations_24(num_bits)
239239

240240
if (
241-
quantization_args.strategy is QuantizationStrategy.GROUP
241+
quantization_args.strategy == QuantizationStrategy.GROUP
242242
and quantization_args.group_size < size_k
243243
):
244244
scales = scales.reshape((-1, len(scale_perm_2_4)))[:, scale_perm_2_4]

0 commit comments

Comments
 (0)