Skip to content

Commit 9ace086

Browse files
authored
fix group_size (#2720)
1 parent dc0141f commit 9ace086

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

swift/llm/export/quant.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -208,6 +208,7 @@ def gptq_model_quantize(self):
208208
with self._patch_gptq():
209209
gptq_quantizer = GPTQQuantizer(
210210
bits=args.quant_bits,
211+
group_size=args.group_size,
211212
dataset=','.join(args.dataset),
212213
batch_size=args.quant_batch_size,
213214
block_name_to_quantize=self.get_block_name_to_quantize(self.model, args.model_type))

0 commit comments

Comments
 (0)