Skip to content

Commit b4ef3b8

Browse files
author
wangzaijun
committed
fix
1 parent 1a792b1 commit b4ef3b8

File tree

1 file changed

+1
-0
lines changed
  • lightllm/common/basemodel/layer_weights/meta_weights/mm_weight

1 file changed

+1
-0
lines changed

lightllm/common/basemodel/layer_weights/meta_weights/mm_weight/mm_weight.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -191,6 +191,7 @@ def load_hf_weights(self, weights):
191191
and self.mm_param.weight is not None
192192
and self.quant_method.weight_need_quanted(self.mm_param.weight)
193193
):
194+
logger.info(f"online quant weight names: {self.weight_names}")
194195
quantized_weight, weight_scale, weight_zero_point = self.quant_method.quantize(
195196
self.mm_param.weight.cuda(get_current_device_id())
196197
)

0 commit comments

Comments
 (0)