Skip to content

Commit 1959178

Browse files
committed
added requantize/resmooth for qlora export
Signed-off-by: Suguna Velury <[email protected]>
1 parent 7fb53bb commit 1959178

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

modelopt/torch/export/unified_export_hf.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -426,9 +426,7 @@ def _export_hf_checkpoint(
426426

427427
# Resmooth and requantize fused layers
428428
# TODO: Handle mixed precision
429-
# TODO: Support requantize and resmooth for modelopt-trained LoRA models
430-
if not is_modelopt_qlora:
431-
requantize_resmooth_fused_llm_layers(model)
429+
requantize_resmooth_fused_llm_layers(model)
432430

433431
# Remove all hooks from the model
434432
try:

0 commit comments

Comments
 (0)