Skip to content

Commit f484b5d

Browse files
committed
added requantize/resmooth for qlora export
Signed-off-by: Suguna Velury <[email protected]>
1 parent 0b19255 commit f484b5d

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

modelopt/torch/export/unified_export_hf.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -430,9 +430,7 @@ def _export_hf_checkpoint(
430430

431431
# Resmooth and requantize fused layers
432432
# TODO: Handle mixed precision
433-
# TODO: Support requantize and resmooth for modelopt-trained LoRA models
434-
if not is_modelopt_qlora:
435-
requantize_resmooth_fused_llm_layers(model)
433+
requantize_resmooth_fused_llm_layers(model)
436434

437435
# Remove all hooks from the model
438436
try:

0 commit comments

Comments
 (0)