File tree Expand file tree Collapse file tree 2 files changed +2
-1
lines changed
Expand file tree Collapse file tree 2 files changed +2
-1
lines changed Original file line number Diff line number Diff line change @@ -359,7 +359,7 @@ After performing QLoRA training the final checkpoint can be exported for deploym
359359``` sh
360360python export.py \
361361 --pyt_ckpt_path llama3-fp4-qlora \
362- --export_dir llama3-fp4-qlora-hf \
362+ --export_path llama3-fp4-qlora-hf \
363363
364364```
365365
Original file line number Diff line number Diff line change @@ -821,6 +821,7 @@ def postprocess_state_dict(
821821 state_dict: The full model state_dict.
822822 maxbound: The maximum bound value for the output quantizer.
823823 quantization: The KV cache quantization format.
824+ is_modelopt_qlora: Whether the model is a modelopt-trained QLoRA model.
824825
825826 Returns:
826827 The filtered state_dict without unnecessary keys like '_amax' and non KV cache output quantizers.
You can’t perform that action at this time.
0 commit comments