File tree Expand file tree Collapse file tree 2 files changed +2
-1
lines changed Expand file tree Collapse file tree 2 files changed +2
-1
lines changed Original file line number Diff line number Diff line change @@ -350,7 +350,7 @@ After performing QLoRA training the final checkpoint can be exported for deploym
350350``` sh
351351python export.py \
352352 --pyt_ckpt_path llama3-fp4-qlora \
353- --export_dir llama3-fp4-qlora-hf \
353+ --export_path llama3-fp4-qlora-hf \
354354
355355```
356356
Original file line number Diff line number Diff line change @@ -827,6 +827,7 @@ def postprocess_state_dict(
827827 state_dict: The full model state_dict.
828828 maxbound: The maximum bound value for the output quantizer.
829829 quantization: The KV cache quantization format.
830+ is_modelopt_qlora: Whether the model is a modelopt-trained QLoRA model.
830831
831832 Returns:
832833 The filtered state_dict without unnecessary keys like '_amax' and non KV cache output quantizers.
You can’t perform that action at this time.
0 commit comments