File tree Expand file tree Collapse file tree 2 files changed +2
-1
lines changed Expand file tree Collapse file tree 2 files changed +2
-1
lines changed Original file line number Diff line number Diff line change @@ -350,7 +350,7 @@ After performing QLoRA training the final checkpoint can be exported for deploym
350
350
``` sh
351
351
python export.py \
352
352
--pyt_ckpt_path llama3-fp4-qlora \
353
- --export_dir llama3-fp4-qlora-hf \
353
+ --export_path llama3-fp4-qlora-hf \
354
354
355
355
```
356
356
Original file line number Diff line number Diff line change @@ -827,6 +827,7 @@ def postprocess_state_dict(
827
827
state_dict: The full model state_dict.
828
828
maxbound: The maximum bound value for the output quantizer.
829
829
quantization: The KV cache quantization format.
830
+ is_modelopt_qlora: Whether the model is a modelopt-trained QLoRA model.
830
831
831
832
Returns:
832
833
The filtered state_dict without unnecessary keys like '_amax' and non KV cache output quantizers.
You can’t perform that action at this time.
0 commit comments