File tree Expand file tree Collapse file tree 2 files changed +2
-1
lines changed Expand file tree Collapse file tree 2 files changed +2
-1
lines changed Original file line number Diff line number Diff line change @@ -359,7 +359,7 @@ After performing QLoRA training the final checkpoint can be exported for deploym
359
359
``` sh
360
360
python export.py \
361
361
--pyt_ckpt_path llama3-fp4-qlora \
362
- --export_dir llama3-fp4-qlora-hf \
362
+ --export_path llama3-fp4-qlora-hf \
363
363
364
364
```
365
365
Original file line number Diff line number Diff line change @@ -821,6 +821,7 @@ def postprocess_state_dict(
821
821
state_dict: The full model state_dict.
822
822
maxbound: The maximum bound value for the output quantizer.
823
823
quantization: The KV cache quantization format.
824
+ is_modelopt_qlora: Whether the model is a modelopt-trained QLoRA model.
824
825
825
826
Returns:
826
827
The filtered state_dict without unnecessary keys like '_amax' and non KV cache output quantizers.
You can’t perform that action at this time.
0 commit comments