You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Jun 3, 2025. It is now read-only.
The SparseML train script is a wrapper around a [HuggingFace script](https://huggingface.co/docs/transformers/run_scripts), and
50
+
The SparseML train script is a wrapper around a [HuggingFace script](https://huggingface.co/docs/transformers/run_scripts), and
51
51
usage for most arguments follows the HuggingFace. The most important arguments for SparseML are:
52
-
-`model_name_or_path`: specifies starting model. It can be a SparseZoo stub, HF model identifier, or a local directory
52
+
-`model_name_or_path`: specifies starting model. It can be a SparseZoo stub, HF model identifier, or a local directory
53
53
with `model.pt`, `tokenizer.json` and `config.json`
54
54
-`recipe`: recipe containing the training hyperparamters (SparseZoo stub or a local file)
55
55
-`task_name`: specifies the sentiment analysis task. If not provided, also specifies the dataset, pipelines, and eval metrics.
56
56
57
-
To utilize a custom dataset, use the `--train_file` and `--validation_file` arguments. To use a dataset from the HuggingFace hub, use `--dataset_name`.
57
+
To utilize a custom dataset, use the `--train_file` and `--validation_file` arguments. To use a dataset from the HuggingFace hub, use `--dataset_name`.
58
58
See the [HF Docs](https://huggingface.co/docs/transformers/run_scripts#run-a-script) for more details.
59
59
60
60
Run the following to see the full list of options:
Usage is the same as above. The `--distill_teacher` argument instructs SparseML to perform model distillation from the
90
+
Usage is the same as above. The `--distill_teacher` argument instructs SparseML to perform model distillation from the
91
91
teacher saved at `models/teacher`.
92
92
93
93
There are many additional command line arguments that can be passed to tweak your fine-tuning process. Run the following to see the full list of options:
0 commit comments