Skip to content

Commit 1ae0684

Browse files
authored
Update quicktour command (#679)
* Update * more fixes
1 parent 2ef1bc5 commit 1ae0684

File tree

2 files changed

+5
-5
lines changed

2 files changed

+5
-5
lines changed

docs/source/adding-a-custom-task.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -171,7 +171,7 @@ Once your file is created you can then run the evaluation with the following com
171171

172172
```bash
173173
lighteval accelerate \
174-
"pretrained=HuggingFaceH4/zephyr-7b-beta" \
174+
"model_name=HuggingFaceH4/zephyr-7b-beta" \
175175
"community|{custom_task}|{fewshots}|{truncate_few_shot}" \
176176
--custom-tasks {path_to_your_custom_task_file}
177177
```

docs/source/quicktour.mdx

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ To evaluate `GPT-2` on the Truthful QA benchmark with [🤗
2727

2828
```bash
2929
lighteval accelerate \
30-
"pretrained=gpt2" \
30+
"model_name=openai-community/gpt2" \
3131
"leaderboard|truthfulqa:mc|0|0"
3232
```
3333

@@ -59,7 +59,7 @@ When specifying a path to file, it should start with `./`.
5959

6060
```bash
6161
lighteval accelerate \
62-
"pretrained=gpt2" \
62+
"model_name=openai-community/gpt2" \
6363
./path/to/lighteval/examples/tasks/recommended_set.txt
6464
# or, e.g., "leaderboard|truthfulqa:mc|0|0|,leaderboard|gsm8k|3|1"
6565
```
@@ -79,7 +79,7 @@ You can then evaluate a model using data parallelism on 8 GPUs like follows:
7979
```bash
8080
accelerate launch --multi_gpu --num_processes=8 -m \
8181
lighteval accelerate \
82-
"pretrained=gpt2" \
82+
"model_name=openai-community/gpt2" \
8383
"leaderboard|truthfulqa:mc|0|0"
8484
```
8585

@@ -92,7 +92,7 @@ To evaluate a model using pipeline parallelism on 2 or more GPUs, run:
9292

9393
```bash
9494
lighteval accelerate \
95-
"pretrained=gpt2,model_parallel=True" \
95+
"model_name=openai-community/gpt2,model_parallel=True" \
9696
"leaderboard|truthfulqa:mc|0|0"
9797
```
9898

0 commit comments

Comments
 (0)