We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 1ec68a5 commit 74e3ebbCopy full SHA for 74e3ebb
chapters/en/chapter11/5.mdx
@@ -92,7 +92,7 @@ Example: `"mmlu|abstract_algebra|0|0"` evaluates on MMLU's abstract algebra task
92
93
Let's set up an evaluation pipeline for our finetuned model. We will evaluate the model on set of sub tasks that relate to the domain of medicine.
94
95
-Here's a complete example of evaluating on automatic benchmarks relevant to one specific domain using Lighteval with the VLLM backend:
+Here's a complete example of evaluating on automatic benchmarks relevant to one specific domain using Lighteval with the accelerate backend:
96
97
```bash
98
lighteval accelerate \
0 commit comments