Skip to content

Commit 4aaa9a1

Browse files
authored
align README to yaml file (#3344)
1 parent ad506a1 commit 4aaa9a1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

lm_eval/tasks/humaneval/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@ Note: For instruct tuned models, we recommend the instruct variant. That uses a
3333
- `humaneval` pass@1
3434
- `humaneval_64` pass@64 variant
3535
- `humaneval_instruct`: pass@1 with config more appropriate for instruct models. (implementation taken from llama [evals](https://huggingface.co/datasets/meta-llama/Llama-3.1-8B-Instruct-evals/viewer/Llama-3.1-8B-Instruct-evals__human_eval__details?row=0))
36-
- `humaneval_instruct_64`: pass@64 variant
36+
- `humaneval_64_instruct`: pass@64 variant
3737

3838
### Checklist
3939

0 commit comments

Comments
 (0)