Skip to content

Commit b416d29

Browse files
committed
Benchmark result with --limit 10 --iterations 15 added
1 parent e56b073 commit b416d29

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

scripts/lm_eval/README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -48,6 +48,12 @@ $ python3 scripts/lm_eval/lm-eval.py --tasks gsm8k --limit 10 --iterations 10
4848
Headline metrics:
4949
gsm8k exact_match,strict-match 80.000%
5050
[..]
51+
52+
$ python3 scripts/lm_eval/lm-eval.py --tasks gsm8k --limit 10 --iterations 15
53+
[..]
54+
Headline metrics:
55+
gsm8k exact_match,strict-match 70.000%
56+
[..]
5157
```
5258

5359
## Warning

0 commit comments

Comments
 (0)