We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 632b69b commit bb14995Copy full SHA for bb14995
src/lighteval/tasks/default_tasks.py
@@ -325,7 +325,7 @@
325
generation_size=32768,
326
metric=[
327
Metrics.expr_gold_metric,
328
- Metrics.math_pass_at_1_16n,
+ Metrics.math_pass_at_1_32n,
329
],
330
version=1,
331
)
@@ -342,7 +342,7 @@
342
generation_size=10000,
343
344
345
346
347
348
0 commit comments