Skip to content

Commit e916aa4

Browse files
authored
make aime.yaml use custom utils to process results (#3353)
1 parent 0c90721 commit e916aa4

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

lm_eval/tasks/aime/aime.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ fewshot_split: train
99
test_split: train
1010
doc_to_text: "Question: {{Question}}\nAnswer:"
1111
doc_to_target: "{{Answer}}"
12+
process_results: !function utils.process_results
1213
metric_list:
1314
- metric: exact_match
1415
aggregation: mean

0 commit comments

Comments
 (0)