Skip to content

Commit 187d0e9

Browse files
christinaexyouchristinaexyou
authored
fix(tasks):pin correct MMLUSR version (#3350)
1 parent 5d2bc54 commit 187d0e9

File tree

3 files changed

+6
-0
lines changed

3 files changed

+6
-0
lines changed

‎lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
11
dataset_path: NiniCat/MMLU-SR
2+
dataset_kwargs:
3+
revision: bd6827d2542e9d6cf1d58ce262ce0b9ad7742754
24
test_split: test
35
fewshot_split: train
46
fewshot_config:

‎lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
11
dataset_path: NiniCat/MMLU-SR
2+
dataset_kwargs:
3+
revision: bd6827d2542e9d6cf1d58ce262ce0b9ad7742754
24
test_split: test
35
fewshot_split: train
46
fewshot_config:

‎lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
11
dataset_path: NiniCat/MMLU-SR
2+
dataset_kwargs:
3+
revision: bd6827d2542e9d6cf1d58ce262ce0b9ad7742754
24
test_split: test
35
fewshot_split: train
46
fewshot_config:

0 commit comments

Comments
 (0)