Skip to content

Commit 860cd6c

Browse files
committed
add explanation of MMLU at the beginning of mmlu.py
It is good practice to include docstrings with clarifications. Signed-off-by: Costa Shulyupin <costa.shul@redhat.com>
1 parent cf02be9 commit 860cd6c

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

src/instructlab/eval/mmlu.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,11 @@
11
# SPDX-License-Identifier: Apache-2.0
22

3+
"""
4+
MMLU - Massive Multitask Language Understanding
5+
https://en.wikipedia.org/wiki/MMLU
6+
https://arxiv.org/abs/2009.03300
7+
"""
8+
39
# Standard
410
from typing import Optional, Union
511
import os

0 commit comments

Comments
 (0)