Skip to content

Commit a0c7e5f

Browse files
eshwarprasadSRobotSail
authored andcommitted
fix: typing for py3.10
Signed-off-by: eshwarprasadS <[email protected]>
1 parent df9543c commit a0c7e5f

File tree

1 file changed

+12
-12
lines changed

1 file changed

+12
-12
lines changed

src/instructlab/eval/longbench.py

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -12,21 +12,21 @@
1212
from .evaluator import Evaluator
1313

1414

15-
class LongBenchResult(t.TypedDict):
15+
class LongBenchResult(t.TypedDict, total=False):
1616
"""Dict containing averages for each task type and language"""
1717

1818
overall_score: float
19-
en_multidoc: t.NotRequired[float]
20-
zh_multidoc: t.NotRequired[float]
21-
en_singledoc: t.NotRequired[float]
22-
zh_singledoc: t.NotRequired[float]
23-
en_summ: t.NotRequired[float]
24-
zh_summ: t.NotRequired[float]
25-
en_fewshot: t.NotRequired[float]
26-
zh_fewshot: t.NotRequired[float]
27-
en_synthetic: t.NotRequired[float]
28-
zh_synthetic: t.NotRequired[float]
29-
code_avg: t.NotRequired[float]
19+
en_multidoc: float
20+
zh_multidoc: float
21+
en_singledoc: float
22+
zh_singledoc: float
23+
en_summ: float
24+
zh_summ: float
25+
en_fewshot: float
26+
zh_fewshot: float
27+
en_synthetic: float
28+
zh_synthetic: float
29+
code_avg: float
3030

3131

3232
# Define task categories

0 commit comments

Comments
 (0)