Skip to content

Commit 17e024b

Browse files
authored
Fix inspect reasoning effrot (#1033)
* adds mmlu-pro * adds mmlu-pro * add mmlu-pro with inspectai * fix reasoning effrot
1 parent fa4860f commit 17e024b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/lighteval/main_inspect.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -283,7 +283,7 @@ def eval(
283283
bool | None, Option(help="Cache prompt prefix.", rich_help_panel=HELP_PANEL_NAME_1)
284284
] = None,
285285
reasoning_effort: Annotated[
286-
int | None, Option(help="Value: `minimal`, `low`, `medium`, `high`", rich_help_panel=HELP_PANEL_NAME_1)
286+
str | None, Option(help="Value: `minimal`, `low`, `medium`, `high`", rich_help_panel=HELP_PANEL_NAME_1)
287287
] = None,
288288
reasoning_tokens: Annotated[
289289
int | None,

0 commit comments

Comments
 (0)