We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent f3a0b55 commit fcddf19Copy full SHA for fcddf19
lm_eval/filters/extraction.py
@@ -141,7 +141,7 @@ def __init__(
141
"""
142
regex_pattern: The basic regex pattern to use. If fails to match, we will use the customized match procedure
143
- step 1 : We parse the choices between ([A-Z])s then try to find these choices in the response.
144
- - step 2 : We parse the choice with regex: r'\s*([A-?])', where ? varies by number of choices.
+ - step 2 : We parse the choice with regex: r's*([A-?])', where ? varies by number of choices.
145
group_select: Selects the (group_select)th match from the findall result.
146
ignore_case: Ignores the case during step 1 matching
147
ignore_punctuation: Remove the punctuation during step 1 matching
0 commit comments