Skip to content

Commit d33aba1

Browse files
committed
HumanEval: Add MiniMax prompt format
1 parent 6606eee commit d33aba1

File tree

1 file changed

+11
-1
lines changed

1 file changed

+11
-1
lines changed

eval/humaneval.py

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,6 +80,16 @@
8080
"<|User|>Complete the following Python function:\n\n{{problem}}"
8181
"<|Assistant|>Sure! Here is how you might implement the function:\n\n```python\n{{problem}}",
8282
" "
83+
),
84+
"minimax": (
85+
"]~!b[]~b]system\n"
86+
"You are a helpful AI coding assistant.[e~[\n"
87+
"]~b]user\n"
88+
"Complete the following Python function:\n\n{{problem}}[e~[\n"
89+
"]~b]ai\n"
90+
"<think> </think>"
91+
"Sure! Here is how you might implement the function:\n\n```python\n{{problem}}",
92+
" "
8393
)
8494
}
8595

@@ -134,7 +144,7 @@ def main(args):
134144
input_ids = input_ids,
135145
sampler = sampler,
136146
max_new_tokens = args.max_tokens,
137-
stop_conditions = [tokenizer.eos_token_id],
147+
stop_conditions = [tokenizer.eos_token_id, "```"],
138148
token_healing = True,
139149
identifier = (problem_id, s),
140150
min_new_tokens = 6

0 commit comments

Comments
 (0)