Skip to content

Commit 3488a35

Browse files
committed
update bcb hard format
1 parent 9c8ac7a commit 3488a35

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

analysis/bcb_hard.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -124,7 +124,7 @@ def read_task_perf(top_tid, task="complete"):
124124
se_scores = [top_id[_id][1] for _id in hard_bcb_tid]
125125

126126
hard_bcb_dict = {
127-
"task_id": [f"BigCodeBenchHard/{i}" for i in range(len(hard_bcb))],
127+
"task_id": hard_bcb_tid,
128128
"complete_prompt": hard_bcb["complete_prompt"],
129129
"instruct_prompt": hard_bcb["instruct_prompt"],
130130
"canonical_solution": hard_bcb["canonical_solution"],

0 commit comments

Comments
 (0)