Skip to content

[Bug] 向medbench上传自测数据集失败 #2320

@qy1026

Description

@qy1026

Prerequisite

Type

I'm evaluating with the officially supported tasks/models/datasets.

Environment

Not applicable

Reproduces the problem - code/configuration sample

Not applicable

Reproduces the problem - command or script

在我提交自己的数据集失败后。我将medbench官方提供的自测数据集下载后,打包成MedBench_LLM.zip压缩包上传(将原始数据集上传),显示失败。看了提交文件指引:

MedBench大语言模型评测数据样例介绍

每条数据样例包含如下字段:

question: 问题
options: 选择题的选项,非选择题则为null
answer: 答案,默认为null
other: 数据编号和来源信息

发现官方提供的数据集中,所有文件并无option字段,但是指引中要求了option字段,是否是此处的差异导致上传失败的呢?

Reproduces the problem - error message

Not applicable

Other information

None

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions