huggingface openLLM 跑分和 opencompass 的跑分不一致的原因是什么? #349
amulil
started this conversation in
View all discussions
Replies: 1 comment
-
|
Hi, the difference may be due to different prompts. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
比如:
meta-llama/llama2-7b-chat-hf 的 mmlu 跑分
opencompass 结果是 46.2
huggingface openLLM 结果是 48.32
一样的模型,一样的数据集,造成这种差距的原因是什么
Beta Was this translation helpful? Give feedback.
All reactions