Experiential Result Evaluation

[Yancy456]

While the ground truth answers of MMMU are no public known, how do you evaluate your hallucination detection results on that dataset?

[Ruiyang-061X]

Thank for your valuable question!

We utilize the validation set of MMMU on huggingface and its ground truth is available.

Link: https://huggingface.co/datasets/MMMU/MMMU