Skip to content

Commit e403abe

Browse files
committed
Enhance majority voting plugin and update eval config
Upgrades the majority voting plugin with category-aware answer extraction, adaptive temperature control, improved normalization, response quality filtering, and smart fallback strategies. Updates the default test-time compute configuration in eval_optillmbench.py to use 5 candidates instead of 8 for fairer comparison and memory efficiency, and revises related reporting logic and documentation.
1 parent a2cd56c commit e403abe

File tree

2 files changed

+335
-206
lines changed

2 files changed

+335
-206
lines changed

0 commit comments

Comments
 (0)