v0.12.1
Patch for quality of life updates !
Run all inference providers at the same time:
in #1039
- lighteval eval hf-inference-providers/openai/gpt-oss-20b:novita hf-inference-providers/openai/gpt-oss-20b:nebius hf-inference-providers/openai/gpt-oss-20b:fireworks-ai ... aime25
+ lighteval eval hf-inference-providers/openai/gpt-oss-20b:all aime25Remove suites and make fewshots optional
in #1038
+ lighteval eval hf-inference-providers/openai/gpt-oss-20b aime25
- lighteval eval hf-inference-providers/openai/gpt-oss-20b "lighteval|aime25|0"Bug fix:
Full Changelog: v0.12.0...v0.12.1