Skip to content

v0.12.1

Latest

Choose a tag to compare

@NathanHB NathanHB released this 06 Nov 15:29
· 0 commits to main since this release

v0.12.1

Patch for quality of life updates !

Run all inference providers at the same time:

in #1039

- lighteval eval hf-inference-providers/openai/gpt-oss-20b:novita hf-inference-providers/openai/gpt-oss-20b:nebius hf-inference-providers/openai/gpt-oss-20b:fireworks-ai ... aime25
+ lighteval eval hf-inference-providers/openai/gpt-oss-20b:all aime25

Remove suites and make fewshots optional

in #1038

+ lighteval eval hf-inference-providers/openai/gpt-oss-20b aime25
- lighteval eval hf-inference-providers/openai/gpt-oss-20b "lighteval|aime25|0"

Bug fix:

Full Changelog: v0.12.0...v0.12.1