Skip to content

Actions: huggingface/lighteval

Actions

PR Style Bot

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
pr_style_bot.yaml
113 workflow runs
113 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

[BUG] TriviaQA numbers are off PR Style Bot #113: Issue comment #893 (comment) created by haochengxi
1s
1s
Enable loading data sets from files for custom tasks PR Style Bot #112: Issue comment #1083 (comment) created by Kwen-Chen
2s
2s
[FT] Support for retriever-augmented and latent-memory models. PR Style Bot #111: Issue comment #1109 (comment) created by akshathmangudi
1s
1s
[EVAL] MultiChallenge PR Style Bot #110: Issue comment #1075 (comment) created by akshathmangudi
1s
1s
[EVAL] SciCode PR Style Bot #109: Issue comment #1086 (comment) created by akshathmangudi
1s
1s
Enable loading data sets from files for custom tasks PR Style Bot #108: Issue comment #1083 (comment) created by NathanHB
2s
2s
fix(tasks): print also tasks not prefixed by the suite name PR Style Bot #107: Issue comment #1087 (comment) created by NathanHB
2s
2s
fix(tasks): print also tasks not prefixed by the suite name PR Style Bot #106: Issue comment #1087 (comment) created by NathanHB
1s
1s
[FT] Support for retriever-augmented and latent-memory models. PR Style Bot #105: Issue comment #1109 (comment) created by NathanHB
1s
1s
[EVAL] SciCode PR Style Bot #104: Issue comment #1086 (comment) created by NathanHB
1s
1s
[EVAL] MultiChallenge PR Style Bot #103: Issue comment #1075 (comment) created by NathanHB
1s
1s
[BUG] OSError: [Errno 22] Invalid argument PR Style Bot #102: Issue comment #632 (comment) created by NathanHB
1s
1s
[BUG] Accelerate backend with dp fails to load cache PR Style Bot #101: Issue comment #1102 (comment) created by NathanHB
1s
1s
[BUG] Get low performance when evaluate Qwen3-8B on MMLU-Redux using the thinking mode. PR Style Bot #100: Issue comment #1094 (comment) created by NathanHB
1s
1s
Feature/tvd mi metric PR Style Bot #99: Issue comment #1080 (comment) created by NathanHB
1s
1s
[FT] Log-likelihood metrics support for API-based evaluation (LiteLLM / completions endpoint) PR Style Bot #98: Issue comment #1093 (comment) created by NathanHB
2s
2s
[FT] Upgrade the VLLM dependency to 0.10.2+ PR Style Bot #97: Issue comment #1002 (comment) created by RobHessQ
1s
1s
fix(tasks): print also tasks not prefixed by the suite name PR Style Bot #96: Issue comment #1087 (comment) created by bram-pramono
2s
2s
[FT] Support for retriever-augmented and latent-memory models. PR Style Bot #95: Issue comment #1109 (comment) created by akshathmangudi
1s
1s
[FT] Log-likelihood metrics support for API-based evaluation (LiteLLM / completions endpoint) PR Style Bot #94: Issue comment #1093 (comment) created by kryvokhyzha
1s
1s
Update comment bot secrets in workflow (#1107) PR Style Bot #93: Commit 7fba130 pushed by paulinebm
Failure main
main
Failure
Update comment bot secrets in workflow PR Style Bot #92: Commit 7c67d24 pushed by paulinebm
Failure paulinebm-patch-2
paulinebm-patch-2
Failure
[EVAL] SciCode PR Style Bot #91: Pull request #1086 by akshathmangudi
Failure akshathmangudi:akshath/issue-740
akshathmangudi:akshath/issue-740
Failure
[EVAL] SciCode PR Style Bot #90: Pull request #1086 by akshathmangudi
Failure akshathmangudi:akshath/issue-740
akshathmangudi:akshath/issue-740
Failure
[EVAL] SciCode PR Style Bot #89: Pull request #1086 by akshathmangudi
Failure akshathmangudi:akshath/issue-740
akshathmangudi:akshath/issue-740
Failure