Skip to content

Actions: huggingface/lighteval

Actions

PR Style Bot

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
pr_style_bot.yaml
118 workflow runs
118 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Comment out PR Style Bot workflow configuration PR Style Bot #68: Commit 6d1f147 pushed by paulinebm
Failure main
main
Failure
[BUG] concurrent_requests in litellm backend limited to 100 PR Style Bot #67: Issue comment #1100 (comment) created by yt0428
1s
1s
[BUG] concurrent_requests in litellm backend limited to 100 PR Style Bot #66: Issue comment #1100 (comment) created by NathanHB
2s
2s
fix(tasks): print also tasks not prefixed by the suite name PR Style Bot #65: Issue comment #1087 (comment) created by HuggingFaceDocBuilderDev
1s
1s
[BUG] Breaking change for Hellaswag/Piqa PR Style Bot #64: Issue comment #1090 (comment) created by slfg
1s
1s
feat: Add Kyrgyz LLM Bench multilingual tasks PR Style Bot #63: Issue comment #1070 (comment) created by golden-ratio
2s
2s
Enable loading data sets from files for custom tasks PR Style Bot #62: Issue comment #1083 (comment) created by davebiagioni
1s
1s
[BUG] Cannot run math_500/mmlu_pro on models without chat template PR Style Bot #61: Issue comment #1089 (comment) created by Giuseppe5
1s
1s
When customizing the save path, modify the "save_details" location PR Style Bot #60: Issue comment #1092 (comment) created by HuggingFaceDocBuilderDev
1s
1s
[FT] I am unable to use microsoft/Phi-4-multimodal-instruct PR Style Bot #59: Issue comment #1096 (comment) created by NathanHB
1s
1s
aime_avg was not added to TASKS_TABLE PR Style Bot #58: Issue comment #1098 (comment) created by HuggingFaceDocBuilderDev
1s
1s
[BUG] Cannot run math_500/mmlu_pro on models without chat template PR Style Bot #57: Issue comment #1089 (comment) created by NathanHB
1s
1s
diskcache for caching PR Style Bot #56: Issue comment #1068 (comment) created by NathanHB
1s
1s
Update available-tasks.mdx PR Style Bot #55: Issue comment #1088 (comment) created by HuggingFaceDocBuilderDev
1s
1s
[BUG] Cannot list tasks if the user doesn't install multilingual extras PR Style Bot #54: Issue comment #973 (comment) created by NathanHB
1s
1s
[FT] Support local datasets PR Style Bot #53: Issue comment #604 (comment) created by NathanHB
1s
1s
[FT] Add tests for nanotron PR Style Bot #52: Issue comment #765 (comment) created by NathanHB
1s
1s
[EVAL] Long Horizon Execution PR Style Bot #51: Issue comment #1074 (comment) created by NathanHB
1s
1s
[EVAL] Long Horizon Execution PR Style Bot #50: Issue comment #1074 (comment) created by akshathmangudi
1s
1s
[EVAL] Long Horizon Execution PR Style Bot #49: Issue comment #1074 (comment) created by HuggingFaceDocBuilderDev
1s
1s
[EVAL] Long Horizon Execution PR Style Bot #48: Issue comment #1074 (comment) created by NathanHB
1s
1s
[BUG] vLLM and Transformers scores are different for the same model and same task PR Style Bot #47: Issue comment #864 (comment) created by NathanHB
1s
1s
[BUG] vLLM and Transformers scores are different for the same model and same task PR Style Bot #46: Issue comment #864 (comment) created by NathanHB
1s
1s
[DOC] Fix Dev Dependencies Install Command PR Style Bot #45: Issue comment #1085 (comment) created by HuggingFaceDocBuilderDev
36s
36s
[EVAL] Big-Bench Extra Hard (BBEH) PR Style Bot #44: Issue comment #600 (comment) created by NathanHB
15s
15s