Skip to content

Pull requests: allenai/olmo-eval

New pull request New
25 Open 206 Closed
25 Open 206 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Update setuptools requirement from <81 to <84 dependencies Pull requests that update a dependency file python Pull requests that update python code
#243 opened Jul 6, 2026 by dependabot Bot Loading…
Update openhands-ai requirement from ~=1.4.0 to >=1.4,<1.10 dependencies Pull requests that update a dependency file python Pull requests that update python code
#242 opened Jul 6, 2026 by dependabot Bot Loading…
Roryd/deepscholar bench s2patch
#240 opened Jul 2, 2026 by donovanr Contributor • Draft
1 of 14 tasks
Harness robustness for agentic evals (tool-error handling + parser detection)
#239 opened Jul 2, 2026 by yilunzhao Loading…
7
Add SAGE scientific paper-retrieval benchmark (short_form + open_ended)
#238 opened Jul 2, 2026 by yilunzhao Loading…
7
Use encrypted Modal sandbox tunnels
#237 opened Jul 1, 2026 by abhinav-bellapu Loading…
8 of 13 tasks
1
Fix vLLM harness provider kind precedence
#236 opened Jul 1, 2026 by abhinav-bellapu Loading…
6 of 13 tasks
1
Fix Hugging Face dataset paths and worker startup diagnostics
#235 opened Jun 30, 2026 by TianhuaTao • Draft
Update openai requirement from ~=2.21.0 to >=2.21,<2.45 dependencies Pull requests that update a dependency file python Pull requests that update python code
#234 opened Jun 29, 2026 by dependabot Bot Loading…
Update rich requirement from <15,>=13.7 to >=13.7,<16 dependencies Pull requests that update a dependency file python Pull requests that update python code
#231 opened Jun 24, 2026 by dependabot Bot Loading…
Update openai-agents requirement from ~=0.7.0 to >=0.7,<0.18 dependencies Pull requests that update a dependency file python Pull requests that update python code
#230 opened Jun 24, 2026 by dependabot Bot Loading…
Update click requirement from ~=8.3.2 to >=8.3.2,<8.5.0 dependencies Pull requests that update a dependency file python Pull requests that update python code
#229 opened Jun 24, 2026 by dependabot Bot Loading…
Bump ty from 0.0.39 to 0.0.56 in the dev-dependencies group across 1 directory dependencies Pull requests that update a dependency file python Pull requests that update python code
#228 opened Jun 24, 2026 by dependabot Bot Loading…
Bump the actions group across 1 directory with 3 updates dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#227 opened Jun 24, 2026 by dependabot Bot Loading…
Safety Suite Update
#208 opened Jun 12, 2026 by mgmorgan23 Contributor Loading…
7 of 13 tasks
11
Add general:posttrain:dev suite
#193 opened May 26, 2026 by finbarrtimbers Contributor Loading…
2 tasks done
2
Propagate suite-level CLI overrides to constituent task specs
#180 opened May 15, 2026 by finbarrtimbers Contributor Loading…
1 task
2
Report cumulative vLLM generation progress across batches
#179 opened May 15, 2026 by finbarrtimbers Contributor Loading…
1 task
Bake SciCode sandbox image once; pre-build from launch host
#159 opened Apr 27, 2026 by finbarrtimbers Contributor • Draft
3
Finbarr/prebuild sandbox
#158 opened Apr 27, 2026 by finbarrtimbers Contributor • Draft
13 tasks
how to use add a serialized task walkthru
#121 opened Apr 8, 2026 by IanMagnusson Contributor Loading…
3 tasks done
4
DNM: Tweaks to support MSWEA + swe-bench
#118 opened Apr 3, 2026 by undfined Collaborator • Draft
WIP: add swebench as external eval
#109 opened Apr 1, 2026 by aetting • Draft
1 of 13 tasks
2
[WIP] Hard reasoning
#102 opened Mar 25, 2026 by rlebras Contributor Loading…
13 tasks
4
adds simple smoke tests
#76 opened Feb 27, 2026 by warmbowski Contributor Loading…
3 of 13 tasks
3
ProTip! Follow long discussions with comments:>50.