Skip to content

[LLM] Add MATH (competition mathematics) environment #3544

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
vmoens wants to merge 1 commit into
base: gh/vmoens/236/base
Choose a base branch
from

Update

9320fdd
Select commit
Loading
Failed to load commit list.
Open

[LLM] Add MATH (competition mathematics) environment #3544

Update
9320fdd
Select commit
Loading
Failed to load commit list.
PyTorch Bot / Dr.CI completed Mar 5, 2026 in 0s

Dr.CI classification results

{"FAILED":[{"workflowId":22714823114,"workflowUniqueId":37755465,"id":65861729248,"runnerName":"i-022917bd9ec122fdb","authorEmail":"vincentmoens@gmail.com","name":"Generate documentation / build-docs (3.12, 12.8) / linux-job","jobName":"build-docs (3.12, 12.8) / linux-job","conclusion":"failure","completed_at":"2026-03-05T11:16:05.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714823114/job/65861729248","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861729248","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":["RuntimeError: Command docker exec -t 25c5a632231f8fed43efb9def32dc44cd6b6297ff3dff1cc8d01d9aa57b5bb42 /exec failed with exit code 2"],"failure_lines":["RuntimeError: Command docker exec -t 25c5a632231f8fed43efb9def32dc44cd6b6297ff3dff1cc8d01d9aa57b5bb42 /exec failed with exit code 2"],"failure_context":[],"time":"2026-03-05T11:01:24.000000000Z"},{"workflowId":22714822966,"workflowUniqueId":61790681,"id":65861728460,"runnerName":"i-02cdade296d67e17d","authorEmail":"vincentmoens@gmail.com","name":"Continuous Benchmark (PR) / CPU Pytest benchmark","jobName":"CPU Pytest benchmark","conclusion":"failure","completed_at":"2026-03-05T11:07:50.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714822966/job/65861728460","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861728460","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":[""],"failure_lines":["##[error]"],"failure_context":[],"time":"2026-03-05T11:01:23.000000000Z"},{"workflowId":22714822966,"workflowUniqueId":61790681,"id":65861728462,"runnerName":"i-0ec8afa8fe2ceea76","authorEmail":"vincentmoens@gmail.com","name":"Continuous Benchmark (PR) / GPU Pytest benchmark","jobName":"GPU Pytest benchmark","conclusion":"cancelled","completed_at":"2026-03-05T11:08:28.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714822966/job/65861728462","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861728462","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":[],"failure_lines":[],"failure_context":[],"time":"2026-03-05T11:01:23.000000000Z"},{"workflowId":22714829813,"workflowUniqueId":226307469,"id":65861752358,"runnerName":"GitHub Actions 1011029701","authorEmail":"vincentmoens@gmail.com","name":"PR Label / add-label","jobName":"add-label","conclusion":"failure","completed_at":"2026-03-05T11:01:49.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714829813/job/65861752358","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861752358","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":["Process completed with exit code 1."],"failure_lines":["##[error]Process completed with exit code 1."],"failure_context":[],"time":"2026-03-05T11:01:35.000000000Z"}],"FLAKY":[],"BROKEN_TRUNK":[{"workflowId":22714823130,"workflowUniqueId":82165822,"id":65861729424,"runnerName":"i-0eccbb34b538ef2a8","authorEmail":"vincentmoens@gmail.com","name":"Unit-tests on Linux / tests-cpu (3.10) / linux-job","jobName":"tests-cpu (3.10) / linux-job","conclusion":"failure","completed_at":"2026-03-05T11:58:27.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714823130/job/65861729424","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861729424","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":["test/test_rb.py::TestStorages::test__rand_given_ndim_recompile"],"failure_lines":["FAILED test/test_rb.py::TestStorages::test__rand_given_ndim_recompile - RuntimeError: Cannot sample from an empty storage."],"failure_context":[],"time":"2026-03-05T11:01:24.000000000Z"},{"workflowId":22714823130,"workflowUniqueId":82165822,"id":65861729405,"runnerName":"i-083788fc485cd348f","authorEmail":"vincentmoens@gmail.com","name":"Unit-tests on Linux / tests-cpu (3.11) / linux-job","jobName":"tests-cpu (3.11) / linux-job","conclusion":"failure","completed_at":"2026-03-05T11:57:18.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714823130/job/65861729405","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861729405","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":["test/test_rb.py::TestStorages::test__rand_given_ndim_recompile"],"failure_lines":["FAILED test/test_rb.py::TestStorages::test__rand_given_ndim_recompile - RuntimeError: Cannot sample from an empty storage."],"failure_context":[],"time":"2026-03-05T11:01:24.000000000Z"},{"workflowId":22714823130,"workflowUniqueId":82165822,"id":65861729455,"runnerName":"i-08b8168e295669d95","authorEmail":"vincentmoens@gmail.com","name":"Unit-tests on Linux / tests-cpu (3.12) / linux-job","jobName":"tests-cpu (3.12) / linux-job","conclusion":"failure","completed_at":"2026-03-05T11:59:49.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714823130/job/65861729455","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861729455","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":["test/test_rb.py::TestStorages::test__rand_given_ndim_recompile"],"failure_lines":["FAILED test/test_rb.py::TestStorages::test__rand_given_ndim_recompile - RuntimeError: Cannot sample from an empty storage."],"failure_context":[],"time":"2026-03-05T11:01:24.000000000Z"},{"workflowId":22714823130,"workflowUniqueId":82165822,"id":65861729421,"runnerName":"i-088cf0669285950a3","authorEmail":"vincentmoens@gmail.com","name":"Unit-tests on Linux / tests-cpu (3.13) / linux-job","jobName":"tests-cpu (3.13) / linux-job","conclusion":"failure","completed_at":"2026-03-05T11:55:48.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714823130/job/65861729421","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861729421","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":["test/test_rb.py::TestStorages::test__rand_given_ndim_recompile"],"failure_lines":["FAILED test/test_rb.py::TestStorages::test__rand_given_ndim_recompile - RuntimeError: Cannot sample from an empty storage."],"failure_context":[],"time":"2026-03-05T11:01:24.000000000Z"},{"workflowId":22714823130,"workflowUniqueId":82165822,"id":65861729432,"runnerName":"i-0a82db517b99f87e1","authorEmail":"vincentmoens@gmail.com","name":"Unit-tests on Linux / tests-olddeps (3.10, 11.8) / linux-job","jobName":"tests-olddeps (3.10, 11.8) / linux-job","conclusion":"failure","completed_at":"2026-03-05T12:07:06.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714823130/job/65861729432","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861729432","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":["test/test_loggers.py::TestCSVLogger::test_log_video[mp4-steps1]"],"failure_lines":["FAILED test/test_loggers.py::TestCSVLogger::test_log_video[mp4-steps1] - TypeError: an integer is required"],"failure_context":[],"time":"2026-03-05T11:01:24.000000000Z"},{"workflowId":22714823130,"workflowUniqueId":82165822,"id":65861729352,"runnerName":"i-0e4f327a0b31466c0","authorEmail":"vincentmoens@gmail.com","name":"Unit-tests on Linux / tests-optdeps (3.12, 13.0) / linux-job","jobName":"tests-optdeps (3.12, 13.0) / linux-job","conclusion":"failure","completed_at":"2026-03-05T12:06:02.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/22714823130/job/65861729352","logUrl":"https://ossci-raw-job-status.s3.amazonaws.com/log/pytorch/rl/65861729352","head_branch":"gh/vmoens/236/head","pr_number":3544,"head_sha":"9320fdd7a2e7e66ca2515e3cca680816596feec5","head_sha_timestamp":"2026-03-05T11:01:18.000000000Z","failure_captures":["test/test_rb.py::TestStorages::test__rand_given_ndim_recompile"],"failure_lines":["FAILED test/test_rb.py::TestStorages::test__rand_given_ndim_recompile - RuntimeError: Cannot sample from an empty storage."],"failure_context":[],"time":"2026-03-05T11:01:24.000000000Z"}],"UNSTABLE":[],"AWAITING_APPROVAL":[]}

View more details on PyTorch Bot