[Feature] PPOTrainer

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3117

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 13 New Failures, 1 Cancelled Job, 5 Unrelated Failures

As of commit 8945d02 with merge base 0e4dabe ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  Process completed with exit code 2.
• Generate documentation / build-docs (3.9, 12.8) / linux-job (gh)
  RuntimeError: Command docker exec -t 6c2c2a970ddfc89bc7492a31ff10024d82c3ec8ce1b9af4985a2a824825305f5 /exec failed with exit code 2
• Habitat Tests on Linux / tests (3.9, 12.8) / linux-job (gh)
  RuntimeError: Command docker exec -t 2e8cf14e36d5f3b34f5a50b316161f4ca5469aa83ea1e39b774ecf1144bf0d35 /exec failed with exit code 1
• Lint / python-source-and-configs / linux-job (gh)
  RuntimeError: Command docker exec -t 151ba4487f45399ccb559b57231d3cec0155d72e44add859009256bb04166657 /exec failed with exit code 1
• SOTA Tests on Linux / tests (3.9, 12.8) / linux-job (gh)
  RuntimeError: Command docker exec -t 6d48a618529815b7da828c1f2f4d29aad574f58608c630f21261fa8402d10cb3 /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh)
  RuntimeError: Command docker exec -t 0c741472f8ac9257727b94b2bf01e01c5cb1c8bc41152518a2c4359f9935f36d /exec failed with exit code 2
• Unit-tests on Linux / tests-gpu (3.11, 12.8) / linux-job (gh)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Linux / tests-optdeps (3.11, 12.8) / linux-job (gh)
  RuntimeError: Command docker exec -t 7587139897d4dadc33125bcaf95e3d445c05cb6cd0f5cc3dd8fa01ba598b3d96 /exec failed with exit code 2
• Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh)
  test/test_transforms.py::TestMultiAction::test_parallel_trans_env_check[True]
• Unit-tests on Windows / unittests-cpu (3.10, windows.4xlarge, cpu) / windows-job (gh)
  Process completed with exit code 2.

CANCELLED JOB - The following job was cancelled. Please retry:

• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  ##[error]The operation was canceled.

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Continuous Benchmark / CPU Pytest benchmark (gh) (trunk failure)
  Process completed with exit code 2.
• Continuous Benchmark / GPU Pytest benchmark (gh) (trunk failure)
• Libs Tests on Linux / unittests-gym (3.9, 12.8) / linux-job (gh) (trunk failure)
  AttributeError: module 'torch.utils._pytree' has no attribute 'register_pytree_node'
• LLM Tests on Linux / unittests (3.9, 12.8) / linux-job (gh) (trunk failure)
  ##[error]The operation was canceled.
• Unit-tests on Linux / tests-olddeps (3.9, 11.6) / linux-job (gh) (trunk failure)
  AttributeError: module 'torch.utils._pytree' has no attribute 'register_pytree_node'

This comment was automatically generated by Dr. CI and updates every 15 minutes.