Commit f1f249e
[Feature] AsyncBatchedCollector: coordinator loop and direct submission mode
Rewrite the AsyncBatchedCollector to use a coordinator thread that
pipelines env stepping and batched inference without a global sync
barrier. Add a `direct=True` mode where each env thread submits
directly to the InferenceServer, eliminating the coordinator thread
and its serialization overhead.
Benchmark results (8 mock pixel envs, Nature-CNN, CPU):
AsyncBatchedCollector direct: 3183 fps (+72% vs coordinator)
AsyncBatchedCollector threading: 1850 fps (coordinator mode)
AsyncBatchedCollector mp: 1042 fps (coordinator mode)
Co-authored-by: Cursor <cursoragent@cursor.com>
ghstack-source-id: c4d370a
Pull-Request: #34991 parent 6e415a5 commit f1f249e
File tree
3 files changed
+714
-150
lines changed- benchmarks
- torchrl/collectors
3 files changed
+714
-150
lines changed
0 commit comments