Skip to content

Multi-Process/Multi-Controller setup #638

@voldyman

Description

@voldyman

Jax has the ability to run in multi-controller mode: https://docs.jax.dev/en/latest/multi_process.html does brax support it?
I am scheduling training using torchx where one process is assigned a single gpu and processes need to coordinate work, is there any guide for how to use brax in this setup?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions