DDP, MPIEnv and numdevices #19927
Unanswered
timocafe
asked this question in
DDP / multi-GPU / multi-node
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
I am confused by the API and the different scenario using the MPI plugin. Let's consider a single node 2 GPUs (XPU I am working for intel). I want to run on the two GPUs only.
Using DDP setting and basic training, if I do
python main.py
:The trainer will spawn 1 additional process and do parallel training.
Now if I plug
MPIEnvironment()
, and start my jobmpirun -n 2 python main.py
.Do I still need to specify
devices = 2
in the trainer ?Beta Was this translation helpful? Give feedback.
All reactions