ddp: how to combine multi-gpus outputs like "training_step_end" which is only used in dp/ddp2? #11265
Answered
by
rohitgr7
jiyt17
asked this question in
Lightning Trainer API: Trainer, LightningModule, LightningDataModule
-
My question is like title. Thank you! |
Beta Was this translation helpful? Give feedback.
Answered by
rohitgr7
Dec 27, 2021
Replies: 1 comment 4 replies
-
checkout the example here: https://pytorch-lightning.readthedocs.io/en/latest/common/lightning_module.html#training-with-dataparallel |
Beta Was this translation helpful? Give feedback.
4 replies
Answer selected by
rohitgr7
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
checkout the example here: https://pytorch-lightning.readthedocs.io/en/latest/common/lightning_module.html#training-with-dataparallel