Skip to content

Commit 97dabf8

Browse files
committed
misc: add docstring of MultiModelDDPStrategy
1 parent 4b22284 commit 97dabf8

File tree

1 file changed

+5
-0
lines changed
  • src/lightning/pytorch/strategies

1 file changed

+5
-0
lines changed

src/lightning/pytorch/strategies/ddp.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -420,6 +420,11 @@ def teardown(self) -> None:
420420

421421

422422
class MultiModelDDPStrategy(DDPStrategy):
423+
"""Specific strategy for training on multiple models with multiple optimizers (e.g. GAN training).
424+
425+
This strategy allows to wrap multiple models with DDP, rather than just one which is about just normal DDPStrategy.
426+
"""
427+
423428
@override
424429
def _setup_model(self, model: Module) -> DistributedDataParallel:
425430
device_ids = self.determine_ddp_device_ids()

0 commit comments

Comments
 (0)