How to use configure_sharded_model function #13234

Unanswered

ankitpatnala asked this question in Lightning Trainer API: Trainer, LightningModule, LightningDataModule

ankitpatnala
Jun 5, 2022

https://github.com/PyTorchLightning/pytorch-lightning/blob/83436ee3dfd0d4079e0f8e704ba76aca672af19d/tests/strategies/test_ddp_fully_sharded_with_full_state_dict.py#L56-L64

Sorry for asking a lame question but I don't understand this function
why i%2 == 0 is wrapped at first go and second all are re-wrapped again ?

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment