Skip to content

Add Deepspeed Zero 3 MiCS support#20461

Open
hehepig4 wants to merge 18 commits intoLightning-AI:masterfrom
hehepig4:deepspeed_mics_init
Open

Add Deepspeed Zero 3 MiCS support#20461
hehepig4 wants to merge 18 commits intoLightning-AI:masterfrom
hehepig4:deepspeed_mics_init

Commits

Commits on Dec 3, 2024

Commits on Dec 4, 2024

Commits on Dec 9, 2024

Commits on Dec 10, 2024

Commits on Dec 11, 2024

Commits on Dec 19, 2024

Commits on Dec 27, 2024

Commits on Apr 16, 2025

Commits on Aug 8, 2025

Commits on Sep 10, 2025