Skip to content

Sync 4 layer norms - bf16, fp32, optimizer states on restart#274

Open
tjruwase wants to merge 40 commits intomainfrom
olruwase/sync_layer_norms
Open

Sync 4 layer norms - bf16, fp32, optimizer states on restart#274
tjruwase wants to merge 40 commits intomainfrom
olruwase/sync_layer_norms

Commits

Commits on Mar 23, 2022

Commits on Mar 24, 2022

Commits on Mar 26, 2022

Commits on Mar 28, 2022

Commits on Mar 29, 2022

Commits on Mar 30, 2022

Commits on Apr 6, 2022