Skip to content

Commit 7328d7d

Browse files
committed
add ckpt for outer schedler
1 parent 1e43b47 commit 7328d7d

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

open_diloco/train_fsdp.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -373,6 +373,7 @@ def outer_scheduler_fn(opt):
373373
model=model,
374374
optimizer=optimizer.inner_optimizer,
375375
scheduler=scheduler,
376+
outer_scheduler=optimizer.outer_scheduler,
376377
outer_optimizer=optimizer.state_averager.optimizer,
377378
scaler=scaler,
378379
data_loader=train_dataloader,

0 commit comments

Comments
 (0)