Skip to content

Commit 03572ec

Browse files
authored
Fix FSDP destroy process group (#749)
1 parent 7bb9f52 commit 03572ec

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

3.test_cases/pytorch/FSDP/src/train.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -275,7 +275,9 @@ def main(args):
275275
world_size,
276276
total_steps,
277277
start_batch_index)
278+
279+
dist.destroy_process_group()
278280

279281
if __name__ == "__main__":
280282
args, _ = parse_args()
281-
main(args)
283+
main(args)

0 commit comments

Comments
 (0)