Skip to content

Commit 639857f

Browse files
authored
fix bug when ep_degree == sharding_degree (#74268)
1 parent 7ec9073 commit 639857f

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

python/paddle/distributed/fleet/utils/tensor_fusion_helper.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -807,6 +807,7 @@ def _comm_grads(self):
807807
def scale_grads(self):
808808
if self.need_reduce_scale_sync():
809809
if self._comm_group.nranks == 1 and self._task is None:
810+
self._reset_params_checked_in()
810811
return
811812
assert self._task is not None, "Task is not initialized."
812813
self._task.wait()

0 commit comments

Comments
 (0)