Skip to content

Commit b5ebfdd

Browse files
phlrainphlrain
andauthored
fix unverlap bw split (#10928)
Co-authored-by: phlrain <[email protected]>
1 parent 542c1b5 commit b5ebfdd

File tree

1 file changed

+2
-5
lines changed

1 file changed

+2
-5
lines changed

paddlenlp/transformers/deepseek_v2/modeling_pp.py

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -721,11 +721,8 @@ def combine_backward(self, output_grad, previous_event=None, async_finish=False,
721721
ret = (inputs_embeds_mtp_grad, *ret) if self.send_mtp_embed else ret
722722
return ret
723723

724-
def mlp_backward_dw(self):
725-
if WeightGradStore.enabled:
726-
WeightGradStore.put(self.fp8_fusion_moe_node.mlp_node.backward_dw)
727-
else:
728-
self.fp8_fusion_moe_node.mlp_node.backward_dw()
724+
def mlp_backward_dw(self):
725+
self.fp8_fusion_moe_node.mlp_node.backward_dw()
729726

730727
def mlp_backward(self, output_grad):
731728
if self.send_mtp_embed:

0 commit comments

Comments
 (0)