Skip to content

Commit 0194cd3

Browse files
committed
fix deepseekv2 infra
1 parent cf497bb commit 0194cd3

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

paddlenlp/transformers/deepseek_v2/modeling.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1746,7 +1746,6 @@ def prepare_inputs_for_generation(
17461746
):
17471747
batch_size, seq_length = input_ids.shape
17481748
position_ids = kwargs.get("position_ids", paddle.arange(seq_length).expand((batch_size, seq_length)))
1749-
attention_mask = kwargs.get("attention_mask", None)
17501749
if past_key_values:
17511750
input_ids = input_ids[:, -1].unsqueeze(axis=-1)
17521751
position_ids = position_ids[:, -1].unsqueeze(-1)

0 commit comments

Comments
 (0)