Skip to content

Commit 1c43445

Browse files
skyloeviljingyu
authored andcommitted
Remove redundant row_indices unsqueeze operation in MiniCPMO (vllm-project#22528)
Signed-off-by: zitian.zhao <[email protected]> Signed-off-by: jingyu <[email protected]>
1 parent 574e0b9 commit 1c43445

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

vllm/model_executor/models/minicpmo.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -605,7 +605,6 @@ def subsequent_chunk_mask(
605605
max=size)
606606
# Create column indices for broadcasting
607607
col_indices = torch.arange(size, device=device).unsqueeze(0)
608-
row_indices = row_indices.unsqueeze(1)
609608
start_indices = start_indices.unsqueeze(1)
610609
end_indices = end_indices.unsqueeze(1)
611610
# Vectorized mask creation

0 commit comments

Comments
 (0)