Skip to content

Commit bc0a787

Browse files
committed
[fix]qwen2vl support fa3
1 parent d8e6280 commit bc0a787

File tree

1 file changed

+1
-0
lines changed
  • lightllm/models/qwen2_vl/triton_kernel

1 file changed

+1
-0
lines changed

lightllm/models/qwen2_vl/triton_kernel/mrope.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -100,6 +100,7 @@ def mrope_triton(q: torch.Tensor, k: torch.Tensor, cos: torch.Tensor, sin: torch
100100
k_out = torch.empty_like(k)
101101
qo_sb, qo_sh, qo_sl, qo_sd = map(int, q_out.stride())
102102
ko_sb, ko_sh, ko_sl, ko_sd = map(int, k_out.stride())
103+
103104
assert len(cos.shape) == 4
104105
token_dim = 2
105106
axis_dim = 0

0 commit comments

Comments
 (0)