Skip to content

Commit b3ad242

Browse files
author
wangzaijun
committed
fix position_ids
1 parent 7aafe2a commit b3ad242

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

lightllm/models/qwen2_vl/infer_struct.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,7 @@ def init_some_extra_state(self, model, input_ids: torch.Tensor):
3232
position_ids = self.position_ids + torch.tensor(b_position_delta, device=self.position_ids.device)
3333
self.position_ids = position_ids.unsqueeze(0).expand(3, -1)
3434

35+
self.position_ids = self.position_ids.contiguous()
3536
self.position_cos = model._cos_cached[self.position_ids] # (3, L, D)
3637
self.position_sin = model._sin_cached[self.position_ids] # (3, L, D)
3738
if get_env_start_args().enable_fa3:

0 commit comments

Comments
 (0)