Skip to content

Commit 792a4fc

Browse files
Fix the accuracy issues caused by the mrope operator
Signed-off-by: zhihaofang1017 <[email protected]>
1 parent 9dc23b6 commit 792a4fc

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/ops/rotary_embedding.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -288,7 +288,7 @@ def mrope_forward(
288288
import torch_npu
289289
mrope_section = [0, 0, 0] if positions.ndim == 1 else self.mrope_section
290290

291-
query, key = torch_npu.npu_mrope(positions,
291+
query, key = torch_npu.npu_mrope(positions.contiguous(),
292292
query.contiguous(),
293293
key.contiguous(),
294294
self.cos_sin_cache.contiguous(),

0 commit comments

Comments
 (0)