Skip to content

Commit c5fcb60

Browse files
Fix the accuracy issues caused by the mrope operator
1 parent 9dc23b6 commit c5fcb60

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/ops/rotary_embedding.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -288,7 +288,7 @@ def mrope_forward(
288288
import torch_npu
289289
mrope_section = [0, 0, 0] if positions.ndim == 1 else self.mrope_section
290290

291-
query, key = torch_npu.npu_mrope(positions,
291+
query, key = torch_npu.npu_mrope(positions.contiguous(),
292292
query.contiguous(),
293293
key.contiguous(),
294294
self.cos_sin_cache.contiguous(),

0 commit comments

Comments
 (0)