Skip to content

Commit c86f62c

Browse files
committed
Ensure MRoPE ID tensor is contiguous
1 parent 663eea1 commit c86f62c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

exllamav2/mrope.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ def gen_mrope_embed(
3636

3737
# Create 3D position IDs
3838

39-
ids = input_ids.squeeze(0)
39+
ids = input_ids.squeeze(0).contiguous()
4040
mrope_pos_ids = torch.zeros((3, max_length), dtype = torch.long).contiguous()
4141
merge_size = 1 if not embeddings else embeddings[0].model.config.vision_spatial_merge_size
4242
spans = []

0 commit comments

Comments
 (0)