Skip to content

Commit c965413

Browse files
committed
Fix TP regression
1 parent 232cc1d commit c965413

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

exllamav3/model/model_tp.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -353,7 +353,7 @@ def prepare_inputs_for_tp(self, x: torch.Tensor, params: dict) -> torch.Tensor:
353353
"cache_seqlens",
354354
"positions",
355355
"position_ids",
356-
"indexed_embeddings",
356+
# "indexed_embeddings",
357357
]:
358358
p = params.get(tensor_param)
359359
if p is not None:

exllamav3/model/model_tp_fn.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -191,7 +191,7 @@ def mp_model_forward(
191191
"cache_seqlens",
192192
"positions",
193193
"position_ids",
194-
"indexed_embeddings",
194+
# "indexed_embeddings",
195195
]:
196196
p = params.get(tensor_param)
197197
if p is not None:

0 commit comments

Comments
 (0)