Skip to content

Commit d7efed8

Browse files
authored
fix experts merging
1 parent e0a0024 commit d7efed8

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2725,7 +2725,7 @@ def set_gguf_parameters(self):
27252725

27262726
def modify_tensors(self, data_torch: Tensor, name: str, bid: int | None) -> Iterable[tuple[str, Tensor]]:
27272727
# process the experts separately
2728-
if name.find(".moe.") != -1 or name.find(".block_sparse_moe.") != -1:
2728+
if name.find(".moe.") != -1 or name.find(".block_sparse_moe.experts.") != -1:
27292729
n_experts = self.hparams["num_local_experts"]
27302730

27312731
assert bid is not None

0 commit comments

Comments
 (0)