Skip to content

Commit 6e3abeb

Browse files
committed
Exclude MTP layers in conversion
1 parent 43eb7a7 commit 6e3abeb

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3760,7 +3760,9 @@ def set_gguf_parameters(self):
37603760
self.gguf_writer.add_ssm_time_step_rank(self.find_hparam(["linear_num_value_heads"]))
37613761
self.gguf_writer.add_ssm_inner_size(self.find_hparam(["hidden_size"]) * (self.find_hparam(["linear_num_value_heads"]) // self.find_hparam(["linear_num_key_heads"])))
37623762

3763-
def modify_tensors(self, data_torch: Tensor, name: str, bid: int | None) -> Iterable[tuple[str, Tensor]]:
3763+
def modify_tensors(self, data_torch: Tensor, name: str, bid: int | None) -> Iterable[tuple[str, Tensor]]:
3764+
if name.startswith("mtp"):
3765+
return [] # ignore MTP layers for now
37643766
if name.endswith(".A_log"):
37653767
data_torch = -torch.exp(data_torch)
37663768
elif name.endswith(".dt_bias"):

0 commit comments

Comments
 (0)