Skip to content

Commit 219eada

Browse files
DamonFoolCISC
andauthored
Update convert_hf_to_gguf.py
Co-authored-by: Sigbjørn Skjæret <[email protected]>
1 parent 33163bf commit 219eada

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6701,7 +6701,8 @@ def set_gguf_parameters(self):
67016701
self.gguf_writer.add_embedding_length(self.hparams["d_model"])
67026702
self.gguf_writer.add_feed_forward_length(self.hparams["d_ff"])
67036703
self.gguf_writer.add_block_count(self.hparams["num_layers"])
6704-
self.gguf_writer.add_num_decoder_layers(self.hparams["num_decoder_layers"])
6704+
if (n_dec_layer := self.hparams.get("num_decoder_layers")) is not None:
6705+
self.gguf_writer.add_decoder_block_count(n_dec_layer)
67056706
self.gguf_writer.add_head_count(self.hparams["num_heads"])
67066707
self.gguf_writer.add_key_length(self.hparams["d_kv"])
67076708
self.gguf_writer.add_value_length(self.hparams["d_kv"])

0 commit comments

Comments
 (0)