Skip to content

Commit 0701efe

Browse files
committed
feat: Auto-fill hparams.recurrent_layer_arr based on whether the model is recurrent
Branch: GraniteFour Signed-off-by: Gabe Goodhart <[email protected]>
1 parent e9660ac commit 0701efe

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

src/llama-model.cpp

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -466,6 +466,10 @@ void llama_model::load_hparams(llama_model_loader & ml) {
466466
std::fill(hparams.n_head_arr.begin(), hparams.n_head_arr.end(), 0);
467467
std::fill(hparams.n_head_kv_arr.begin(), hparams.n_head_kv_arr.end(), 0);
468468
std::fill(hparams.n_ff_arr.begin(), hparams.n_ff_arr.end(), 0);
469+
std::fill(
470+
hparams.recurrent_layer_arr.begin(),
471+
hparams.recurrent_layer_arr.end(),
472+
llm_arch_is_recurrent(ml.get_arch()));
469473

470474
std::fill(hparams.rope_sections.begin(), hparams.rope_sections.end(), 0);
471475

0 commit comments

Comments
 (0)