Skip to content

Commit e58d585

Browse files
authored
model : add Granite Hybrid nano types (ggml-org#16896)
Signed-off-by: Giuseppe Scrivano <[email protected]>
1 parent 31c511a commit e58d585

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

src/llama-model.cpp

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1898,7 +1898,8 @@ void llama_model::load_hparams(llama_model_loader & ml) {
18981898
ml.get_key(LLM_KV_ATTENTION_LAYERNORM_RMS_EPS, hparams.f_norm_rms_eps);
18991899

19001900
switch (hparams.n_embd) {
1901-
case 1536: type = LLM_TYPE_7B_A1B; break;
1901+
case 768: type = LLM_TYPE_350M; break;
1902+
case 1536: type = (hparams.n_embd == 2048 ? LLM_TYPE_7B_A1B : LLM_TYPE_1B); break;
19021903
case 2048: case 2560: type = LLM_TYPE_3B; break;
19031904
case 4096: type = LLM_TYPE_32B; break;
19041905
default: type = LLM_TYPE_UNKNOWN;

0 commit comments

Comments
 (0)