Skip to content

Commit 4610ee2

Browse files
Update src/llama-vocab.cpp
Co-authored-by: Georgi Gerganov <[email protected]>
1 parent f8d7c97 commit 4610ee2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/llama-vocab.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1523,7 +1523,7 @@ void llama_vocab::impl::load(llama_model_loader & ml, const LLM_KV & kv) {
15231523
tokenizer_pre == "llama-v3" ||
15241524
tokenizer_pre == "llama-bpe"||
15251525
tokenizer_pre == "falcon3" ||
1526-
tokenizer_pre == "falcon_h1" ||
1526+
tokenizer_pre == "falcon-h1" ||
15271527
tokenizer_pre == "pixtral") {
15281528
pre_type = LLAMA_VOCAB_PRE_TYPE_LLAMA3;
15291529
ignore_merges = true;

0 commit comments

Comments
 (0)