Skip to content

Commit ecc4b45

Browse files
committed
add sp token
1 parent 764b856 commit ecc4b45

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/llama-vocab.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1969,6 +1969,7 @@ void llama_vocab::impl::load(llama_model_loader & ml, const LLM_KV & kv) {
19691969
|| t.first == "<end_of_turn>"
19701970
|| t.first == "<|endoftext|>"
19711971
|| t.first == "<|eom_id|>"
1972+
|| t.first == "<|observation|>"
19721973
|| t.first == "<EOT>"
19731974
|| t.first == "_<EOT>"
19741975
) {

0 commit comments

Comments
 (0)