[UNK_BYTE_0xefbfbd]is[UNK_BYTE_0xefbfbd]

[RandomTurtle]

I download Falcon-40b-gguf from hf, load it into kobold but when I talk to it, it says "[UNK_BYTE_0xefbfbd]is[UNK_BYTE_0xefbfbd]" and spams this. I read that it needs tokenizer.model, but that doesn't exist on hf where Falcon was download from. So I found a different falcon 40b-instruct-8bit and they have a tokenizer.json so I assumed that's needed. So I put it in the same directory but it didn't help. Now when I say "Hi" it just locks up and sits there. How do I get it to work :)

[LostRuins]

I would strongly suggest against using that model as it is extremely old and largely abandoned. Instead, I'd recommend trying a modern model like this one:

https://huggingface.co/unsloth/gemma-3-12b-it-GGUF/resolve/main/gemma-3-12b-it-Q3_K_M.gguf

If you really want to use Falcon 40B, please try this model: https://huggingface.co/mradermacher/WizardLM-Uncensored-Falcon-40b-i1-GGUF/resolve/main/WizardLM-Uncensored-Falcon-40b.i1-Q2_K.gguf
Tested and it works.

[RandomTurtle]

Ah ok. I'm pretty clueless with all this AI stuff, struggling to get things working 🤣