Add Falcon3 model support

[mokeddembillel]

Adding Falcon3 model support

[slaren]

@mokeddembillel heads up, this has been reverted because the change to convert_hf_to_gguf.py was creating gguf files with broken tokenizers. This will need to be fixed before it can be added again.

[mokeddembillel]

@slaren @ggerganov, Thanks for flagging this. working on fixing it right now.

[mokeddembillel]

@slaren @ggerganov Thanks again for flagging this issue.

The issue is that when using meta-llama/Llama-3.1-8B-Instruct the <|begin_of_text|> token is added to every special token when doing token = tokenizer.decode(tokenizer.encode(token))

the screenshot shows before and after token = tokenizer.decode(tokenizer.encode(token))

I'm fixing this by adding add_special_tokens=False to tokenizer.encode(). Here is the the result after the fix

to be extra safe, we will use token = tokenizer.decode(tokenizer.encode(token)) only if len(token) == 1 so that still fix this issue when \n is econded as Ċ

Generation before the fix:

Prompt: Once upon a time in a land far away,
there was a kingdom ruled by a wise and just king. The kingdom was known for its beauty and prosperity, and the people lived in peace and harmony.ĊĊOne day, a terrible drought struck the land, and the crops began to wither and die. The king, worried about the well-being of his people, called upon his wise council to find a solution. The council, after much deliberation, decided to send a group of brave knights to search for a magical spring that was said to have the power to bring rain to the kingdom.

Generation after the fix:

Prompt: Once upon a time in a land far away,
there was a kingdom ruled by a wise and just king. The kingdom was known for its beauty and prosperity, and the people lived in peace and harmony.

One day, a terrible drought struck the land, and the crops began to wither and die. The king, worried about the well-being of his people, called upon his wise council to find a solution. The council, after much deliberation, decided to send a group of brave knights to search for a magical spring that was said to have the power to bring rain to the kingdom.

Created new PR with the Fix #10883