Skip to content

Conversation

slaren
Copy link
Member

@slaren slaren commented Dec 17, 2024

Reverts #10864

Fixes #10875

Let's revert this until it can be fixed properly to stop gguf files with incorrect tokenizers being created and distributed.

@slaren slaren requested review from ggerganov and ngxson December 17, 2024 22:31
@github-actions github-actions bot added the python python script changes label Dec 17, 2024
@slaren slaren merged commit 4da69d1 into master Dec 18, 2024
53 checks passed
@slaren slaren deleted the revert-10864-falcon3_integration branch December 18, 2024 00:36
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Dec 20, 2024
tinglou pushed a commit to tinglou/llama.cpp that referenced this pull request Feb 13, 2025
mglambda pushed a commit to mglambda/llama.cpp that referenced this pull request Mar 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

python python script changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Eval bug: PR#10864 tokenization regression

2 participants