Skip to content

Conversation

@CISC
Copy link
Collaborator

@CISC CISC commented Mar 19, 2025

Useful for f.ex. mistralai/Mistral-Small-3.1-24B-Instruct-2503 that has no chat template in tokenizer_config.json.

@github-actions github-actions bot added the python python script changes label Mar 19, 2025
@CISC CISC requested a review from compilade March 19, 2025 04:35
@ngxson
Copy link
Collaborator

ngxson commented Mar 19, 2025

Ok this is a bit surprise, I heard from my coworker at HF said that chat_template.json is used by Processor class, and it is a bit confusing indeed.

@ngxson ngxson merged commit a686171 into ggml-org:master Mar 19, 2025
4 checks passed
@CISC CISC deleted the convert-chat-template-json branch March 19, 2025 08:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

python python script changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants