Skip to content

Conversation

daminho
Copy link
Contributor

@daminho daminho commented Sep 7, 2024

Add Phi-2/Phi-1.5 Tokenizer in get_vocab_base_pre
ref: https://huggingface.co/microsoft/phi-2
image

@github-actions github-actions bot added the python python script changes label Sep 7, 2024
@daminho daminho closed this Sep 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

python python script changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant