Skip to content

Escaping "</think>" and other sensitive tokens from the input? #15156

Answered by CISC
l29ah asked this question in Q&A
Discussion options

You must be logged in to vote

You would have to tokenize it in two or more parts and use those tokens, as parse_special or not, the </think> token is the shortest possible token representation.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by l29ah
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants