Add special token to llama 2

[generalsvr]

Hello! How can I add a new token to the model? I need a special separator token to interrupt streaming response. Can I just simply add a new token to special_tokens config? Like this:

special_tokens:
  bos_token: "<s>"
  eos_token: "</s>"
  unk_token: "<unk>"
  my_token: "<end>"

[NanoCode012]

No, in this case, you would need to use the

tokens:
  - "<end>"