Avoid calling byte_pair_encode for existing tokens#252

hauntsaninja merged 1 commit intomainopenai/tiktoken:mainfrom

paplorinc-2openai/tiktoken:paplorinc-2Copy head branch name to clipboard