Store tokens in u32 instead of usize#251

hauntsaninja merged 1 commit intomainopenai/tiktoken:mainfrom

paplorinc-1openai/tiktoken:paplorinc-1Copy head branch name to clipboard