tokenizer: account for multi-byte characters in `tokenize_with_range`#39

jmhain merged 1 commit intomainsigmacomputing/sqlparser-rs:mainfrom

joey/utf8sigmacomputing/sqlparser-rs:joey/utf8Copy head branch name to clipboard