Typehinting a tokenizer

[decorator-factory]

Just wanted to share a trick I found to improve editor support for a tokenizer.

If instead of a dict you pass in a sequence of tuples to define a tokenizer, the keys (token names) are treated as Literals if they are string or integer literals:

With this definition, token types are displayed and even narrowed: