Commit 1f2c4d9
Graham Wheeler
Add comprehensive tokenizer unit tests
Added 27 new tests (86 -> 113 total) covering:
- Template strings (t-strings) for Python 3.14+
- Raw template strings (rt/tr prefixes)
- Multiline template strings
- Matrix multiply operator (@)
- Matrix multiply assignment operator (@=)
- All 39 Python keywords
- Soft keywords as identifiers
- Unicode identifiers (Greek, Japanese, Chinese)
- Complex number literals
- Numbers with leading zeros
- All escape sequences in strings
- Line continuation in expressions
- Mixed tabs/spaces indentation
- Empty f-strings and template strings
- Deeply nested f-strings
- F-strings with colons in expressions
- Very long identifiers, strings, and numbers
- Named Unicode escapes
- Multiple operators without spaces
- Chained comparison operators
- All bitwise operators
- All assignment operators
Part of: pyright-rzw (Parser Component Test Coverage)1 parent c930453 commit 1f2c4d9
File tree
6 files changed
+716
-2238
lines changed- .beads
- packages/pyright-internal
- src/tests
6 files changed
+716
-2238
lines changedLarge diffs are not rendered by default.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
0 commit comments