Commit 4894f2a
committed
mktables: Handle Unicode 16.0 new \d ranges
mktables does a lot of sanity checks on the data it gets fed. One of
those is to make sure any \d group of code points is 10 long. This
verifies that Unicode has given us enough code points to form 0-9. It
assumes that if it got this much right, that their numeric values are
also 0-9. This check has uncovered issues with the Unicode Standard in
the past.
Nowadays, they've cleaned up their act, and it's been many releases
since there has been problems. But our checks remain, and I think they
should.
What happens in Unicode 16.0 was there was a range of \d characters that
contain two consecutive groups of 0-9 values. The check could be
changed to verify that the count is divisible by 10, but checking for
this particular range is a bit safer.1 parent 688f6ba commit 4894f2a
File tree
6 files changed
+9
-5
lines changed- lib/unicore
6 files changed
+9
-5
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
436055 | 436055 | | |
436056 | 436056 | | |
436057 | 436057 | | |
436058 | | - | |
| 436058 | + | |
436059 | 436059 | | |
436060 | 436060 | | |
436061 | 436061 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13756 | 13756 | | |
13757 | 13757 | | |
13758 | 13758 | | |
| 13759 | + | |
| 13760 | + | |
| 13761 | + | |
| 13762 | + | |
13759 | 13763 | | |
13760 | 13764 | | |
13761 | 13765 | | |
| |||
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
78 | 78 | | |
79 | 79 | | |
80 | 80 | | |
81 | | - | |
| 81 | + | |
82 | 82 | | |
83 | 83 | | |
84 | 84 | | |
| |||
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
0 commit comments