Skip to content

Support Unicode 16.0 #23205

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 79 commits into from
Apr 20, 2025
Merged

Support Unicode 16.0 #23205

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
79 commits
Select commit Hold shift + click to select a range
0d4db07
Temporarily skip regen porting test in this branch
khwilliamson Apr 18, 2025
3f17d85
mk_invlists: Temporarily don't generate some porting info
khwilliamson Apr 18, 2025
e355e50
mk_invlists: Add stack trace facility
khwilliamson Apr 18, 2025
d8532cf
regexec.c: Rename a couple of variables
khwilliamson Apr 18, 2025
3bf4f15
mk_invlists: Change doubled semicolon to single
khwilliamson Apr 16, 2025
58110b6
mk_invlists.pl: Use feature signatures
khwilliamson Mar 22, 2025
041c018
mk_invlists: White-space comments
khwilliamson Mar 13, 2025
81c520a
mk_invlists: Clarify output table headings
khwilliamson Mar 13, 2025
d4c449d
mk_invlists: Sort some lists
khwilliamson Apr 17, 2025
dc75f2f
mk_invlists: Fix rule LB11
khwilliamson Mar 27, 2025
c7ee419
mk_invlists: Fix rule LB12
khwilliamson Mar 31, 2025
e7e0a38
mk_invlists: Fix rule LB13
khwilliamson Mar 21, 2025
1d7d669
mk_invlists: Add extensive comments
khwilliamson Mar 22, 2025
ee83f07
mk_invlists: Narrow some output tables
khwilliamson Apr 7, 2025
9b8fb89
mk_invlists: Center row labels in output tables
khwilliamson Apr 7, 2025
08b371e
mk_invlists: Move break tables edge cells
khwilliamson Apr 10, 2025
e4201f0
mk_invlists: Improve output table column headings
khwilliamson Apr 7, 2025
e07142a
mk_invlists: Change two formal parameter names
khwilliamson Mar 28, 2025
f8c3ee4
mk_invlists: Move some lines earlier in their functions
khwilliamson Mar 23, 2025
ef84749
mk_invlists: Change a word to be more accurate
khwilliamson Mar 26, 2025
75613b6
mk_invlists: Set and get break table values with functions
khwilliamson Mar 23, 2025
28d4709
mk_invlists: Hoist calculation to sub callers
khwilliamson Apr 9, 2025
1ed711e
mk_invlists: Set values in unused table cells to 0
khwilliamson Apr 9, 2025
3e04bc4
mk_invlists: Reorder two statements
khwilliamson Mar 23, 2025
96e146b
mk_invlists: Add ability to specify an entire row simply
khwilliamson Mar 23, 2025
2ffed1b
mk_invlists: Allow arbitrary list of cells
khwilliamson Mar 23, 2025
c7f991b
mk_invlists: Add no_nobreak_override()
khwilliamson Apr 8, 2025
b3b5d59
mk_invlists: Add ability to specify a complement of list
khwilliamson Mar 23, 2025
aa1373f
mk_invlists: Handle Combining Mark: changes CMxZWJ
khwilliamson Mar 24, 2025
5b830cf
mk_invlists: move decls comments around
khwilliamson Mar 23, 2025
2b29181
mk_invlists: Allow abbreviations for break classes
khwilliamson Mar 24, 2025
902daea
mk_invlists: Add effectively macro expansions
khwilliamson Mar 26, 2025
c44db1e
mk_invlists: Use new split capability with ALetter
khwilliamson Apr 18, 2025
c5b5bd2
mk_invlists: Use new split capability with ExtPict
khwilliamson Apr 12, 2025
c8cde99
mk_invlists: Use new split capability with AHLetter
khwilliamson Mar 30, 2025
f95d00f
mk_invlists: Use new split capability with MidNumLetQ
khwilliamson Mar 30, 2025
83a5e2a
mk_invlists: Add ability to get set subtraction
khwilliamson Apr 8, 2025
5044f5e
mk_invlists: Use new set subtraction ability
khwilliamson Apr 9, 2025
a76e1c7
mk_invlists: Use abbreviations for Line Break
khwilliamson Mar 27, 2025
4f663bb
mk_invlists: Use 'for' statement modifier
khwilliamson Apr 12, 2025
d487caa
mk_invlists: Improve DFA names
khwilliamson Mar 27, 2025
241ca80
mk_invlists: Add rule numbers to break table output
khwilliamson Mar 31, 2025
360f240
mk_invlists: Reorder some hash entries
khwilliamson Apr 16, 2025
51cc76c
mk_invlists: Add fields to data structure
khwilliamson Mar 28, 2025
ba895e9
mk_invlists/regexec.c: Generate and use macros
khwilliamson Mar 28, 2025
0b863c5
mk_invlists: Reverse order of break property rules
khwilliamson Apr 14, 2025
6e47ef8
mk_invlists: Remove obsolete function
khwilliamson Apr 12, 2025
26aa0a9
mk_invlists: Remove some special cases
khwilliamson Apr 15, 2025
964d932
mk_invlists: Add ability to tie table cell changes together
khwilliamson Apr 14, 2025
8d0651d
mk_invlists: rm no longer used sub
khwilliamson Apr 14, 2025
9ff7fa4
regexec.c: Change static function API
khwilliamson Apr 15, 2025
0446b1c
regexec.c: Change function name
khwilliamson Apr 15, 2025
b3acc47
regexec.c: Change static function API
khwilliamson Apr 18, 2025
491f967
regexec.c: Skip CM and ZWJ in look behind in LB parsing
khwilliamson Apr 18, 2025
2cebeea
mktables: Consolidate code into a single function
khwilliamson Apr 7, 2025
d116195
mk_invlists: Use new mktables enhancements
khwilliamson Apr 15, 2025
3303e54
mk_invlists: Generalize to stack DFAs for break properties
khwilliamson Apr 16, 2025
e980f5d
mk_invlists: Use new DFA scheme for horizontal white space
khwilliamson Apr 18, 2025
2ab93e9
mk_invlists: Remove accesses of unused parameter
khwilliamson Apr 18, 2025
52c1ce2
mk_invlists: Remove a temporary work-around
khwilliamson Apr 16, 2025
e7cb8fa
mk_invlists: Remove a no longer used enum
khwilliamson Apr 17, 2025
478b09b
mk_invlists: Remove no longer used function
khwilliamson Apr 17, 2025
8891654
mk_invlists: Look for a DFA optimization possibility
khwilliamson Apr 16, 2025
e0aefb3
mk_invlists: Remove hard-coded numbers
khwilliamson Apr 16, 2025
63a7d25
mk_invlists: Add a shorter form DFA
khwilliamson Apr 18, 2025
ff27cd8
lib/Unicode/UCD.t: Prepare for Unicode 15.1
khwilliamson Apr 18, 2025
84d02ff
UCD.t: Skip test which fails on 32 bit words
khwilliamson Apr 20, 2025
cd9bf04
mk_invlists/regexec.c: Prepare for Unicode 15.1
khwilliamson Apr 18, 2025
9765ad4
mktables: Prepare for Unicode 15.1
khwilliamson Apr 18, 2025
dd21401
mk_invlists: Restore calculation of new keywords, etc
khwilliamson Apr 17, 2025
81f3547
mk_invlists: Include cells in calculating column widths
khwilliamson Apr 17, 2025
b7e342b
mk_invlists/regexec.c: Prepare for Unicode 16.0
khwilliamson Apr 17, 2025
73cff8e
mktables: Prepare for Unicode 16.0
khwilliamson Apr 17, 2025
8d98672
Add Unicode 16.0
Apr 17, 2025
119b5ac
mktables: Note break table code for Unicode 16.0 is updated
khwilliamson Apr 17, 2025
84c8d3d
mk_invlists: Restore generating EBCDIC
khwilliamson Apr 19, 2025
ede3743
Revert "Temporarily skip regen porting test in this branch"
khwilliamson Apr 19, 2025
a80649e
mk_invlists: Update comments
khwilliamson Apr 20, 2025
bba5581
perldelta for Unicode update
khwilliamson Apr 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions MANIFEST
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5539,6 +5539,7 @@ lib/unicore/CompositionExclusions.txt Unicode character database
lib/unicore/DAge.txt Unicode character database
lib/unicore/DCoreProperties.txt Unicode character database
lib/unicore/DNormalizationProps.txt Unicode character database
lib/unicore/DoNotEmit.txt Unicode character database
lib/unicore/EastAsianWidth.txt Unicode character database
lib/unicore/emoji/emoji.txt Unicode character database
lib/unicore/EmojiSources.txt Unicode character database
Expand All @@ -5560,6 +5561,7 @@ lib/unicore/IdType.txt Unicode UTS 39 database
lib/unicore/Index.txt Unicode character database
lib/unicore/IndicPositionalCategory.txt Unicode character database
lib/unicore/IndicSyllabicCategory.txt Unicode character database
lib/unicore/intentional.txt Unicode character database
lib/unicore/Jamo.txt Unicode character database
lib/unicore/LineBreak.txt Unicode character database
lib/unicore/Makefile Unicode character database
Expand All @@ -5582,6 +5584,7 @@ lib/unicore/StandardizedVariants.txt Unicode character database
lib/unicore/TestNorm.pl Unicode character database
lib/unicore/uni_keywords.pl Indices into array in charclass_invlists.inc
lib/unicore/UnicodeData.txt Unicode character database
lib/unicore/Unikemet.txt Unicode character database
lib/unicore/version The version of the Unicode
lib/unicore/VerticalOrientation.txt Unicode character database
lib/UNIVERSAL.pm Base class for ALL classes
Expand Down
Loading
Loading