Skip to content

V3 json#531

Merged
xeus2001 merged 64 commits intov3from
v3_json
Nov 4, 2025
Merged

V3 json#531
xeus2001 merged 64 commits intov3from
v3_json

Conversation

@xeus2001
Copy link
Member

@xeus2001 xeus2001 commented Nov 4, 2025

Implement alternative JSON parser that consumes a lot less memory, and is as fast as Jackson (only consumes 2.6 times the JSON, and does not produce any garbage while parsing, compared to 6.5 times that Jackson uses).

xeus2001 and others added 30 commits October 21, 2025 13:55
@xeus2001
Add Werner Randelshofer’s FastDoubleParser.
40e927c 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Minor improvements to existing Jackson configuration.
9adc25a 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Add Java only, optimized, FNV1a hashing code (ported from Wikvaya).
b6498b3 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Minor improvements done while testing storage-api, not yet added into v3
544d872 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Remove not needed imports.
2e27a56 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Add new JBON draft, this is a learning from storage-api performance t…
5c39bc6 
…ests with inserting 500k features per second.

Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Add thread local char buffer needed for optimized JSON parser.
adc7e8d 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Port some helper frunctions from Wikvaya, needed soon for JSON parser.
c1a7de4 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Ported UTF-8 handling from Wikvaya, but improved to not throw excepti…
ef28761 
…ons.

Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Add string utils with a concurrency safe cache to intern strings.
0a219d4 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
First version of the JSON parser.
8a569bf 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Merge branch 'v3' into v3_json
1de2384
@xeus2001
Move classes into java code, allow string pinning, fix issues
394733d 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Merge branch 'v3' into v3_json
35f2aa3
@gunplar
CASL-1411 partial JsonArray
2d75d73 
Signed-off-by: phmai <phuc.mai@here.com>
@xeus2001
Improve parser
58ed590 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Finish parts of parser, add first tests.
d1b544c 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Improve JSON parser with more tests, and some minor fixes.
989a58e 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Add tests for null
e3a8d4f 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@gunplar
CASL-1411 partial JsonArray
54791ea 
Signed-off-by: phmai <phuc.mai@here.com>
@xeus2001
Add some more tests.
46fe3e2 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Add quoted string parsing testing and fixes.
5be7684 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Add tests for singleton, fix singleton handling.
b3cc122 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@gunplar
CASL-1411 partial JsonArray
3e3000f 
Signed-off-by: phmai <phuc.mai@here.com>
@gunplar
CASL-1411 partial JsonArray
2277297 
Signed-off-by: phmai <phuc.mai@here.com>
@xeus2001
Prepare array parsing.
514ed5b 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Finish array parsing, add testing.
ed6b1fe 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@gunplar
CASL-1411 partial JsonArray
c9326b1 
Signed-off-by: phmai <phuc.mai@here.com>
@xeus2001
Fix test of line-feed
d1d6a31 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Finish map parsing, add tests
c0771f2 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
xeus2001 and others added 21 commits November 3, 2025 11:11
@xeus2001
Finish JvmMap and JvmList support for JsonMap and JsonArray backing them
64678af 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Remove the lock from the StringUtil, not needed, even while our test …
1f420e2 
…does not cover, it will improve parallel parsing speed.

Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Upgrade version to beta.26
331d975 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Increment version to beta.30
8682e00 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix StringUtil assertion and integer boxing in JvmParser
f682a9a 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix put, it was not setting key/value at correct locations.
ea258bd 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix iteration of entry-map or key-set, we now fallback to LinkedHashMap
8bbb878 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix order of keys in put case, add basic entry-set test.
a470dcd 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix minor issue in indexOfValue and containsValue
1871d17 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@gunplar
rename backing array so JvmMap entries can reuse JsonMap entrySet
3df4915 
Signed-off-by: phmai <phuc.mai@here.com>
@gunplar
bug
7006da6 
Signed-off-by: phmai <phuc.mai@here.com>
@gunplar
expose Platform fromJSON utf8 ByteArray
9542589 
Signed-off-by: phmai <phuc.mai@here.com>
@gunplar
add JvmMap constructor for JvmParser to correctly use
15e974a 
Signed-off-by: phmai <phuc.mai@here.com>
@gunplar
potential stack bug
53a9725 
Signed-off-by: phmai <phuc.mai@here.com>
@xeus2001
Revert changes done to releaseStackAt, we want to avoid memory alloca…
1b79f1c 
…tion, more important than safety in this case!

Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Minor performance improvement for toJtsLineString, avoids the interme…
c841a7c 
…diate step over a list

Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix array_compact, add test for JsonArray removal.
77bd952 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Make code more debug friendly, no runtime effect
81ec67d 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix that JvmList adds an unwrapped object into an internal arraylist
ad26fc6 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix hasNext of iterators.
1f03ae5 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Add test for setCapacity, fix assertion in JsonArray constructor
78665f9 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
gunplar
gunplar previously approved these changes Nov 4, 2025
View reviewed changes
@xeus2001
Adjust tests to just tests for CLI failure, not testing the JSON pars…
236fa34 
…er response

Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
xeus2001 and others added 3 commits November 4, 2025 15:11
@xeus2001
Fix add-at and subList, adjust tests to code
a582687 
Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@xeus2001
Fix isolation in tests, so that they do not leave gobale toggle on, f…
12045b9 
…ix JSON parser map length

Signed-off-by: Alexander Lowey-Weber <alexander.weber@here.com>
@gunplar
bugs out of bound
60928cc 
Signed-off-by: phmai <phuc.mai@here.com>
@xeus2001 xeus2001 merged commit 47eb2d2 into v3 Nov 4, 2025
3 checks passed
@xeus2001 xeus2001 deleted the v3_json branch November 4, 2025 14:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gunplar gunplar gunplar approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@xeus2001 @gunplar