Add JDK 26-EA testing to CI by sarahchen6 · Pull Request #9996 · DataDog/dd-trace-java

sarahchen6 · 2025-11-18T17:34:23Z

What Does This Do

Add testing for JDK 26-ea to CI as a non-default JVM. Skip and label incompatible tests as TODO: Fix for Java 26...

Motivation

Start testing Java 26 in CI in preparation for the GA release, planned for March 17, 2026 (ref). Next steps are to unskip the Maven smoke tests (jira ticket for tracking) and to update Java 26 as the latest stable release once GA-ed.

Additional Notes

I tested by manually running NON_DEFAULT_JVM tests, including Java 26, here: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/83365559.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-903

pr-commenter · 2025-11-18T18:29:26Z

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1764604834	1764605179
end_time	2025-12-01T16:01:56	2025-12-01T16:07:40
git_branch	master	sarahchen6/add-jdk-26-ea-to-ci
git_commit_sha	`ab694c7`	`621988a`
start_time	2025-12-01T16:00:35	2025-12-01T16:06:20

See matching parameters

	Baseline	Candidate
ci_job_id	1263852589	1263852589
ci_pipeline_id	84478085	84478085
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1764603949	1764603949

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-25.428µs; +44.339µs] or [-8.992%; +15.680%]	unstable [-40.663µs; +58.694µs] or [-12.522%; +18.075%]	unstable [-48.668µs; +68.720µs] or [-14.390%; +20.318%]	unstable [-168.128µs; +367.471µs] or [-16.671%; +36.438%]	same
scenario:basic	same	same	same	unstable [-92.383µs; +59.484µs] or [-12.798%; +8.240%]	unstable [-161.798op/s; +161.798op/s] or [-6.310%; +6.310%]
scenario:loop	unsure [-10.768µs; -4.925µs] or [-0.121%; -0.056%]	unsure [-14.434µs; -5.889µs] or [-0.161%; -0.066%]	unsure [-11.393µs; -2.953µs] or [-0.126%; -0.033%]	same	same

Request duration reports for reports

gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (324.726 µs) : 292, 358
.   : milestone, 325,
basic (291.166 µs) : 284, 298
.   : milestone, 291,
loop (8.96 ms) : 8957, 8964
.   : milestone, 8960,
section candidate
noprobe (333.742 µs) : 275, 392
.   : milestone, 334,
basic (293.365 µs) : 286, 300
.   : milestone, 293,
loop (8.95 ms) : 8945, 8954
.   : milestone, 8950,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	324.726 µs [291.882 µs, 357.571 µs]
basic	291.166 µs [283.98 µs, 298.352 µs]
loop	8.96 ms [8.957 ms, 8.964 ms]

candidate results

Scenario	Request median duration [CI 0.99]
noprobe	333.742 µs [275.486 µs, 391.998 µs]
basic	293.365 µs [286.38 µs, 300.351 µs]
loop	8.95 ms [8.945 ms, 8.954 ms]

pr-commenter · 2025-11-18T18:48:16Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/add-jdk-26-ea-to-ci
git_commit_date	1764344838	1764603949
git_commit_sha	`17c7fcf`	`621988a`
release_version	1.57.0-SNAPSHOT~17c7fcf3e9	1.57.0-SNAPSHOT~621988a0df

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1764605840	1764605840
ci_job_id	1263852574	1263852574
ci_pipeline_id	84478085	84478085
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-fjut9htd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-fjut9htd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~621988a0df, baseline=1.57.0-SNAPSHOT~17c7fcf3e9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054874
Total [baseline] (8.726 s) : 0, 8726014
Agent [candidate] (1.064 s) : 0, 1063768
Total [candidate] (8.728 s) : 0, 8728265
section iast
Agent [baseline] (1.203 s) : 0, 1202848
Total [baseline] (9.373 s) : 0, 9373143
Agent [candidate] (1.198 s) : 0, 1198036
Total [candidate] (9.361 s) : 0, 9361251

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	iast	1.203 s	147.974 ms (14.0%)
Total	tracing	8.726 s	-
Total	iast	9.373 s	647.128 ms (7.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	iast	1.198 s	134.268 ms (12.6%)
Total	tracing	8.728 s	-
Total	iast	9.361 s	632.986 ms (7.3%)

gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~621988a0df, baseline=1.57.0-SNAPSHOT~17c7fcf3e9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.495 ms) : 0, 1495
crashtracking [candidate] (1.503 ms) : 0, 1503
BytebuddyAgent [baseline] (709.206 ms) : 0, 709206
BytebuddyAgent [candidate] (715.179 ms) : 0, 715179
GlobalTracer [baseline] (249.747 ms) : 0, 249747
GlobalTracer [candidate] (251.817 ms) : 0, 251817
AppSec [baseline] (31.981 ms) : 0, 31981
AppSec [candidate] (32.386 ms) : 0, 32386
Debugger [baseline] (6.389 ms) : 0, 6389
Debugger [candidate] (6.476 ms) : 0, 6476
Remote Config [baseline] (700.167 µs) : 0, 700
Remote Config [candidate] (678.238 µs) : 0, 678
Telemetry [baseline] (16.286 ms) : 0, 16286
Telemetry [candidate] (16.358 ms) : 0, 16358
Flare Poller [baseline] (4.101 ms) : 0, 4101
Flare Poller [candidate] (4.248 ms) : 0, 4248
section iast
crashtracking [baseline] (1.49 ms) : 0, 1490
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (839.081 ms) : 0, 839081
BytebuddyAgent [candidate] (834.385 ms) : 0, 834385
GlobalTracer [baseline] (239.434 ms) : 0, 239434
GlobalTracer [candidate] (239.778 ms) : 0, 239778
AppSec [baseline] (31.196 ms) : 0, 31196
AppSec [candidate] (28.837 ms) : 0, 28837
Debugger [baseline] (6.136 ms) : 0, 6136
Debugger [candidate] (6.098 ms) : 0, 6098
Remote Config [baseline] (615.568 µs) : 0, 616
Remote Config [candidate] (620.267 µs) : 0, 620
Telemetry [baseline] (7.957 ms) : 0, 7957
Telemetry [candidate] (7.983 ms) : 0, 7983
Flare Poller [baseline] (10.829 ms) : 0, 10829
Flare Poller [candidate] (10.891 ms) : 0, 10891
IAST [baseline] (31.021 ms) : 0, 31021
IAST [candidate] (33.002 ms) : 0, 33002

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~621988a0df, baseline=1.57.0-SNAPSHOT~17c7fcf3e9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063169
Total [baseline] (10.845 s) : 0, 10844795
Agent [candidate] (1.058 s) : 0, 1058172
Total [candidate] (10.923 s) : 0, 10923326
section appsec
Agent [baseline] (1.23 s) : 0, 1230187
Total [baseline] (10.928 s) : 0, 10927563
Agent [candidate] (1.229 s) : 0, 1229430
Total [candidate] (10.907 s) : 0, 10906667
section iast
Agent [baseline] (1.205 s) : 0, 1204804
Total [baseline] (11.262 s) : 0, 11262101
Agent [candidate] (1.194 s) : 0, 1194253
Total [candidate] (11.131 s) : 0, 11130550
section profiling
Agent [baseline] (1.208 s) : 0, 1208063
Total [baseline] (10.97 s) : 0, 10969583
Agent [candidate] (1.204 s) : 0, 1203501
Total [candidate] (11.023 s) : 0, 11022946

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.063 s	-
Agent	appsec	1.23 s	167.018 ms (15.7%)
Agent	iast	1.205 s	141.636 ms (13.3%)
Agent	profiling	1.208 s	144.894 ms (13.6%)
Total	tracing	10.845 s	-
Total	appsec	10.928 s	82.767 ms (0.8%)
Total	iast	11.262 s	417.305 ms (3.8%)
Total	profiling	10.97 s	124.787 ms (1.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	appsec	1.229 s	171.257 ms (16.2%)
Agent	iast	1.194 s	136.08 ms (12.9%)
Agent	profiling	1.204 s	145.329 ms (13.7%)
Total	tracing	10.923 s	-
Total	appsec	10.907 s	-16.66 ms (-0.2%)
Total	iast	11.131 s	207.224 ms (1.9%)
Total	profiling	11.023 s	99.62 ms (0.9%)

gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~621988a0df, baseline=1.57.0-SNAPSHOT~17c7fcf3e9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.498 ms) : 0, 1498
crashtracking [candidate] (1.491 ms) : 0, 1491
BytebuddyAgent [baseline] (714.476 ms) : 0, 714476
BytebuddyAgent [candidate] (709.274 ms) : 0, 709274
GlobalTracer [baseline] (252.046 ms) : 0, 252046
GlobalTracer [candidate] (252.321 ms) : 0, 252321
AppSec [baseline] (32.474 ms) : 0, 32474
AppSec [candidate] (32.485 ms) : 0, 32485
Debugger [baseline] (6.499 ms) : 0, 6499
Debugger [candidate] (6.445 ms) : 0, 6445
Remote Config [baseline] (679.767 µs) : 0, 680
Remote Config [candidate] (680.334 µs) : 0, 680
Telemetry [baseline] (15.569 ms) : 0, 15569
Telemetry [candidate] (16.38 ms) : 0, 16380
Flare Poller [baseline] (4.952 ms) : 0, 4952
Flare Poller [candidate] (4.188 ms) : 0, 4188
section appsec
crashtracking [baseline] (1.49 ms) : 0, 1490
crashtracking [candidate] (1.487 ms) : 0, 1487
BytebuddyAgent [baseline] (732.317 ms) : 0, 732317
BytebuddyAgent [candidate] (731.348 ms) : 0, 731348
GlobalTracer [baseline] (242.183 ms) : 0, 242183
GlobalTracer [candidate] (242.108 ms) : 0, 242108
AppSec [baseline] (175.111 ms) : 0, 175111
AppSec [candidate] (175.449 ms) : 0, 175449
Debugger [baseline] (6.251 ms) : 0, 6251
Debugger [candidate] (6.304 ms) : 0, 6304
Remote Config [baseline] (677.986 µs) : 0, 678
Remote Config [candidate] (687.081 µs) : 0, 687
Telemetry [baseline] (8.159 ms) : 0, 8159
Telemetry [candidate] (8.114 ms) : 0, 8114
Flare Poller [baseline] (3.985 ms) : 0, 3985
Flare Poller [candidate] (4.016 ms) : 0, 4016
IAST [baseline] (24.983 ms) : 0, 24983
IAST [candidate] (24.934 ms) : 0, 24934
section iast
crashtracking [baseline] (1.513 ms) : 0, 1513
crashtracking [candidate] (1.492 ms) : 0, 1492
BytebuddyAgent [baseline] (841.018 ms) : 0, 841018
BytebuddyAgent [candidate] (832.992 ms) : 0, 832992
GlobalTracer [baseline] (240.245 ms) : 0, 240245
GlobalTracer [candidate] (238.792 ms) : 0, 238792
AppSec [baseline] (27.285 ms) : 0, 27285
AppSec [candidate] (26.853 ms) : 0, 26853
Debugger [baseline] (6.055 ms) : 0, 6055
Debugger [candidate] (6.029 ms) : 0, 6029
Remote Config [baseline] (612.77 µs) : 0, 613
Remote Config [candidate] (605.012 µs) : 0, 605
Telemetry [baseline] (7.875 ms) : 0, 7875
Telemetry [candidate] (7.803 ms) : 0, 7803
Flare Poller [baseline] (10.72 ms) : 0, 10720
Flare Poller [candidate] (10.684 ms) : 0, 10684
IAST [baseline] (34.459 ms) : 0, 34459
IAST [candidate] (34.077 ms) : 0, 34077
section profiling
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (738.439 ms) : 0, 738439
BytebuddyAgent [candidate] (736.011 ms) : 0, 736011
GlobalTracer [baseline] (225.011 ms) : 0, 225011
GlobalTracer [candidate] (224.331 ms) : 0, 224331
AppSec [baseline] (32.533 ms) : 0, 32533
AppSec [candidate] (32.4 ms) : 0, 32400
Debugger [baseline] (6.974 ms) : 0, 6974
Debugger [candidate] (7.725 ms) : 0, 7725
Remote Config [baseline] (697.826 µs) : 0, 698
Remote Config [candidate] (708.767 µs) : 0, 709
Telemetry [baseline] (16.701 ms) : 0, 16701
Telemetry [candidate] (15.304 ms) : 0, 15304
Flare Poller [baseline] (4.19 ms) : 0, 4190
Flare Poller [candidate] (4.179 ms) : 0, 4179
ProfilingAgent [baseline] (112.578 ms) : 0, 112578
ProfilingAgent [candidate] (112.152 ms) : 0, 112152
Profiling [baseline] (113.211 ms) : 0, 113211
Profiling [candidate] (112.789 ms) : 0, 112789

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/add-jdk-26-ea-to-ci
git_commit_date	1764344838	1764603949
git_commit_sha	`17c7fcf`	`621988a`
release_version	1.57.0-SNAPSHOT~17c7fcf3e9	1.57.0-SNAPSHOT~621988a0df

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1764606400	1764606400
ci_job_id	1263852577	1263852577
ci_pipeline_id	84478085	84478085
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-33q9x9ly 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-33q9x9ly 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load	worse [+285.043µs; +536.058µs] or [+5.603%; +10.537%]	worse [+0.598ms; +1.470ms] or [+4.944%; +12.149%]	unstable [-137.310op/s; +32.872op/s] or [-17.189%; +4.115%]	5.498ms	13.132ms	746.625op/s	5.088ms	12.098ms	798.844op/s
scenario:load:petclinic:iast:high_load	better [-1349.484µs; -561.533µs] or [-7.317%; -3.045%]	unsure [-1533.193µs; -95.803µs] or [-5.140%; -0.321%]	unstable [-14.763op/s; +35.326op/s] or [-5.906%; +14.132%]	17.488ms	29.012ms	260.250op/s	18.443ms	29.826ms	249.969op/s
scenario:load:petclinic:appsec:high_load	better [-854.459µs; -439.773µs] or [-4.565%; -2.349%]	unsure [-1206.262µs; -44.141µs] or [-3.942%; -0.144%]	unstable [-16.217op/s; +31.592op/s] or [-6.634%; +12.923%]	18.071ms	29.978ms	252.156op/s	18.718ms	30.603ms	244.469op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~621988a0df, baseline=1.57.0-SNAPSHOT~17c7fcf3e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.127 ms) : 18932, 19322
.   : milestone, 19127,
appsec (19.093 ms) : 18895, 19291
.   : milestone, 19093,
code_origins (17.812 ms) : 17637, 17987
.   : milestone, 17812,
iast (18.672 ms) : 18484, 18861
.   : milestone, 18672,
profiling (19.326 ms) : 19128, 19523
.   : milestone, 19326,
tracing (17.613 ms) : 17440, 17787
.   : milestone, 17613,
section candidate
no_agent (18.145 ms) : 17958, 18333
.   : milestone, 18145,
appsec (18.508 ms) : 18319, 18696
.   : milestone, 18508,
code_origins (17.58 ms) : 17406, 17755
.   : milestone, 17580,
iast (17.929 ms) : 17750, 18109
.   : milestone, 17929,
profiling (19.598 ms) : 19401, 19795
.   : milestone, 19598,
tracing (17.389 ms) : 17219, 17559
.   : milestone, 17389,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.127 ms [18.932 ms, 19.322 ms]	-
appsec	19.093 ms [18.895 ms, 19.291 ms]	-34.144 µs (-0.2%)
code_origins	17.812 ms [17.637 ms, 17.987 ms]	-1.315 ms (-6.9%)
iast	18.672 ms [18.484 ms, 18.861 ms]	-455.054 µs (-2.4%)
profiling	19.326 ms [19.128 ms, 19.523 ms]	198.142 µs (1.0%)
tracing	17.613 ms [17.44 ms, 17.787 ms]	-1.514 ms (-7.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.145 ms [17.958 ms, 18.333 ms]	-
appsec	18.508 ms [18.319 ms, 18.696 ms]	362.214 µs (2.0%)
code_origins	17.58 ms [17.406 ms, 17.755 ms]	-565.285 µs (-3.1%)
iast	17.929 ms [17.75 ms, 18.109 ms]	-215.985 µs (-1.2%)
profiling	19.598 ms [19.401 ms, 19.795 ms]	1.453 ms (8.0%)
tracing	17.389 ms [17.219 ms, 17.559 ms]	-756.583 µs (-4.2%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~621988a0df, baseline=1.57.0-SNAPSHOT~17c7fcf3e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.2 ms) : 1189, 1211
.   : milestone, 1200,
iast (3.272 ms) : 3227, 3317
.   : milestone, 3272,
iast_FULL (5.79 ms) : 5732, 5848
.   : milestone, 5790,
iast_GLOBAL (3.646 ms) : 3593, 3700
.   : milestone, 3646,
profiling (1.91 ms) : 1893, 1926
.   : milestone, 1910,
tracing (1.85 ms) : 1834, 1866
.   : milestone, 1850,
section candidate
no_agent (1.2 ms) : 1188, 1211
.   : milestone, 1200,
iast (3.124 ms) : 3085, 3163
.   : milestone, 3124,
iast_FULL (6.198 ms) : 6133, 6262
.   : milestone, 6198,
iast_GLOBAL (3.707 ms) : 3651, 3763
.   : milestone, 3707,
profiling (2.034 ms) : 2016, 2051
.   : milestone, 2034,
tracing (1.884 ms) : 1868, 1901
.   : milestone, 1884,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.2 ms [1.189 ms, 1.211 ms]	-
iast	3.272 ms [3.227 ms, 3.317 ms]	2.072 ms (172.6%)
iast_FULL	5.79 ms [5.732 ms, 5.848 ms]	4.59 ms (382.4%)
iast_GLOBAL	3.646 ms [3.593 ms, 3.7 ms]	2.446 ms (203.8%)
profiling	1.91 ms [1.893 ms, 1.926 ms]	709.454 µs (59.1%)
tracing	1.85 ms [1.834 ms, 1.866 ms]	650.053 µs (54.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.2 ms [1.188 ms, 1.211 ms]	-
iast	3.124 ms [3.085 ms, 3.163 ms]	1.924 ms (160.4%)
iast_FULL	6.198 ms [6.133 ms, 6.262 ms]	4.998 ms (416.7%)
iast_GLOBAL	3.707 ms [3.651 ms, 3.763 ms]	2.508 ms (209.1%)
profiling	2.034 ms [2.016 ms, 2.051 ms]	834.208 µs (69.5%)
tracing	1.884 ms [1.868 ms, 1.901 ms]	684.819 µs (57.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/add-jdk-26-ea-to-ci
git_commit_date	1764344838	1764603949
git_commit_sha	`17c7fcf`	`621988a`
release_version	1.57.0-SNAPSHOT~17c7fcf3e9	1.57.0-SNAPSHOT~621988a0df

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1764606050	1764606050
ci_job_id	1263852579	1263852579
ci_pipeline_id	84478085	84478085
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-chsxidt5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-chsxidt5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~621988a0df, baseline=1.57.0-SNAPSHOT~17c7fcf3e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.509 s) : 15509000, 15509000
.   : milestone, 15509000,
appsec (14.484 s) : 14484000, 14484000
.   : milestone, 14484000,
iast (18.555 s) : 18555000, 18555000
.   : milestone, 18555000,
iast_GLOBAL (17.809 s) : 17809000, 17809000
.   : milestone, 17809000,
profiling (15.341 s) : 15341000, 15341000
.   : milestone, 15341000,
tracing (14.584 s) : 14584000, 14584000
.   : milestone, 14584000,
section candidate
no_agent (15.694 s) : 15694000, 15694000
.   : milestone, 15694000,
appsec (14.759 s) : 14759000, 14759000
.   : milestone, 14759000,
iast (17.896 s) : 17896000, 17896000
.   : milestone, 17896000,
iast_GLOBAL (18.139 s) : 18139000, 18139000
.   : milestone, 18139000,
profiling (14.586 s) : 14586000, 14586000
.   : milestone, 14586000,
tracing (14.728 s) : 14728000, 14728000
.   : milestone, 14728000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.509 s [15.509 s, 15.509 s]	-
appsec	14.484 s [14.484 s, 14.484 s]	-1.025 s (-6.6%)
iast	18.555 s [18.555 s, 18.555 s]	3.046 s (19.6%)
iast_GLOBAL	17.809 s [17.809 s, 17.809 s]	2.3 s (14.8%)
profiling	15.341 s [15.341 s, 15.341 s]	-168.0 ms (-1.1%)
tracing	14.584 s [14.584 s, 14.584 s]	-925.0 ms (-6.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.694 s [15.694 s, 15.694 s]	-
appsec	14.759 s [14.759 s, 14.759 s]	-935.0 ms (-6.0%)
iast	17.896 s [17.896 s, 17.896 s]	2.202 s (14.0%)
iast_GLOBAL	18.139 s [18.139 s, 18.139 s]	2.445 s (15.6%)
profiling	14.586 s [14.586 s, 14.586 s]	-1.108 s (-7.1%)
tracing	14.728 s [14.728 s, 14.728 s]	-966.0 ms (-6.2%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~621988a0df, baseline=1.57.0-SNAPSHOT~17c7fcf3e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (3.74 ms) : 3522, 3959
.   : milestone, 3740,
iast (2.212 ms) : 2147, 2276
.   : milestone, 2212,
iast_GLOBAL (2.264 ms) : 2199, 2330
.   : milestone, 2264,
profiling (2.077 ms) : 2023, 2131
.   : milestone, 2077,
tracing (2.048 ms) : 1997, 2099
.   : milestone, 2048,
section candidate
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.699 ms) : 3481, 3916
.   : milestone, 3699,
iast (2.218 ms) : 2153, 2282
.   : milestone, 2218,
iast_GLOBAL (2.262 ms) : 2197, 2327
.   : milestone, 2262,
profiling (2.098 ms) : 2044, 2152
.   : milestone, 2098,
tracing (2.047 ms) : 1996, 2098
.   : milestone, 2047,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.47 ms, 1.493 ms]	-
appsec	3.74 ms [3.522 ms, 3.959 ms]	2.259 ms (152.5%)
iast	2.212 ms [2.147 ms, 2.276 ms]	730.318 µs (49.3%)
iast_GLOBAL	2.264 ms [2.199 ms, 2.33 ms]	783.237 µs (52.9%)
profiling	2.077 ms [2.023 ms, 2.131 ms]	595.755 µs (40.2%)
tracing	2.048 ms [1.997 ms, 2.099 ms]	566.93 µs (38.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.465 ms, 1.488 ms]	-
appsec	3.699 ms [3.481 ms, 3.916 ms]	2.222 ms (150.4%)
iast	2.218 ms [2.153 ms, 2.282 ms]	740.637 µs (50.1%)
iast_GLOBAL	2.262 ms [2.197 ms, 2.327 ms]	784.969 µs (53.1%)
profiling	2.098 ms [2.044 ms, 2.152 ms]	621.105 µs (42.1%)
tracing	2.047 ms [1.996 ms, 2.098 ms]	569.719 µs (38.6%)

PerfectSlayer

Looking good for the platform change.
I will let live debugger and ci visibility review their related code changes.

dd-java-agent/agent-debugger/src/test/java/com/datadog/debugger/agent/CapturingTestBase.java

jpbempel

LGTM for debugger part

sarahchen6 added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Nov 18, 2025

sarahchen6 added 4 commits November 20, 2025 08:59

Add Java 26 to CI as non-default JVM

41b2043

Add EA workarounds

86e2fa9

Update gradle compatibility check

024715c

Skip maven smoke tests

c8cac17

sarahchen6 force-pushed the sarahchen6/add-jdk-26-ea-to-ci branch from 3ab90bc to c8cac17 Compare November 20, 2025 14:19

This comment has been minimized.

Sign in to view

sarahchen6 marked this pull request as ready for review November 20, 2025 16:31

sarahchen6 requested review from a team as code owners November 20, 2025 16:31

sarahchen6 requested review from PerfectSlayer, colin-higgins, daniel-mohedano, dougqh and shatzi and removed request for a team November 20, 2025 16:31

Merge branch 'master' into sarahchen6/add-jdk-26-ea-to-ci

c272092

PerfectSlayer approved these changes Nov 21, 2025

View reviewed changes

jpbempel reviewed Nov 21, 2025

View reviewed changes

dd-java-agent/agent-debugger/src/test/java/com/datadog/debugger/agent/CapturingTestBase.java Outdated Show resolved Hide resolved

sarahchen6 added 2 commits November 21, 2025 10:29

Use @EnabledForJreRange instead of workaround

1f594d8

Oops use annotation correctly now

eda14ac

jpbempel approved these changes Nov 21, 2025

View reviewed changes

Merge branch 'master' into sarahchen6/add-jdk-26-ea-to-ci

621988a

sarahchen6 merged commit 4d1a38c into master Dec 1, 2025
546 checks passed

sarahchen6 deleted the sarahchen6/add-jdk-26-ea-to-ci branch December 1, 2025 23:51

github-actions bot added this to the 1.57.0 milestone Dec 1, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add JDK 26-EA testing to CI#9996

Add JDK 26-EA testing to CI#9996
sarahchen6 merged 8 commits intomasterfrom
sarahchen6/add-jdk-26-ea-to-ci

sarahchen6 commented Nov 18, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Nov 18, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Nov 18, 2025 •

edited

Loading

Uh oh!

This comment has been minimized.

PerfectSlayer left a comment

Uh oh!

Uh oh!

jpbempel left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

sarahchen6 commented Nov 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Nov 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Debugger benchmarks

Parameters

Summary

Uh oh!

pr-commenter bot commented Nov 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

This comment has been minimized.

PerfectSlayer left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

jpbempel left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

sarahchen6 commented Nov 18, 2025 •

edited

Loading

pr-commenter bot commented Nov 18, 2025 •

edited

Loading

pr-commenter bot commented Nov 18, 2025 •

edited

Loading