Fix Kotlin unit test running on JDK 25 #9646

jpbempel · 2025-10-01T13:59:58Z

What Does This Do

upgraded the Kotlin compiler version to 2.1.21

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: DEBUG-4513

upgraded the Kotlin compiler version to 2.1.21

datadog-datadog-prod-us1 · 2025-10-02T14:33:12Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 57.97% (+0.05%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: fb43eb5 | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-10-03T06:49:53Z

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1759473482	1759473854
end_time	2025-10-03T06:39:23	2025-10-03T06:45:35
git_branch	master	jpbempel/fix-kotlin-compilation-jdk25
git_commit_sha	`730565b`	`fb43eb5`
start_time	2025-10-03T06:38:03	2025-10-03T06:44:15

See matching parameters

	Baseline	Candidate
ci_job_id	1158601344	1158601344
ci_pipeline_id	78134345	78134345
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1759351078	1759351078

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 7 unstable metrics.

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:loop	better [-2.146ms; -1.472ms] or [-20.101%; -13.792%]	better [-2.183ms; -1.503ms] or [-20.200%; -13.909%]	better [-2.176ms; -1.498ms] or [-20.037%; -13.795%]	better [-2.196ms; -1.516ms] or [-19.971%; -13.789%]	better [+11.343op/s; +17.050op/s] or [+11.854%; +17.817%]

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-18.779µs; +30.410µs] or [-6.785%; +10.987%]	unstable [-31.128µs; +42.008µs] or [-9.828%; +13.264%]	unstable [-39.526µs; +55.234µs] or [-11.976%; +16.735%]	unstable [-83.269µs; +154.134µs] or [-9.024%; +16.704%]	unstable [-124.419op/s; +124.419op/s] or [-5.039%; +5.039%]
scenario:basic	same	same	same	unstable [-96.266µs; +110.694µs] or [-12.868%; +14.796%]	unstable [-215.871op/s; +215.871op/s] or [-8.203%; +8.203%]

Request duration reports for reports

gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (316.713 µs) : 290, 343
.   : milestone, 317,
basic (279.536 µs) : 273, 286
.   : milestone, 280,
loop (10.807 ms) : 10360, 11254
.   : milestone, 10807,
section candidate
noprobe (322.153 µs) : 281, 364
.   : milestone, 322,
basic (276.742 µs) : 270, 283
.   : milestone, 277,
loop (8.964 ms) : 8959, 8969
.   : milestone, 8964,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	316.713 µs [290.414 µs, 343.013 µs]
basic	279.536 µs [272.698 µs, 286.375 µs]
loop	10.807 ms [10.36 ms, 11.254 ms]

candidate results

Scenario	Request median duration [CI 0.99]
noprobe	322.153 µs [280.535 µs, 363.771 µs]
basic	276.742 µs [270.23 µs, 283.254 µs]
loop	8.964 ms [8.959 ms, 8.969 ms]

pr-commenter · 2025-10-03T07:05:29Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-kotlin-compilation-jdk25
git_commit_date	1759434795	1759351078
git_commit_sha	`730565b`	`fb43eb5`
release_version	1.54.0-SNAPSHOT~730565b556	1.54.0-SNAPSHOT~fb43eb5b5d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1759474740	1759474740
ci_job_id	1158601332	1158601332
ci_pipeline_id	78134345	78134345
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-3-9o6myru0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-3-9o6myru0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~fb43eb5b5d, baseline=1.54.0-SNAPSHOT~730565b556

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1027792
Total [baseline] (8.665 s) : 0, 8665110
Agent [candidate] (1.017 s) : 0, 1017100
Total [candidate] (8.616 s) : 0, 8615996
section iast
Agent [baseline] (1.161 s) : 0, 1160791
Total [baseline] (9.241 s) : 0, 9240669
Agent [candidate] (1.149 s) : 0, 1149276
Total [candidate] (9.23 s) : 0, 9230078

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.028 s	-
Agent	iast	1.161 s	132.998 ms (12.9%)
Total	tracing	8.665 s	-
Total	iast	9.241 s	575.559 ms (6.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.017 s	-
Agent	iast	1.149 s	132.175 ms (13.0%)
Total	tracing	8.616 s	-
Total	iast	9.23 s	614.082 ms (7.1%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~fb43eb5b5d, baseline=1.54.0-SNAPSHOT~730565b556

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.493 ms) : 0, 1493
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (701.2 ms) : 0, 701200
BytebuddyAgent [candidate] (692.041 ms) : 0, 692041
GlobalTracer [baseline] (244.732 ms) : 0, 244732
GlobalTracer [candidate] (242.751 ms) : 0, 242751
AppSec [baseline] (32.697 ms) : 0, 32697
AppSec [candidate] (32.641 ms) : 0, 32641
Debugger [baseline] (6.376 ms) : 0, 6376
Debugger [candidate] (6.38 ms) : 0, 6380
Remote Config [baseline] (686.145 µs) : 0, 686
Remote Config [candidate] (675.433 µs) : 0, 675
Telemetry [baseline] (9.027 ms) : 0, 9027
Telemetry [candidate] (9.049 ms) : 0, 9049
Flare Poller [baseline] (10.303 ms) : 0, 10303
Flare Poller [candidate] (11.002 ms) : 0, 11002
section iast
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (822.253 ms) : 0, 822253
BytebuddyAgent [candidate] (813.04 ms) : 0, 813040
GlobalTracer [baseline] (234.525 ms) : 0, 234525
GlobalTracer [candidate] (232.871 ms) : 0, 232871
IAST [baseline] (26.63 ms) : 0, 26630
IAST [candidate] (26.279 ms) : 0, 26279
AppSec [baseline] (35.442 ms) : 0, 35442
AppSec [candidate] (35.325 ms) : 0, 35325
Debugger [baseline] (6.204 ms) : 0, 6204
Debugger [candidate] (6.011 ms) : 0, 6011
Remote Config [baseline] (601.197 µs) : 0, 601
Remote Config [candidate] (576.886 µs) : 0, 577
Telemetry [baseline] (8.175 ms) : 0, 8175
Telemetry [candidate] (8.254 ms) : 0, 8254
Flare Poller [baseline] (4.201 ms) : 0, 4201
Flare Poller [candidate] (4.277 ms) : 0, 4277

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~fb43eb5b5d, baseline=1.54.0-SNAPSHOT~730565b556

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.016 s) : 0, 1016359
Total [baseline] (10.683 s) : 0, 10682527
Agent [candidate] (1.016 s) : 0, 1015844
Total [candidate] (10.639 s) : 0, 10638849
section appsec
Agent [baseline] (1.219 s) : 0, 1219247
Total [baseline] (11.03 s) : 0, 11030092
Agent [candidate] (1.202 s) : 0, 1201996
Total [candidate] (11.071 s) : 0, 11070862
section iast
Agent [baseline] (1.152 s) : 0, 1151572
Total [baseline] (10.845 s) : 0, 10844692
Agent [candidate] (1.159 s) : 0, 1159451
Total [candidate] (10.922 s) : 0, 10921770
section profiling
Agent [baseline] (1.165 s) : 0, 1164977
Total [baseline] (10.976 s) : 0, 10975651
Agent [candidate] (1.167 s) : 0, 1166511
Total [candidate] (11.013 s) : 0, 11013373

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.016 s	-
Agent	appsec	1.219 s	202.889 ms (20.0%)
Agent	iast	1.152 s	135.213 ms (13.3%)
Agent	profiling	1.165 s	148.618 ms (14.6%)
Total	tracing	10.683 s	-
Total	appsec	11.03 s	347.565 ms (3.3%)
Total	iast	10.845 s	162.165 ms (1.5%)
Total	profiling	10.976 s	293.124 ms (2.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.016 s	-
Agent	appsec	1.202 s	186.152 ms (18.3%)
Agent	iast	1.159 s	143.608 ms (14.1%)
Agent	profiling	1.167 s	150.667 ms (14.8%)
Total	tracing	10.639 s	-
Total	appsec	11.071 s	432.013 ms (4.1%)
Total	iast	10.922 s	282.921 ms (2.7%)
Total	profiling	11.013 s	374.524 ms (3.5%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~fb43eb5b5d, baseline=1.54.0-SNAPSHOT~730565b556

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (694.818 ms) : 0, 694818
BytebuddyAgent [candidate] (691.728 ms) : 0, 691728
GlobalTracer [baseline] (243.204 ms) : 0, 243204
GlobalTracer [candidate] (242.919 ms) : 0, 242919
AppSec [baseline] (32.537 ms) : 0, 32537
AppSec [candidate] (32.428 ms) : 0, 32428
Debugger [baseline] (6.354 ms) : 0, 6354
Debugger [candidate] (6.372 ms) : 0, 6372
Remote Config [baseline] (666.498 µs) : 0, 666
Remote Config [candidate] (675.413 µs) : 0, 675
Telemetry [baseline] (9.139 ms) : 0, 9139
Telemetry [candidate] (9.042 ms) : 0, 9042
Flare Poller [baseline] (7.108 ms) : 0, 7108
Flare Poller [candidate] (9.97 ms) : 0, 9970
section appsec
crashtracking [baseline] (1.495 ms) : 0, 1495
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (733.819 ms) : 0, 733819
BytebuddyAgent [candidate] (720.819 ms) : 0, 720819
GlobalTracer [baseline] (240.44 ms) : 0, 240440
GlobalTracer [candidate] (237.8 ms) : 0, 237800
AppSec [baseline] (175.918 ms) : 0, 175918
AppSec [candidate] (174.46 ms) : 0, 174460
Debugger [baseline] (6.289 ms) : 0, 6289
Debugger [candidate] (6.146 ms) : 0, 6146
Remote Config [baseline] (658.347 µs) : 0, 658
Remote Config [candidate] (661.203 µs) : 0, 661
Telemetry [baseline] (9.347 ms) : 0, 9347
Telemetry [candidate] (9.926 ms) : 0, 9926
Flare Poller [baseline] (4.095 ms) : 0, 4095
Flare Poller [candidate] (4.002 ms) : 0, 4002
IAST [baseline] (25.681 ms) : 0, 25681
IAST [candidate] (25.427 ms) : 0, 25427
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (814.499 ms) : 0, 814499
BytebuddyAgent [candidate] (820.375 ms) : 0, 820375
GlobalTracer [baseline] (233.355 ms) : 0, 233355
GlobalTracer [candidate] (234.871 ms) : 0, 234871
AppSec [baseline] (35.363 ms) : 0, 35363
AppSec [candidate] (35.232 ms) : 0, 35232
Debugger [baseline] (6.121 ms) : 0, 6121
Debugger [candidate] (6.113 ms) : 0, 6113
Remote Config [baseline] (589.775 µs) : 0, 590
Remote Config [candidate] (584.265 µs) : 0, 584
Telemetry [baseline] (8.191 ms) : 0, 8191
Telemetry [candidate] (8.357 ms) : 0, 8357
Flare Poller [baseline] (4.214 ms) : 0, 4214
Flare Poller [candidate] (4.254 ms) : 0, 4254
IAST [baseline] (26.5 ms) : 0, 26500
IAST [candidate] (26.756 ms) : 0, 26756
section profiling
ProfilingAgent [baseline] (107.493 ms) : 0, 107493
ProfilingAgent [candidate] (106.381 ms) : 0, 106381
crashtracking [baseline] (1.417 ms) : 0, 1417
crashtracking [candidate] (1.423 ms) : 0, 1423
BytebuddyAgent [baseline] (722.583 ms) : 0, 722583
BytebuddyAgent [candidate] (724.253 ms) : 0, 724253
GlobalTracer [baseline] (219.575 ms) : 0, 219575
GlobalTracer [candidate] (219.366 ms) : 0, 219366
AppSec [baseline] (32.836 ms) : 0, 32836
AppSec [candidate] (32.712 ms) : 0, 32712
Debugger [baseline] (6.55 ms) : 0, 6550
Debugger [candidate] (6.572 ms) : 0, 6572
Remote Config [baseline] (818.194 µs) : 0, 818
Remote Config [candidate] (1.549 ms) : 0, 1549
Telemetry [baseline] (16.664 ms) : 0, 16664
Telemetry [candidate] (15.811 ms) : 0, 15811
Flare Poller [baseline] (4.142 ms) : 0, 4142
Flare Poller [candidate] (4.252 ms) : 0, 4252
Profiling [baseline] (108.573 ms) : 0, 108573
Profiling [candidate] (108.456 ms) : 0, 108456

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-kotlin-compilation-jdk25
git_commit_date	1759434795	1759351078
git_commit_sha	`730565b`	`fb43eb5`
release_version	1.54.0-SNAPSHOT~730565b556	1.54.0-SNAPSHOT~fb43eb5b5d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1759474406	1759474406
ci_job_id	1158601334	1158601334
ci_pipeline_id	78134345	78134345
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-dp9g81gp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-dp9g81gp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 2 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	better [-202.906µs; -99.512µs] or [-4.614%; -2.263%]	unstable [-85.738op/s; +158.676op/s] or [-8.215%; +15.204%]	4.246ms	1080.094op/s	4.397ms	1043.625op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+481.586µs; +879.451µs] or [+4.861%; +8.877%]	unstable [-84.805op/s; +24.992op/s] or [-18.092%; +5.332%]	10.588ms	438.844op/s	9.907ms	468.750op/s
scenario:load:insecure-bank:tracing:high_load	better [-729.946µs; -491.404µs] or [-8.972%; -6.040%]	unstable [-27.885op/s; +119.198op/s] or [-4.896%; +20.929%]	7.525ms	615.188op/s	8.135ms	569.531op/s
scenario:load:petclinic:iast:high_load	better [-1.723ms; -0.905ms] or [-3.813%; -2.003%]	unstable [-4.040op/s; +10.240op/s] or [-3.903%; +9.893%]	43.874ms	106.612op/s	45.188ms	103.513op/s
scenario:load:petclinic:no_agent:high_load	better [-2.129ms; -1.493ms] or [-5.694%; -3.991%]	unstable [-1.865op/s; +14.515op/s] or [-1.492%; +11.612%]	35.590ms	131.325op/s	37.401ms	125.000op/s
scenario:load:petclinic:tracing:high_load	worse [+0.939ms; +1.771ms] or [+2.099%; +3.959%]	unstable [-9.777op/s; +3.702op/s] or [-9.351%; +3.541%]	46.090ms	101.513op/s	44.735ms	104.550op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~fb43eb5b5d, baseline=1.54.0-SNAPSHOT~730565b556
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.397 ms) : 4348, 4446
.   : milestone, 4397,
iast (9.942 ms) : 9775, 10110
.   : milestone, 9942,
iast_FULL (13.955 ms) : 13676, 14235
.   : milestone, 13955,
iast_GLOBAL (9.907 ms) : 9736, 10079
.   : milestone, 9907,
profiling (9.063 ms) : 8921, 9205
.   : milestone, 9063,
tracing (8.135 ms) : 8021, 8250
.   : milestone, 8135,
section candidate
no_agent (4.246 ms) : 4199, 4293
.   : milestone, 4246,
iast (10.002 ms) : 9830, 10173
.   : milestone, 10002,
iast_FULL (13.965 ms) : 13685, 14246
.   : milestone, 13965,
iast_GLOBAL (10.588 ms) : 10390, 10786
.   : milestone, 10588,
profiling (8.863 ms) : 8724, 9002
.   : milestone, 8863,
tracing (7.525 ms) : 7417, 7632
.   : milestone, 7525,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.397 ms [4.348 ms, 4.446 ms]	-
iast	9.942 ms [9.775 ms, 10.11 ms]	5.545 ms (126.1%)
iast_FULL	13.955 ms [13.676 ms, 14.235 ms]	9.558 ms (217.4%)
iast_GLOBAL	9.907 ms [9.736 ms, 10.079 ms]	5.51 ms (125.3%)
profiling	9.063 ms [8.921 ms, 9.205 ms]	4.666 ms (106.1%)
tracing	8.135 ms [8.021 ms, 8.25 ms]	3.738 ms (85.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.246 ms [4.199 ms, 4.293 ms]	-
iast	10.002 ms [9.83 ms, 10.173 ms]	5.756 ms (135.6%)
iast_FULL	13.965 ms [13.685 ms, 14.246 ms]	9.719 ms (228.9%)
iast_GLOBAL	10.588 ms [10.39 ms, 10.786 ms]	6.342 ms (149.4%)
profiling	8.863 ms [8.724 ms, 9.002 ms]	4.617 ms (108.7%)
tracing	7.525 ms [7.417 ms, 7.632 ms]	3.279 ms (77.2%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~fb43eb5b5d, baseline=1.54.0-SNAPSHOT~730565b556
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.401 ms) : 37096, 37705
.   : milestone, 37401,
appsec (49.217 ms) : 48780, 49653
.   : milestone, 49217,
code_origins (45.091 ms) : 44710, 45471
.   : milestone, 45091,
iast (45.188 ms) : 44799, 45576
.   : milestone, 45188,
profiling (48.831 ms) : 48316, 49347
.   : milestone, 48831,
tracing (44.735 ms) : 44354, 45116
.   : milestone, 44735,
section candidate
no_agent (35.59 ms) : 35303, 35877
.   : milestone, 35590,
appsec (49.317 ms) : 48891, 49743
.   : milestone, 49317,
code_origins (45.723 ms) : 45341, 46106
.   : milestone, 45723,
iast (43.874 ms) : 43503, 44245
.   : milestone, 43874,
profiling (49.245 ms) : 48757, 49734
.   : milestone, 49245,
tracing (46.09 ms) : 45698, 46482
.   : milestone, 46090,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.401 ms [37.096 ms, 37.705 ms]	-
appsec	49.217 ms [48.78 ms, 49.653 ms]	11.816 ms (31.6%)
code_origins	45.091 ms [44.71 ms, 45.471 ms]	7.69 ms (20.6%)
iast	45.188 ms [44.799 ms, 45.576 ms]	7.787 ms (20.8%)
profiling	48.831 ms [48.316 ms, 49.347 ms]	11.431 ms (30.6%)
tracing	44.735 ms [44.354 ms, 45.116 ms]	7.334 ms (19.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.59 ms [35.303 ms, 35.877 ms]	-
appsec	49.317 ms [48.891 ms, 49.743 ms]	13.727 ms (38.6%)
code_origins	45.723 ms [45.341 ms, 46.106 ms]	10.134 ms (28.5%)
iast	43.874 ms [43.503 ms, 44.245 ms]	8.284 ms (23.3%)
profiling	49.245 ms [48.757 ms, 49.734 ms]	13.656 ms (38.4%)
tracing	46.09 ms [45.698 ms, 46.482 ms]	10.5 ms (29.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-kotlin-compilation-jdk25
git_commit_date	1759434795	1759351078
git_commit_sha	`730565b`	`fb43eb5`
release_version	1.54.0-SNAPSHOT~730565b556	1.54.0-SNAPSHOT~fb43eb5b5d

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1759475005	1759475005
ci_job_id	1158601335	1158601335
ci_pipeline_id	78134345	78134345
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-tfmm91ea 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-tfmm91ea 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.369ms; -1.027ms] or [-36.977%; -27.744%]	2.504ms	3.702ms

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~fb43eb5b5d, baseline=1.54.0-SNAPSHOT~730565b556
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.458 s) : 15458000, 15458000
.   : milestone, 15458000,
appsec (15.046 s) : 15046000, 15046000
.   : milestone, 15046000,
iast (18.417 s) : 18417000, 18417000
.   : milestone, 18417000,
iast_GLOBAL (17.902 s) : 17902000, 17902000
.   : milestone, 17902000,
profiling (15.463 s) : 15463000, 15463000
.   : milestone, 15463000,
tracing (15.088 s) : 15088000, 15088000
.   : milestone, 15088000,
section candidate
no_agent (15.356 s) : 15356000, 15356000
.   : milestone, 15356000,
appsec (15.046 s) : 15046000, 15046000
.   : milestone, 15046000,
iast (18.751 s) : 18751000, 18751000
.   : milestone, 18751000,
iast_GLOBAL (18.222 s) : 18222000, 18222000
.   : milestone, 18222000,
profiling (15.509 s) : 15509000, 15509000
.   : milestone, 15509000,
tracing (14.954 s) : 14954000, 14954000
.   : milestone, 14954000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.458 s [15.458 s, 15.458 s]	-
appsec	15.046 s [15.046 s, 15.046 s]	-412.0 ms (-2.7%)
iast	18.417 s [18.417 s, 18.417 s]	2.959 s (19.1%)
iast_GLOBAL	17.902 s [17.902 s, 17.902 s]	2.444 s (15.8%)
profiling	15.463 s [15.463 s, 15.463 s]	5.0 ms (0.0%)
tracing	15.088 s [15.088 s, 15.088 s]	-370.0 ms (-2.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.356 s [15.356 s, 15.356 s]	-
appsec	15.046 s [15.046 s, 15.046 s]	-310.0 ms (-2.0%)
iast	18.751 s [18.751 s, 18.751 s]	3.395 s (22.1%)
iast_GLOBAL	18.222 s [18.222 s, 18.222 s]	2.866 s (18.7%)
profiling	15.509 s [15.509 s, 15.509 s]	153.0 ms (1.0%)
tracing	14.954 s [14.954 s, 14.954 s]	-402.0 ms (-2.6%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~fb43eb5b5d, baseline=1.54.0-SNAPSHOT~730565b556
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.702 ms) : 3484, 3920
.   : milestone, 3702,
iast (2.208 ms) : 2144, 2272
.   : milestone, 2208,
iast_GLOBAL (2.233 ms) : 2169, 2297
.   : milestone, 2233,
profiling (2.043 ms) : 1992, 2095
.   : milestone, 2043,
tracing (2.012 ms) : 1963, 2062
.   : milestone, 2012,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.504 ms) : 2450, 2558
.   : milestone, 2504,
iast (2.206 ms) : 2142, 2270
.   : milestone, 2206,
iast_GLOBAL (2.236 ms) : 2172, 2300
.   : milestone, 2236,
profiling (2.07 ms) : 2017, 2122
.   : milestone, 2070,
tracing (2.016 ms) : 1966, 2065
.   : milestone, 2016,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	3.702 ms [3.484 ms, 3.92 ms]	2.23 ms (151.5%)
iast	2.208 ms [2.144 ms, 2.272 ms]	735.742 µs (50.0%)
iast_GLOBAL	2.233 ms [2.169 ms, 2.297 ms]	761.06 µs (51.7%)
profiling	2.043 ms [1.992 ms, 2.095 ms]	571.252 µs (38.8%)
tracing	2.012 ms [1.963 ms, 2.062 ms]	540.267 µs (36.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.461 ms, 1.484 ms]	-
appsec	2.504 ms [2.45 ms, 2.558 ms]	1.031 ms (70.0%)
iast	2.206 ms [2.142 ms, 2.27 ms]	733.103 µs (49.8%)
iast_GLOBAL	2.236 ms [2.172 ms, 2.3 ms]	763.241 µs (51.8%)
profiling	2.07 ms [2.017 ms, 2.122 ms]	596.778 µs (40.5%)
tracing	2.016 ms [1.966 ms, 2.065 ms]	542.827 µs (36.9%)

jpbempel requested a review from a team as a code owner October 1, 2025 13:59

jpbempel requested review from ojung and removed request for a team October 1, 2025 13:59

jpbempel added tag: no release notes Changes to exclude from release notes type: refactoring comp: debugger Dynamic Instrumentation labels Oct 1, 2025

jpbempel requested a review from evanchooly October 1, 2025 14:00

Fix Kotlin unit test running on JDK 25

fb43eb5

upgraded the Kotlin compiler version to 2.1.21

jpbempel force-pushed the jpbempel/fix-kotlin-compilation-jdk25 branch from 8257a9f to fb43eb5 Compare October 1, 2025 20:38

evanchooly approved these changes Oct 3, 2025

View reviewed changes

jpbempel merged commit 8f34523 into master Oct 3, 2025
861 of 863 checks passed

jpbempel deleted the jpbempel/fix-kotlin-compilation-jdk25 branch October 3, 2025 12:13

github-actions bot added this to the 1.54.0 milestone Oct 3, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Fix Kotlin unit test running on JDK 25 #9646

Fix Kotlin unit test running on JDK 25 #9646

Uh oh!

jpbempel commented Oct 1, 2025 •

edited by atlassian bot

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Oct 2, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Oct 3, 2025

Uh oh!

pr-commenter bot commented Oct 3, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Fix Kotlin unit test running on JDK 25 #9646

Fix Kotlin unit test running on JDK 25 #9646

Uh oh!

Conversation

jpbempel commented Oct 1, 2025 • edited by atlassian bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Oct 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Oct 3, 2025

Debugger benchmarks

Parameters

Summary

Uh oh!

pr-commenter bot commented Oct 3, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

jpbempel commented Oct 1, 2025 •

edited by atlassian bot

Loading

datadog-datadog-prod-us1 bot commented Oct 2, 2025 •

edited

Loading