Fixed flaky muzzle test for jersy-client-2.0 instrumentation by AlexeyKuznetsov-DD · Pull Request #10175 · DataDog/dd-trace-java

AlexeyKuznetsov-DD · 2025-12-11T21:29:21Z

What Does This Do

Fix the flaky muzzle test for the jersey-client-2.0 instrumentation by excluding problematic external dependencies.

Motivation

The muzzle test has been intermittently failing due to missing artifacts in external repositories. For example, builds sometimes fail with errors such as:

Execution failed for task ':dd-java-agent:instrumentation:jersey:jersey-client-2.0:muzzle-AssertPass-org.glassfish.jersey.core-jersey-client-2.28.0.redhat-00001'.
> Could not resolve all files for configuration ':dd-java-agent:instrumentation:jersey:jersey-client-2.0:muzzle-AssertPass-org.glassfish.jersey.core-jersey-client-2.28.0.redhat-00001'.
   > Could not find jakarta.annotation-api-1.3.4.redhat-00002.jar (jakarta.annotation:jakarta.annotation-api:1.3.4.redhat-00002).
     Searched in the following locations:
         https://depot-read-api-java.us1.ddbuild.io/magicmirror/magicmirror/@current/jakarta/annotation/jakarta.annotation-api/1.3.4.redhat-00002/jakarta.annotation-api-1.3.4.redhat-00002.jar

Verification shows that the Red Hat Maven repository does not contain this artifact see

Additional Notes

To fix such failures the only way is to explicitly exclude known bad releases and/or their missing/broken transitive dependencies..

pr-commenter · 2025-12-11T22:05:27Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-muzzle-test-fixed
git_commit_date	1765481941	1765487855
git_commit_sha	`f2a8d05`	`5bb5617`
release_version	1.57.0-SNAPSHOT~f2a8d05e73	1.57.0-SNAPSHOT~5bb561769c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765497455	1765497455
ci_job_id	1289419365	1289419365
ci_pipeline_id	86376546	86376546
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-pyd6ib53 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-pyd6ib53 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~5bb561769c, baseline=1.57.0-SNAPSHOT~f2a8d05e73

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.087 s) : 0, 1086833
Total [baseline] (8.724 s) : 0, 8724220
Agent [candidate] (1.08 s) : 0, 1080185
Total [candidate] (8.723 s) : 0, 8723420
section iast
Agent [baseline] (1.218 s) : 0, 1218320
Total [baseline] (9.425 s) : 0, 9425044
Agent [candidate] (1.218 s) : 0, 1218250
Total [candidate] (9.479 s) : 0, 9479161

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.087 s	-
Agent	iast	1.218 s	131.487 ms (12.1%)
Total	tracing	8.724 s	-
Total	iast	9.425 s	700.824 ms (8.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.08 s	-
Agent	iast	1.218 s	138.065 ms (12.8%)
Total	tracing	8.723 s	-
Total	iast	9.479 s	755.741 ms (8.7%)

gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~5bb561769c, baseline=1.57.0-SNAPSHOT~f2a8d05e73

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (653.031 ms) : 0, 653031
BytebuddyAgent [candidate] (646.754 ms) : 0, 646754
GlobalTracer [baseline] (283.495 ms) : 0, 283495
GlobalTracer [candidate] (282.212 ms) : 0, 282212
AppSec [baseline] (32.521 ms) : 0, 32521
AppSec [candidate] (32.849 ms) : 0, 32849
Debugger [baseline] (67.449 ms) : 0, 67449
Debugger [candidate] (68.233 ms) : 0, 68233
Remote Config [baseline] (643.306 µs) : 0, 643
Remote Config [candidate] (672.132 µs) : 0, 672
Telemetry [baseline] (9.082 ms) : 0, 9082
Telemetry [candidate] (9.043 ms) : 0, 9043
Flare Poller [baseline] (3.801 ms) : 0, 3801
Flare Poller [candidate] (3.793 ms) : 0, 3793
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (788.197 ms) : 0, 788197
BytebuddyAgent [candidate] (787.732 ms) : 0, 787732
GlobalTracer [baseline] (254.88 ms) : 0, 254880
GlobalTracer [candidate] (254.947 ms) : 0, 254947
AppSec [baseline] (35.128 ms) : 0, 35128
AppSec [candidate] (35.368 ms) : 0, 35368
Debugger [baseline] (64.465 ms) : 0, 64465
Debugger [candidate] (64.581 ms) : 0, 64581
Remote Config [baseline] (536.677 µs) : 0, 537
Remote Config [candidate] (545.866 µs) : 0, 546
Telemetry [baseline] (8.396 ms) : 0, 8396
Telemetry [candidate] (8.4 ms) : 0, 8400
Flare Poller [baseline] (3.455 ms) : 0, 3455
Flare Poller [candidate] (3.507 ms) : 0, 3507
IAST [baseline] (26.825 ms) : 0, 26825
IAST [candidate] (26.709 ms) : 0, 26709

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~5bb561769c, baseline=1.57.0-SNAPSHOT~f2a8d05e73

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.082 s) : 0, 1081781
Total [baseline] (10.817 s) : 0, 10817436
Agent [candidate] (1.089 s) : 0, 1088735
Total [candidate] (10.78 s) : 0, 10780192
section appsec
Agent [baseline] (1.257 s) : 0, 1257484
Total [baseline] (11.092 s) : 0, 11091689
Agent [candidate] (1.27 s) : 0, 1270085
Total [candidate] (11.049 s) : 0, 11049443
section iast
Agent [baseline] (1.22 s) : 0, 1219658
Total [baseline] (11.199 s) : 0, 11199155
Agent [candidate] (1.221 s) : 0, 1220883
Total [candidate] (11.143 s) : 0, 11143499
section profiling
Agent [baseline] (1.203 s) : 0, 1202860
Total [baseline] (11.07 s) : 0, 11070445
Agent [candidate] (1.209 s) : 0, 1209274
Total [candidate] (11.077 s) : 0, 11077242

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.082 s	-
Agent	appsec	1.257 s	175.702 ms (16.2%)
Agent	iast	1.22 s	137.876 ms (12.7%)
Agent	profiling	1.203 s	121.079 ms (11.2%)
Total	tracing	10.817 s	-
Total	appsec	11.092 s	274.253 ms (2.5%)
Total	iast	11.199 s	381.719 ms (3.5%)
Total	profiling	11.07 s	253.009 ms (2.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.089 s	-
Agent	appsec	1.27 s	181.351 ms (16.7%)
Agent	iast	1.221 s	132.149 ms (12.1%)
Agent	profiling	1.209 s	120.54 ms (11.1%)
Total	tracing	10.78 s	-
Total	appsec	11.049 s	269.25 ms (2.5%)
Total	iast	11.143 s	363.306 ms (3.4%)
Total	profiling	11.077 s	297.05 ms (2.8%)

gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~5bb561769c, baseline=1.57.0-SNAPSHOT~f2a8d05e73

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (648.647 ms) : 0, 648647
BytebuddyAgent [candidate] (654.485 ms) : 0, 654485
GlobalTracer [baseline] (281.905 ms) : 0, 281905
GlobalTracer [candidate] (283.559 ms) : 0, 283559
AppSec [baseline] (32.513 ms) : 0, 32513
AppSec [candidate] (32.539 ms) : 0, 32539
Debugger [baseline] (68.549 ms) : 0, 68549
Debugger [candidate] (67.824 ms) : 0, 67824
Remote Config [baseline] (672.589 µs) : 0, 673
Remote Config [candidate] (639.042 µs) : 0, 639
Telemetry [baseline] (9.066 ms) : 0, 9066
Telemetry [candidate] (8.989 ms) : 0, 8989
Flare Poller [baseline] (3.795 ms) : 0, 3795
Flare Poller [candidate] (3.751 ms) : 0, 3751
section appsec
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (685.365 ms) : 0, 685365
BytebuddyAgent [candidate] (693.062 ms) : 0, 693062
GlobalTracer [baseline] (258.194 ms) : 0, 258194
GlobalTracer [candidate] (260.563 ms) : 0, 260563
AppSec [baseline] (173.812 ms) : 0, 173812
AppSec [candidate] (174.321 ms) : 0, 174321
Debugger [baseline] (65.804 ms) : 0, 65804
Debugger [candidate] (66.872 ms) : 0, 66872
Remote Config [baseline] (683.5 µs) : 0, 683
Remote Config [candidate] (717.732 µs) : 0, 718
Telemetry [baseline] (8.991 ms) : 0, 8991
Telemetry [candidate] (8.986 ms) : 0, 8986
Flare Poller [baseline] (3.729 ms) : 0, 3729
Flare Poller [candidate] (3.9 ms) : 0, 3900
IAST [baseline] (24.388 ms) : 0, 24388
IAST [candidate] (24.891 ms) : 0, 24891
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (788.353 ms) : 0, 788353
BytebuddyAgent [candidate] (788.845 ms) : 0, 788845
GlobalTracer [baseline] (254.987 ms) : 0, 254987
GlobalTracer [candidate] (255.561 ms) : 0, 255561
AppSec [baseline] (35.428 ms) : 0, 35428
AppSec [candidate] (35.49 ms) : 0, 35490
Debugger [baseline] (65.245 ms) : 0, 65245
Debugger [candidate] (65.477 ms) : 0, 65477
Remote Config [baseline] (534.041 µs) : 0, 534
Remote Config [candidate] (537.234 µs) : 0, 537
Telemetry [baseline] (8.373 ms) : 0, 8373
Telemetry [candidate] (8.362 ms) : 0, 8362
Flare Poller [baseline] (3.435 ms) : 0, 3435
Flare Poller [candidate] (3.482 ms) : 0, 3482
IAST [baseline] (26.751 ms) : 0, 26751
IAST [candidate] (26.631 ms) : 0, 26631
section profiling
ProfilingAgent [baseline] (97.096 ms) : 0, 97096
ProfilingAgent [candidate] (97.158 ms) : 0, 97158
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (700.847 ms) : 0, 700847
BytebuddyAgent [candidate] (705.262 ms) : 0, 705262
GlobalTracer [baseline] (220.726 ms) : 0, 220726
GlobalTracer [candidate] (221.56 ms) : 0, 221560
AppSec [baseline] (32.194 ms) : 0, 32194
AppSec [candidate] (32.505 ms) : 0, 32505
Debugger [baseline] (67.797 ms) : 0, 67797
Debugger [candidate] (68.364 ms) : 0, 68364
Remote Config [baseline] (639.673 µs) : 0, 640
Remote Config [candidate] (638.945 µs) : 0, 639
Telemetry [baseline] (9.051 ms) : 0, 9051
Telemetry [candidate] (9.021 ms) : 0, 9021
Flare Poller [baseline] (3.8 ms) : 0, 3800
Flare Poller [candidate] (3.804 ms) : 0, 3804
Profiling [baseline] (97.676 ms) : 0, 97676
Profiling [candidate] (97.74 ms) : 0, 97740

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-muzzle-test-fixed
git_commit_date	1765481941	1765487855
git_commit_sha	`f2a8d05`	`5bb5617`
release_version	1.57.0-SNAPSHOT~f2a8d05e73	1.57.0-SNAPSHOT~5bb561769c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765498035	1765498035
ci_job_id	1289419367	1289419367
ci_pipeline_id	86376546	86376546
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-7aco7b79 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-7aco7b79 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 19 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:iast:high_load	worse [+352.406µs; +1274.125µs] or [+2.049%; +7.408%]	unsure [+0.411ms; +1.915ms] or [+1.457%; +6.782%]	unstable [-39.089op/s; +16.651op/s] or [-14.745%; +6.281%]	18.012ms	29.401ms	253.875op/s	17.199ms	28.238ms	265.094op/s
scenario:load:petclinic:appsec:high_load	worse [+458.123µs; +1252.732µs] or [+2.516%; +6.879%]	unsure [+60.974µs; +1651.512µs] or [+0.205%; +5.551%]	unstable [-37.279op/s; +15.779op/s] or [-14.852%; +6.286%]	19.066ms	30.608ms	240.250op/s	18.211ms	29.752ms	251.000op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~5bb561769c, baseline=1.57.0-SNAPSHOT~f2a8d05e73
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.38 ms) : 19181, 19579
.   : milestone, 19380,
appsec (18.593 ms) : 18405, 18780
.   : milestone, 18593,
code_origins (17.466 ms) : 17294, 17638
.   : milestone, 17466,
iast (17.6 ms) : 17424, 17777
.   : milestone, 17600,
profiling (18.393 ms) : 18211, 18575
.   : milestone, 18393,
tracing (17.777 ms) : 17596, 17957
.   : milestone, 17777,
section candidate
no_agent (19.171 ms) : 18972, 19369
.   : milestone, 19171,
appsec (19.429 ms) : 19233, 19624
.   : milestone, 19429,
code_origins (17.475 ms) : 17302, 17647
.   : milestone, 17475,
iast (18.383 ms) : 18197, 18570
.   : milestone, 18383,
profiling (18.733 ms) : 18548, 18919
.   : milestone, 18733,
tracing (17.599 ms) : 17424, 17773
.   : milestone, 17599,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.38 ms [19.181 ms, 19.579 ms]	-
appsec	18.593 ms [18.405 ms, 18.78 ms]	-787.254 µs (-4.1%)
code_origins	17.466 ms [17.294 ms, 17.638 ms]	-1.914 ms (-9.9%)
iast	17.6 ms [17.424 ms, 17.777 ms]	-1.78 ms (-9.2%)
profiling	18.393 ms [18.211 ms, 18.575 ms]	-986.851 µs (-5.1%)
tracing	17.777 ms [17.596 ms, 17.957 ms]	-1.603 ms (-8.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.171 ms [18.972 ms, 19.369 ms]	-
appsec	19.429 ms [19.233 ms, 19.624 ms]	257.972 µs (1.3%)
code_origins	17.475 ms [17.302 ms, 17.647 ms]	-1.696 ms (-8.8%)
iast	18.383 ms [18.197 ms, 18.57 ms]	-787.403 µs (-4.1%)
profiling	18.733 ms [18.548 ms, 18.919 ms]	-437.355 µs (-2.3%)
tracing	17.599 ms [17.424 ms, 17.773 ms]	-1.572 ms (-8.2%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~5bb561769c, baseline=1.57.0-SNAPSHOT~f2a8d05e73
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.196 ms) : 1185, 1207
.   : milestone, 1196,
iast (3.185 ms) : 3138, 3231
.   : milestone, 3185,
iast_FULL (5.827 ms) : 5769, 5884
.   : milestone, 5827,
iast_GLOBAL (3.627 ms) : 3567, 3687
.   : milestone, 3627,
profiling (1.959 ms) : 1942, 1976
.   : milestone, 1959,
tracing (1.782 ms) : 1768, 1796
.   : milestone, 1782,
section candidate
no_agent (1.217 ms) : 1205, 1229
.   : milestone, 1217,
iast (3.216 ms) : 3178, 3254
.   : milestone, 3216,
iast_FULL (5.776 ms) : 5717, 5834
.   : milestone, 5776,
iast_GLOBAL (3.626 ms) : 3573, 3679
.   : milestone, 3626,
profiling (1.916 ms) : 1899, 1932
.   : milestone, 1916,
tracing (1.833 ms) : 1818, 1848
.   : milestone, 1833,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.196 ms [1.185 ms, 1.207 ms]	-
iast	3.185 ms [3.138 ms, 3.231 ms]	1.989 ms (166.3%)
iast_FULL	5.827 ms [5.769 ms, 5.884 ms]	4.631 ms (387.3%)
iast_GLOBAL	3.627 ms [3.567 ms, 3.687 ms]	2.431 ms (203.3%)
profiling	1.959 ms [1.942 ms, 1.976 ms]	763.254 µs (63.8%)
tracing	1.782 ms [1.768 ms, 1.796 ms]	586.334 µs (49.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.217 ms [1.205 ms, 1.229 ms]	-
iast	3.216 ms [3.178 ms, 3.254 ms]	1.999 ms (164.3%)
iast_FULL	5.776 ms [5.717 ms, 5.834 ms]	4.559 ms (374.6%)
iast_GLOBAL	3.626 ms [3.573 ms, 3.679 ms]	2.409 ms (198.0%)
profiling	1.916 ms [1.899 ms, 1.932 ms]	698.807 µs (57.4%)
tracing	1.833 ms [1.818 ms, 1.848 ms]	616.073 µs (50.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-muzzle-test-fixed
git_commit_date	1765481941	1765487855
git_commit_sha	`f2a8d05`	`5bb5617`
release_version	1.57.0-SNAPSHOT~f2a8d05e73	1.57.0-SNAPSHOT~5bb561769c

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1765497625	1765497625
ci_job_id	1289419371	1289419371
ci_pipeline_id	86376546	86376546
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-j2qmpxiy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-j2qmpxiy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~5bb561769c, baseline=1.57.0-SNAPSHOT~f2a8d05e73
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1495
.   : milestone, 1483,
appsec (3.753 ms) : 3532, 3974
.   : milestone, 3753,
iast (2.24 ms) : 2175, 2305
.   : milestone, 2240,
iast_GLOBAL (2.277 ms) : 2212, 2343
.   : milestone, 2277,
profiling (2.092 ms) : 2039, 2146
.   : milestone, 2092,
tracing (2.075 ms) : 2023, 2126
.   : milestone, 2075,
section candidate
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (3.771 ms) : 3549, 3992
.   : milestone, 3771,
iast (2.233 ms) : 2168, 2298
.   : milestone, 2233,
iast_GLOBAL (2.282 ms) : 2216, 2347
.   : milestone, 2282,
profiling (2.086 ms) : 2033, 2138
.   : milestone, 2086,
tracing (2.068 ms) : 2016, 2119
.   : milestone, 2068,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.483 ms [1.471 ms, 1.495 ms]	-
appsec	3.753 ms [3.532 ms, 3.974 ms]	2.27 ms (153.1%)
iast	2.24 ms [2.175 ms, 2.305 ms]	757.372 µs (51.1%)
iast_GLOBAL	2.277 ms [2.212 ms, 2.343 ms]	794.094 µs (53.5%)
profiling	2.092 ms [2.039 ms, 2.146 ms]	609.468 µs (41.1%)
tracing	2.075 ms [2.023 ms, 2.126 ms]	591.569 µs (39.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.475 ms, 1.498 ms]	-
appsec	3.771 ms [3.549 ms, 3.992 ms]	2.284 ms (153.6%)
iast	2.233 ms [2.168 ms, 2.298 ms]	746.013 µs (50.2%)
iast_GLOBAL	2.282 ms [2.216 ms, 2.347 ms]	794.885 µs (53.5%)
profiling	2.086 ms [2.033 ms, 2.138 ms]	598.875 µs (40.3%)
tracing	2.068 ms [2.016 ms, 2.119 ms]	580.89 µs (39.1%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~5bb561769c, baseline=1.57.0-SNAPSHOT~f2a8d05e73
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.758 s) : 14758000, 14758000
.   : milestone, 14758000,
appsec (14.835 s) : 14835000, 14835000
.   : milestone, 14835000,
iast (18.173 s) : 18173000, 18173000
.   : milestone, 18173000,
iast_GLOBAL (17.732 s) : 17732000, 17732000
.   : milestone, 17732000,
profiling (14.566 s) : 14566000, 14566000
.   : milestone, 14566000,
tracing (14.922 s) : 14922000, 14922000
.   : milestone, 14922000,
section candidate
no_agent (15.313 s) : 15313000, 15313000
.   : milestone, 15313000,
appsec (14.88 s) : 14880000, 14880000
.   : milestone, 14880000,
iast (18.436 s) : 18436000, 18436000
.   : milestone, 18436000,
iast_GLOBAL (17.81 s) : 17810000, 17810000
.   : milestone, 17810000,
profiling (15.081 s) : 15081000, 15081000
.   : milestone, 15081000,
tracing (14.777 s) : 14777000, 14777000
.   : milestone, 14777000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.758 s [14.758 s, 14.758 s]	-
appsec	14.835 s [14.835 s, 14.835 s]	77.0 ms (0.5%)
iast	18.173 s [18.173 s, 18.173 s]	3.415 s (23.1%)
iast_GLOBAL	17.732 s [17.732 s, 17.732 s]	2.974 s (20.2%)
profiling	14.566 s [14.566 s, 14.566 s]	-192.0 ms (-1.3%)
tracing	14.922 s [14.922 s, 14.922 s]	164.0 ms (1.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.313 s [15.313 s, 15.313 s]	-
appsec	14.88 s [14.88 s, 14.88 s]	-433.0 ms (-2.8%)
iast	18.436 s [18.436 s, 18.436 s]	3.123 s (20.4%)
iast_GLOBAL	17.81 s [17.81 s, 17.81 s]	2.497 s (16.3%)
profiling	15.081 s [15.081 s, 15.081 s]	-232.0 ms (-1.5%)
tracing	14.777 s [14.777 s, 14.777 s]	-536.0 ms (-3.5%)

Fixed flaky muzzle test for jersy-client-2.0 instrumentation

5bb5617

AlexeyKuznetsov-DD requested review from amarziali, bric3, mcculls and sarahchen6 December 11, 2025 21:29

AlexeyKuznetsov-DD self-assigned this Dec 11, 2025

AlexeyKuznetsov-DD added type: bug Bug report and fix inst: others All other instrumentations labels Dec 11, 2025

AlexeyKuznetsov-DD temporarily deployed to ci-build December 11, 2025 21:29 — with GitHub Actions Inactive

AlexeyKuznetsov-DD marked this pull request as ready for review December 11, 2025 21:29

AlexeyKuznetsov-DD requested a review from a team as a code owner December 11, 2025 21:29

PerfectSlayer approved these changes Dec 12, 2025

View reviewed changes

AlexeyKuznetsov-DD merged commit ce2b2fe into master Dec 12, 2025
718 of 720 checks passed

AlexeyKuznetsov-DD deleted the alexeyk/flaky-muzzle-test-fixed branch December 12, 2025 12:58

github-actions bot added this to the 1.57.0 milestone Dec 12, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fixed flaky muzzle test for jersy-client-2.0 instrumentation#10175

Fixed flaky muzzle test for jersy-client-2.0 instrumentation#10175
AlexeyKuznetsov-DD merged 1 commit intomasterfrom
alexeyk/flaky-muzzle-test-fixed

AlexeyKuznetsov-DD commented Dec 11, 2025

Uh oh!

pr-commenter bot commented Dec 11, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

AlexeyKuznetsov-DD commented Dec 11, 2025

What Does This Do

Motivation

Additional Notes

Uh oh!

pr-commenter bot commented Dec 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

pr-commenter bot commented Dec 11, 2025 •

edited

Loading