Fix the flaky StackedOperatorsTest on CI #9648

ygree · 2025-10-01T19:14:44Z

What Does This Do

Resolve the issue with the StackedOperatorsTest being flaky by removing the subscribe spans. This is because their parent may be either the connect parent or the upstream parent, both of which may fluctuate when executed with a concurrent scheduler.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-10-01T19:48:58Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/resilience4j-flaky-test
git_commit_date	1761241658	1761243164
git_commit_sha	`9f0225c`	`ca66190`
release_version	1.55.0-SNAPSHOT~9f0225c968	1.55.0-SNAPSHOT~ca66190ab3

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761244954	1761244954
ci_job_id	1194690571	1194690571
ci_pipeline_id	80131607	80131607
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-njvkzk9i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-njvkzk9i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 12 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~ca66190ab3, baseline=1.55.0-SNAPSHOT~9f0225c968

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1047362
Total [baseline] (10.868 s) : 0, 10867617
Agent [candidate] (1.026 s) : 0, 1026466
Total [candidate] (10.801 s) : 0, 10801211
section appsec
Agent [baseline] (1.202 s) : 0, 1201838
Total [baseline] (11.015 s) : 0, 11015018
Agent [candidate] (1.212 s) : 0, 1211660
Total [candidate] (10.972 s) : 0, 10971817
section iast
Agent [baseline] (1.16 s) : 0, 1159607
Total [baseline] (11.07 s) : 0, 11069912
Agent [candidate] (1.159 s) : 0, 1159409
Total [candidate] (11.143 s) : 0, 11143134
section profiling
Agent [baseline] (1.188 s) : 0, 1188085
Total [baseline] (11.09 s) : 0, 11089658
Agent [candidate] (1.173 s) : 0, 1173229
Total [candidate] (10.958 s) : 0, 10957510

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.047 s	-
Agent	appsec	1.202 s	154.476 ms (14.7%)
Agent	iast	1.16 s	112.244 ms (10.7%)
Agent	profiling	1.188 s	140.722 ms (13.4%)
Total	tracing	10.868 s	-
Total	appsec	11.015 s	147.401 ms (1.4%)
Total	iast	11.07 s	202.295 ms (1.9%)
Total	profiling	11.09 s	222.042 ms (2.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.026 s	-
Agent	appsec	1.212 s	185.193 ms (18.0%)
Agent	iast	1.159 s	132.942 ms (13.0%)
Agent	profiling	1.173 s	146.763 ms (14.3%)
Total	tracing	10.801 s	-
Total	appsec	10.972 s	170.606 ms (1.6%)
Total	iast	11.143 s	341.923 ms (3.2%)
Total	profiling	10.958 s	156.299 ms (1.4%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~ca66190ab3, baseline=1.55.0-SNAPSHOT~9f0225c968

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.5 ms) : 0, 1500
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (715.095 ms) : 0, 715095
BytebuddyAgent [candidate] (699.863 ms) : 0, 699863
GlobalTracer [baseline] (248.803 ms) : 0, 248803
GlobalTracer [candidate] (244.218 ms) : 0, 244218
AppSec [baseline] (32.766 ms) : 0, 32766
AppSec [candidate] (32.132 ms) : 0, 32132
Debugger [baseline] (6.547 ms) : 0, 6547
Debugger [candidate] (6.372 ms) : 0, 6372
Remote Config [baseline] (692.038 µs) : 0, 692
Remote Config [candidate] (685.7 µs) : 0, 686
Telemetry [baseline] (13.869 ms) : 0, 13869
Telemetry [candidate] (12.804 ms) : 0, 12804
Flare Poller [baseline] (6.509 ms) : 0, 6509
Flare Poller [candidate] (7.789 ms) : 0, 7789
section appsec
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (725.657 ms) : 0, 725657
BytebuddyAgent [candidate] (732.17 ms) : 0, 732170
GlobalTracer [baseline] (235.75 ms) : 0, 235750
GlobalTracer [candidate] (237.436 ms) : 0, 237436
IAST [baseline] (24.837 ms) : 0, 24837
IAST [candidate] (25.279 ms) : 0, 25279
AppSec [baseline] (174.233 ms) : 0, 174233
AppSec [candidate] (175.111 ms) : 0, 175111
Debugger [baseline] (5.875 ms) : 0, 5875
Debugger [candidate] (5.926 ms) : 0, 5926
Remote Config [baseline] (625.442 µs) : 0, 625
Remote Config [candidate] (628.399 µs) : 0, 628
Telemetry [baseline] (8.351 ms) : 0, 8351
Telemetry [candidate] (8.423 ms) : 0, 8423
Flare Poller [baseline] (3.918 ms) : 0, 3918
Flare Poller [candidate] (3.902 ms) : 0, 3902
section iast
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (822.46 ms) : 0, 822460
BytebuddyAgent [candidate] (822.276 ms) : 0, 822276
GlobalTracer [baseline] (233.611 ms) : 0, 233611
GlobalTracer [candidate] (233.903 ms) : 0, 233903
IAST [baseline] (32.603 ms) : 0, 32603
IAST [candidate] (31.594 ms) : 0, 31594
AppSec [baseline] (28.769 ms) : 0, 28769
AppSec [candidate] (29.633 ms) : 0, 29633
Debugger [baseline] (6.166 ms) : 0, 6166
Debugger [candidate] (6.115 ms) : 0, 6115
Remote Config [baseline] (594.796 µs) : 0, 595
Remote Config [candidate] (593.032 µs) : 0, 593
Telemetry [baseline] (8.471 ms) : 0, 8471
Telemetry [candidate] (8.429 ms) : 0, 8429
Flare Poller [baseline] (4.152 ms) : 0, 4152
Flare Poller [candidate] (4.108 ms) : 0, 4108
section profiling
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (733.281 ms) : 0, 733281
BytebuddyAgent [candidate] (726.526 ms) : 0, 726526
GlobalTracer [baseline] (224.172 ms) : 0, 224172
GlobalTracer [candidate] (220.456 ms) : 0, 220456
AppSec [baseline] (34.724 ms) : 0, 34724
AppSec [candidate] (32.298 ms) : 0, 32298
Debugger [baseline] (12.339 ms) : 0, 12339
Debugger [candidate] (12.898 ms) : 0, 12898
Remote Config [baseline] (721.388 µs) : 0, 721
Remote Config [candidate] (697.475 µs) : 0, 697
Telemetry [baseline] (9.175 ms) : 0, 9175
Telemetry [candidate] (9.736 ms) : 0, 9736
Flare Poller [baseline] (4.213 ms) : 0, 4213
Flare Poller [candidate] (4.127 ms) : 0, 4127
ProfilingAgent [baseline] (111.902 ms) : 0, 111902
ProfilingAgent [candidate] (109.712 ms) : 0, 109712
Profiling [baseline] (112.568 ms) : 0, 112568
Profiling [candidate] (110.331 ms) : 0, 110331

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~ca66190ab3, baseline=1.55.0-SNAPSHOT~9f0225c968

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1050510
Total [baseline] (8.714 s) : 0, 8713866
Agent [candidate] (1.028 s) : 0, 1027775
Total [candidate] (8.683 s) : 0, 8683340
section iast
Agent [baseline] (1.166 s) : 0, 1166309
Total [baseline] (9.382 s) : 0, 9381675
Agent [candidate] (1.16 s) : 0, 1159627
Total [candidate] (9.361 s) : 0, 9361259

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	iast	1.166 s	115.799 ms (11.0%)
Total	tracing	8.714 s	-
Total	iast	9.382 s	667.809 ms (7.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.028 s	-
Agent	iast	1.16 s	131.852 ms (12.8%)
Total	tracing	8.683 s	-
Total	iast	9.361 s	677.918 ms (7.8%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~ca66190ab3, baseline=1.55.0-SNAPSHOT~9f0225c968

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.496 ms) : 0, 1496
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (716.742 ms) : 0, 716742
BytebuddyAgent [candidate] (700.8 ms) : 0, 700800
GlobalTracer [baseline] (248.91 ms) : 0, 248910
GlobalTracer [candidate] (244.47 ms) : 0, 244470
AppSec [baseline] (33.11 ms) : 0, 33110
AppSec [candidate] (32.143 ms) : 0, 32143
Debugger [baseline] (6.639 ms) : 0, 6639
Debugger [candidate] (6.353 ms) : 0, 6353
Remote Config [baseline] (698.276 µs) : 0, 698
Remote Config [candidate] (674.204 µs) : 0, 674
Telemetry [baseline] (12.514 ms) : 0, 12514
Telemetry [candidate] (15.103 ms) : 0, 15103
Flare Poller [baseline] (8.833 ms) : 0, 8833
Flare Poller [candidate] (5.636 ms) : 0, 5636
section iast
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (827.367 ms) : 0, 827367
BytebuddyAgent [candidate] (822.375 ms) : 0, 822375
GlobalTracer [baseline] (234.609 ms) : 0, 234609
GlobalTracer [candidate] (233.655 ms) : 0, 233655
AppSec [baseline] (31.671 ms) : 0, 31671
AppSec [candidate] (29.942 ms) : 0, 29942
Debugger [baseline] (6.109 ms) : 0, 6109
Debugger [candidate] (6.088 ms) : 0, 6088
Remote Config [baseline] (616.236 µs) : 0, 616
Remote Config [candidate] (597.918 µs) : 0, 598
Telemetry [baseline] (8.473 ms) : 0, 8473
Telemetry [candidate] (8.425 ms) : 0, 8425
Flare Poller [baseline] (4.229 ms) : 0, 4229
Flare Poller [candidate] (4.139 ms) : 0, 4139
IAST [baseline] (30.274 ms) : 0, 30274
IAST [candidate] (31.673 ms) : 0, 31673

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/resilience4j-flaky-test
git_commit_date	1761241658	1761243164
git_commit_sha	`9f0225c`	`ca66190`
release_version	1.55.0-SNAPSHOT~9f0225c968	1.55.0-SNAPSHOT~ca66190ab3

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761244706	1761244706
ci_job_id	1194690572	1194690572
ci_pipeline_id	80131607	80131607
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-sk5jxws7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-sk5jxws7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+269.883µs; +677.083µs] or [+2.602%; +6.528%]	unstable [-71.982op/s; +33.170op/s] or [-16.063%; +7.402%]	10.845ms	428.719op/s	10.372ms	448.125op/s
scenario:load:insecure-bank:iast_FULL:high_load	worse [+486.890µs; +1100.438µs] or [+3.472%; +7.847%]	unstable [-53.912op/s; +18.662op/s] or [-16.226%; +5.617%]	14.817ms	314.625op/s	14.023ms	332.250op/s
scenario:load:petclinic:no_agent:high_load	worse [+1.818ms; +2.452ms] or [+5.031%; +6.785%]	unstable [-17.703op/s; -0.022op/s] or [-13.513%; -0.017%]	38.274ms	122.150op/s	36.139ms	131.013op/s
scenario:load:petclinic:appsec:high_load	better [-2.577ms; -1.641ms] or [-5.265%; -3.352%]	unstable [-4.308op/s; +10.436op/s] or [-4.448%; +10.776%]	46.841ms	99.912op/s	48.950ms	96.848op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~ca66190ab3, baseline=1.55.0-SNAPSHOT~9f0225c968
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.139 ms) : 35854, 36424
.   : milestone, 36139,
appsec (48.95 ms) : 48506, 49393
.   : milestone, 48950,
code_origins (42.896 ms) : 42530, 43262
.   : milestone, 42896,
iast (46.117 ms) : 45725, 46510
.   : milestone, 46117,
profiling (47.794 ms) : 47378, 48210
.   : milestone, 47794,
tracing (43.18 ms) : 42818, 43542
.   : milestone, 43180,
section candidate
no_agent (38.274 ms) : 37970, 38578
.   : milestone, 38274,
appsec (46.841 ms) : 46414, 47267
.   : milestone, 46841,
code_origins (43.97 ms) : 43579, 44361
.   : milestone, 43970,
iast (45.077 ms) : 44673, 45481
.   : milestone, 45077,
profiling (48.729 ms) : 48288, 49169
.   : milestone, 48729,
tracing (44.18 ms) : 43785, 44575
.   : milestone, 44180,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.139 ms [35.854 ms, 36.424 ms]	-
appsec	48.95 ms [48.506 ms, 49.393 ms]	12.811 ms (35.4%)
code_origins	42.896 ms [42.53 ms, 43.262 ms]	6.757 ms (18.7%)
iast	46.117 ms [45.725 ms, 46.51 ms]	9.979 ms (27.6%)
profiling	47.794 ms [47.378 ms, 48.21 ms]	11.655 ms (32.3%)
tracing	43.18 ms [42.818 ms, 43.542 ms]	7.041 ms (19.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	38.274 ms [37.97 ms, 38.578 ms]	-
appsec	46.841 ms [46.414 ms, 47.267 ms]	8.567 ms (22.4%)
code_origins	43.97 ms [43.579 ms, 44.361 ms]	5.696 ms (14.9%)
iast	45.077 ms [44.673 ms, 45.481 ms]	6.803 ms (17.8%)
profiling	48.729 ms [48.288 ms, 49.169 ms]	10.455 ms (27.3%)
tracing	44.18 ms [43.785 ms, 44.575 ms]	5.906 ms (15.4%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~ca66190ab3, baseline=1.55.0-SNAPSHOT~9f0225c968
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.321 ms) : 4267, 4376
.   : milestone, 4321,
iast (9.977 ms) : 9809, 10145
.   : milestone, 9977,
iast_FULL (14.023 ms) : 13746, 14301
.   : milestone, 14023,
iast_GLOBAL (10.372 ms) : 10187, 10556
.   : milestone, 10372,
profiling (9.006 ms) : 8855, 9156
.   : milestone, 9006,
tracing (8.003 ms) : 7883, 8123
.   : milestone, 8003,
section candidate
no_agent (4.425 ms) : 4376, 4475
.   : milestone, 4425,
iast (9.768 ms) : 9600, 9936
.   : milestone, 9768,
iast_FULL (14.817 ms) : 14524, 15109
.   : milestone, 14817,
iast_GLOBAL (10.845 ms) : 10651, 11039
.   : milestone, 10845,
profiling (9.013 ms) : 8866, 9161
.   : milestone, 9013,
tracing (7.965 ms) : 7851, 8078
.   : milestone, 7965,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.321 ms [4.267 ms, 4.376 ms]	-
iast	9.977 ms [9.809 ms, 10.145 ms]	5.656 ms (130.9%)
iast_FULL	14.023 ms [13.746 ms, 14.301 ms]	9.702 ms (224.5%)
iast_GLOBAL	10.372 ms [10.187 ms, 10.556 ms]	6.05 ms (140.0%)
profiling	9.006 ms [8.855 ms, 9.156 ms]	4.684 ms (108.4%)
tracing	8.003 ms [7.883 ms, 8.123 ms]	3.682 ms (85.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.425 ms [4.376 ms, 4.475 ms]	-
iast	9.768 ms [9.6 ms, 9.936 ms]	5.343 ms (120.7%)
iast_FULL	14.817 ms [14.524 ms, 15.109 ms]	10.392 ms (234.8%)
iast_GLOBAL	10.845 ms [10.651 ms, 11.039 ms]	6.42 ms (145.1%)
profiling	9.013 ms [8.866 ms, 9.161 ms]	4.588 ms (103.7%)
tracing	7.965 ms [7.851 ms, 8.078 ms]	3.539 ms (80.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/resilience4j-flaky-test
git_commit_date	1761241658	1761243164
git_commit_sha	`9f0225c`	`ca66190`
release_version	1.55.0-SNAPSHOT~9f0225c968	1.55.0-SNAPSHOT~ca66190ab3

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1761245222	1761245222
ci_job_id	1194690573	1194690573
ci_pipeline_id	80131607	80131607
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-1yqqzgr0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-1yqqzgr0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~ca66190ab3, baseline=1.55.0-SNAPSHOT~9f0225c968
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.491 s) : 15491000, 15491000
.   : milestone, 15491000,
appsec (14.702 s) : 14702000, 14702000
.   : milestone, 14702000,
iast (18.61 s) : 18610000, 18610000
.   : milestone, 18610000,
iast_GLOBAL (18.273 s) : 18273000, 18273000
.   : milestone, 18273000,
profiling (15.181 s) : 15181000, 15181000
.   : milestone, 15181000,
tracing (15.324 s) : 15324000, 15324000
.   : milestone, 15324000,
section candidate
no_agent (15.483 s) : 15483000, 15483000
.   : milestone, 15483000,
appsec (15.093 s) : 15093000, 15093000
.   : milestone, 15093000,
iast (18.665 s) : 18665000, 18665000
.   : milestone, 18665000,
iast_GLOBAL (18.109 s) : 18109000, 18109000
.   : milestone, 18109000,
profiling (15.453 s) : 15453000, 15453000
.   : milestone, 15453000,
tracing (15.21 s) : 15210000, 15210000
.   : milestone, 15210000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.491 s [15.491 s, 15.491 s]	-
appsec	14.702 s [14.702 s, 14.702 s]	-789.0 ms (-5.1%)
iast	18.61 s [18.61 s, 18.61 s]	3.119 s (20.1%)
iast_GLOBAL	18.273 s [18.273 s, 18.273 s]	2.782 s (18.0%)
profiling	15.181 s [15.181 s, 15.181 s]	-310.0 ms (-2.0%)
tracing	15.324 s [15.324 s, 15.324 s]	-167.0 ms (-1.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.483 s [15.483 s, 15.483 s]	-
appsec	15.093 s [15.093 s, 15.093 s]	-390.0 ms (-2.5%)
iast	18.665 s [18.665 s, 18.665 s]	3.182 s (20.6%)
iast_GLOBAL	18.109 s [18.109 s, 18.109 s]	2.626 s (17.0%)
profiling	15.453 s [15.453 s, 15.453 s]	-30.0 ms (-0.2%)
tracing	15.21 s [15.21 s, 15.21 s]	-273.0 ms (-1.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~ca66190ab3, baseline=1.55.0-SNAPSHOT~9f0225c968
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.486 ms) : 1474, 1498
.   : milestone, 1486,
appsec (3.734 ms) : 3515, 3953
.   : milestone, 3734,
iast (2.229 ms) : 2165, 2292
.   : milestone, 2229,
iast_GLOBAL (2.256 ms) : 2192, 2320
.   : milestone, 2256,
profiling (2.082 ms) : 2030, 2135
.   : milestone, 2082,
tracing (2.033 ms) : 1984, 2082
.   : milestone, 2033,
section candidate
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (3.737 ms) : 3518, 3955
.   : milestone, 3737,
iast (2.214 ms) : 2150, 2277
.   : milestone, 2214,
iast_GLOBAL (2.26 ms) : 2196, 2324
.   : milestone, 2260,
profiling (2.089 ms) : 2036, 2142
.   : milestone, 2089,
tracing (2.032 ms) : 1982, 2081
.   : milestone, 2032,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.486 ms [1.474 ms, 1.498 ms]	-
appsec	3.734 ms [3.515 ms, 3.953 ms]	2.248 ms (151.3%)
iast	2.229 ms [2.165 ms, 2.292 ms]	742.613 µs (50.0%)
iast_GLOBAL	2.256 ms [2.192 ms, 2.32 ms]	770.158 µs (51.8%)
profiling	2.082 ms [2.03 ms, 2.135 ms]	596.474 µs (40.1%)
tracing	2.033 ms [1.984 ms, 2.082 ms]	546.959 µs (36.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.489 ms]	-
appsec	3.737 ms [3.518 ms, 3.955 ms]	2.259 ms (152.9%)
iast	2.214 ms [2.15 ms, 2.277 ms]	735.823 µs (49.8%)
iast_GLOBAL	2.26 ms [2.196 ms, 2.324 ms]	781.906 µs (52.9%)
profiling	2.089 ms [2.036 ms, 2.142 ms]	611.333 µs (41.4%)
tracing	2.032 ms [1.982 ms, 2.081 ms]	554.05 µs (37.5%)

github-actions · 2025-10-22T20:50:40Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

AlexeyKuznetsov-DD

LGTM, but would be nice to have some explanation in PR's description.

ygree self-assigned this Oct 1, 2025

ygree added the tag: flaky test Flaky tests label Oct 1, 2025

This comment has been minimized.

Sign in to view

ygree force-pushed the ygree/resilience4j-flaky-test branch from d49ccdb to 2183ae2 Compare October 22, 2025 20:50

ygree marked this pull request as ready for review October 22, 2025 20:50

ygree requested a review from a team as a code owner October 22, 2025 20:50

ygree added the tag: no release notes Changes to exclude from release notes label Oct 22, 2025

AlexeyKuznetsov-DD approved these changes Oct 22, 2025

View reviewed changes

ygree marked this pull request as draft October 23, 2025 16:13

ygree force-pushed the ygree/resilience4j-flaky-test branch 2 times, most recently from 07e4c13 to 1803b53 Compare October 23, 2025 17:26

Fix flaky test

ca66190

ygree force-pushed the ygree/resilience4j-flaky-test branch from 1803b53 to ca66190 Compare October 23, 2025 18:13

ygree marked this pull request as ready for review October 23, 2025 19:36

ygree changed the title ~~Attempt to fix the flaky StackedOperatorsTest on CI~~ Fix the flaky StackedOperatorsTest on CI Oct 24, 2025

ygree merged commit d0b8d67 into master Oct 24, 2025
542 of 543 checks passed

ygree deleted the ygree/resilience4j-flaky-test branch October 24, 2025 16:11

github-actions bot added this to the 1.55.0 milestone Oct 24, 2025

amarziali pushed a commit that referenced this pull request Oct 27, 2025

Fix flaky test (#9648)

e46b626

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Fix the flaky StackedOperatorsTest on CI #9648

Fix the flaky StackedOperatorsTest on CI #9648

Uh oh!

ygree commented Oct 1, 2025 •

edited

Loading

Uh oh!

This comment has been minimized.

pr-commenter bot commented Oct 1, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Oct 22, 2025 •

edited

Loading

Uh oh!

AlexeyKuznetsov-DD left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Fix the flaky StackedOperatorsTest on CI #9648

Fix the flaky StackedOperatorsTest on CI #9648

Uh oh!

Conversation

ygree commented Oct 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

This comment has been minimized.

pr-commenter bot commented Oct 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

github-actions bot commented Oct 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

AlexeyKuznetsov-DD left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

ygree commented Oct 1, 2025 •

edited

Loading

pr-commenter bot commented Oct 1, 2025 •

edited

Loading

github-actions bot commented Oct 22, 2025 •

edited

Loading