Ensure minimum number of fuzz tests on TagsMap#9385
Merged
Conversation
mcculls
reviewed
Aug 19, 2025
mcculls
approved these changes
Aug 19, 2025
Contributor
mcculls
left a comment
There was a problem hiding this comment.
Appreciate the related cleanup!
|
Code coverage: total 57.49%, base diff 0.05%, patch 100.00% (view details) This comment will be updated automatically if new data arrives.🔗 Commit SHA: 5c97107 | Docs | Was this helpful? Give us feedback! |
PerfectSlayer
approved these changes
Aug 19, 2025
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~5c971073d1, baseline=1.53.0-SNAPSHOT~1f3544809f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1047352
Total [baseline] (8.617 s) : 0, 8617024
Agent [candidate] (1.057 s) : 0, 1057274
Total [candidate] (8.625 s) : 0, 8624689
section iast
Agent [baseline] (1.179 s) : 0, 1179316
Total [baseline] (9.303 s) : 0, 9303492
Agent [candidate] (1.19 s) : 0, 1189905
Total [candidate] (9.299 s) : 0, 9299194
gantt
title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~5c971073d1, baseline=1.53.0-SNAPSHOT~1f3544809f
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.48 ms) : 0, 1480
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (733.509 ms) : 0, 733509
BytebuddyAgent [candidate] (738.231 ms) : 0, 738231
GlobalTracer [baseline] (242.818 ms) : 0, 242818
GlobalTracer [candidate] (244.146 ms) : 0, 244146
AppSec [baseline] (30.114 ms) : 0, 30114
AppSec [candidate] (30.302 ms) : 0, 30302
Debugger [baseline] (6.049 ms) : 0, 6049
Debugger [candidate] (6.094 ms) : 0, 6094
Remote Config [baseline] (674.73 µs) : 0, 675
Remote Config [candidate] (675.053 µs) : 0, 675
Telemetry [baseline] (11.661 ms) : 0, 11661
Telemetry [candidate] (15.19 ms) : 0, 15190
section iast
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (850.578 ms) : 0, 850578
BytebuddyAgent [candidate] (859.023 ms) : 0, 859023
GlobalTracer [baseline] (233.261 ms) : 0, 233261
GlobalTracer [candidate] (234.866 ms) : 0, 234866
IAST [baseline] (30.623 ms) : 0, 30623
IAST [candidate] (30.745 ms) : 0, 30745
AppSec [baseline] (27.724 ms) : 0, 27724
AppSec [candidate] (27.786 ms) : 0, 27786
Debugger [baseline] (5.768 ms) : 0, 5768
Debugger [candidate] (5.831 ms) : 0, 5831
Remote Config [baseline] (612.683 µs) : 0, 613
Remote Config [candidate] (604.34 µs) : 0, 604
Telemetry [baseline] (8.364 ms) : 0, 8364
Telemetry [candidate] (8.472 ms) : 0, 8472
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~5c971073d1, baseline=1.53.0-SNAPSHOT~1f3544809f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1046039
Total [baseline] (10.64 s) : 0, 10639933
Agent [candidate] (1.048 s) : 0, 1048350
Total [candidate] (10.728 s) : 0, 10728132
section appsec
Agent [baseline] (1.235 s) : 0, 1235471
Total [baseline] (10.764 s) : 0, 10764333
Agent [candidate] (1.23 s) : 0, 1230159
Total [candidate] (10.709 s) : 0, 10709179
section iast
Agent [baseline] (1.181 s) : 0, 1180753
Total [baseline] (10.885 s) : 0, 10884976
Agent [candidate] (1.182 s) : 0, 1182098
Total [candidate] (10.967 s) : 0, 10967420
section profiling
Agent [baseline] (1.194 s) : 0, 1194003
Total [baseline] (10.904 s) : 0, 10903530
Agent [candidate] (1.199 s) : 0, 1199111
Total [candidate] (10.892 s) : 0, 10891632
gantt
title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~5c971073d1, baseline=1.53.0-SNAPSHOT~1f3544809f
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (731.416 ms) : 0, 731416
BytebuddyAgent [candidate] (731.972 ms) : 0, 731972
GlobalTracer [baseline] (242.259 ms) : 0, 242259
GlobalTracer [candidate] (242.539 ms) : 0, 242539
AppSec [baseline] (30.09 ms) : 0, 30090
AppSec [candidate] (30.256 ms) : 0, 30256
Debugger [baseline] (6.099 ms) : 0, 6099
Debugger [candidate] (6.075 ms) : 0, 6075
Remote Config [baseline] (689.915 µs) : 0, 690
Remote Config [candidate] (675.457 µs) : 0, 675
Telemetry [baseline] (13.004 ms) : 0, 13004
Telemetry [candidate] (14.326 ms) : 0, 14326
section appsec
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (763.9 ms) : 0, 763900
BytebuddyAgent [candidate] (760.517 ms) : 0, 760517
GlobalTracer [baseline] (237.482 ms) : 0, 237482
GlobalTracer [candidate] (236.667 ms) : 0, 236667
IAST [baseline] (23.961 ms) : 0, 23961
IAST [candidate] (23.69 ms) : 0, 23690
AppSec [baseline] (170.114 ms) : 0, 170114
AppSec [candidate] (170.238 ms) : 0, 170238
Debugger [baseline] (8.174 ms) : 0, 8174
Debugger [candidate] (7.285 ms) : 0, 7285
Remote Config [baseline] (653.877 µs) : 0, 654
Remote Config [candidate] (640.522 µs) : 0, 641
Telemetry [baseline] (8.472 ms) : 0, 8472
Telemetry [candidate] (8.42 ms) : 0, 8420
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (852.255 ms) : 0, 852255
BytebuddyAgent [candidate] (852.713 ms) : 0, 852713
GlobalTracer [baseline] (233.347 ms) : 0, 233347
GlobalTracer [candidate] (233.836 ms) : 0, 233836
IAST [baseline] (30.187 ms) : 0, 30187
IAST [candidate] (32.099 ms) : 0, 32099
AppSec [baseline] (27.831 ms) : 0, 27831
AppSec [candidate] (24.372 ms) : 0, 24372
Debugger [baseline] (5.718 ms) : 0, 5718
Debugger [candidate] (7.555 ms) : 0, 7555
Remote Config [baseline] (613.819 µs) : 0, 614
Remote Config [candidate] (605.579 µs) : 0, 606
Telemetry [baseline] (8.316 ms) : 0, 8316
Telemetry [candidate] (8.347 ms) : 0, 8347
section profiling
crashtracking [baseline] (1.421 ms) : 0, 1421
crashtracking [candidate] (1.424 ms) : 0, 1424
BytebuddyAgent [baseline] (760.696 ms) : 0, 760696
BytebuddyAgent [candidate] (764.749 ms) : 0, 764749
GlobalTracer [baseline] (221.905 ms) : 0, 221905
GlobalTracer [candidate] (221.606 ms) : 0, 221606
AppSec [baseline] (30.799 ms) : 0, 30799
AppSec [candidate] (29.965 ms) : 0, 29965
Debugger [baseline] (7.012 ms) : 0, 7012
Debugger [candidate] (6.243 ms) : 0, 6243
Remote Config [baseline] (686.304 µs) : 0, 686
Remote Config [candidate] (706.408 µs) : 0, 706
Telemetry [baseline] (14.804 ms) : 0, 14804
Telemetry [candidate] (16.25 ms) : 0, 16250
ProfilingAgent [baseline] (107.158 ms) : 0, 107158
ProfilingAgent [candidate] (108.314 ms) : 0, 108314
Profiling [baseline] (107.807 ms) : 0, 107807
Profiling [candidate] (108.971 ms) : 0, 108971
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 3 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~5c971073d1, baseline=1.53.0-SNAPSHOT~1f3544809f
dateFormat X
axisFormat %s
section baseline
no_agent (4.276 ms) : 4220, 4333
. : milestone, 4276,
iast (9.202 ms) : 9048, 9356
. : milestone, 9202,
iast_FULL (14.06 ms) : 13779, 14341
. : milestone, 14060,
iast_GLOBAL (9.943 ms) : 9773, 10114
. : milestone, 9943,
profiling (8.517 ms) : 8386, 8648
. : milestone, 8517,
tracing (7.906 ms) : 7779, 8034
. : milestone, 7906,
section candidate
no_agent (4.455 ms) : 4404, 4506
. : milestone, 4455,
iast (9.282 ms) : 9114, 9449
. : milestone, 9282,
iast_FULL (14.336 ms) : 14040, 14631
. : milestone, 14336,
iast_GLOBAL (10.174 ms) : 9997, 10351
. : milestone, 10174,
profiling (8.666 ms) : 8519, 8812
. : milestone, 8666,
tracing (7.473 ms) : 7361, 7585
. : milestone, 7473,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~5c971073d1, baseline=1.53.0-SNAPSHOT~1f3544809f
dateFormat X
axisFormat %s
section baseline
no_agent (36.762 ms) : 36466, 37057
. : milestone, 36762,
appsec (46.858 ms) : 46440, 47276
. : milestone, 46858,
code_origins (46.801 ms) : 46401, 47201
. : milestone, 46801,
iast (43.01 ms) : 42643, 43376
. : milestone, 43010,
profiling (46.862 ms) : 46444, 47280
. : milestone, 46862,
tracing (43.948 ms) : 43561, 44335
. : milestone, 43948,
section candidate
no_agent (37.202 ms) : 36904, 37501
. : milestone, 37202,
appsec (48.32 ms) : 47884, 48756
. : milestone, 48320,
code_origins (43.977 ms) : 43596, 44357
. : milestone, 43977,
iast (43.065 ms) : 42687, 43443
. : milestone, 43065,
profiling (46.848 ms) : 46432, 47264
. : milestone, 46848,
tracing (45.936 ms) : 45524, 46348
. : milestone, 45936,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~5c971073d1, baseline=1.53.0-SNAPSHOT~1f3544809f
dateFormat X
axisFormat %s
section baseline
no_agent (15.494 s) : 15494000, 15494000
. : milestone, 15494000,
appsec (14.992 s) : 14992000, 14992000
. : milestone, 14992000,
iast (18.673 s) : 18673000, 18673000
. : milestone, 18673000,
iast_GLOBAL (18.099 s) : 18099000, 18099000
. : milestone, 18099000,
profiling (15.645 s) : 15645000, 15645000
. : milestone, 15645000,
tracing (14.947 s) : 14947000, 14947000
. : milestone, 14947000,
section candidate
no_agent (15.001 s) : 15001000, 15001000
. : milestone, 15001000,
appsec (14.803 s) : 14803000, 14803000
. : milestone, 14803000,
iast (18.17 s) : 18170000, 18170000
. : milestone, 18170000,
iast_GLOBAL (17.922 s) : 17922000, 17922000
. : milestone, 17922000,
profiling (15.455 s) : 15455000, 15455000
. : milestone, 15455000,
tracing (14.914 s) : 14914000, 14914000
. : milestone, 14914000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~5c971073d1, baseline=1.53.0-SNAPSHOT~1f3544809f
dateFormat X
axisFormat %s
section baseline
no_agent (1.48 ms) : 1469, 1492
. : milestone, 1480,
appsec (3.694 ms) : 3475, 3912
. : milestone, 3694,
iast (2.223 ms) : 2159, 2286
. : milestone, 2223,
iast_GLOBAL (2.255 ms) : 2191, 2318
. : milestone, 2255,
profiling (2.104 ms) : 2050, 2159
. : milestone, 2104,
tracing (2.036 ms) : 1987, 2086
. : milestone, 2036,
section candidate
no_agent (1.482 ms) : 1470, 1494
. : milestone, 1482,
appsec (3.677 ms) : 3460, 3894
. : milestone, 3677,
iast (2.221 ms) : 2158, 2284
. : milestone, 2221,
iast_GLOBAL (2.257 ms) : 2194, 2321
. : milestone, 2257,
profiling (2.079 ms) : 2027, 2132
. : milestone, 2079,
tracing (2.042 ms) : 1992, 2092
. : milestone, 2042,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
There are CI failure because of
They are not deterministic also because the TagMapFuzzTest is creating coverage based on random actions so also the coverage is not deterministic.
Better covering TagMap is looking a bigger effort that just trying to always have test enough done by the fuzz test.
This PR tries to put low bundaries on actions done by the fuzz test in order to minimize the probability to have low coverage.
I also cleaned up a bit the code according to IDE suggestions (i.e. remove unnecessary final modifier)
Motivation
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]