-
Notifications
You must be signed in to change notification settings - Fork 323
Update ignoreif reason for karate tests on jdk 24 #9152
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
+1
−1
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sarahchen6
commented
Jul 10, 2025
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 44 metrics, 9 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~9b84d015b2, baseline=1.52.0-SNAPSHOT~ad6d6b9786
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.001 s) : 0, 1000867
Total [baseline] (10.655 s) : 0, 10655272
Agent [candidate] (995.822 ms) : 0, 995822
Total [candidate] (10.656 s) : 0, 10656250
section appsec
Agent [baseline] (1.173 s) : 0, 1173457
Total [baseline] (10.722 s) : 0, 10722121
Agent [candidate] (1.174 s) : 0, 1173964
Total [candidate] (10.759 s) : 0, 10759288
section iast
Agent [baseline] (1.137 s) : 0, 1137166
Total [baseline] (10.928 s) : 0, 10928047
Agent [candidate] (1.141 s) : 0, 1140814
Total [candidate] (10.846 s) : 0, 10845526
section profiling
Agent [baseline] (1.246 s) : 0, 1246082
Total [baseline] (11.004 s) : 0, 11004126
Agent [candidate] (1.252 s) : 0, 1251660
Total [candidate] (11.019 s) : 0, 11019064
gantt
title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~9b84d015b2, baseline=1.52.0-SNAPSHOT~ad6d6b9786
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.263 ms) : 0, 691263
BytebuddyAgent [candidate] (687.279 ms) : 0, 687279
GlobalTracer [baseline] (243.394 ms) : 0, 243394
GlobalTracer [candidate] (242.676 ms) : 0, 242676
AppSec [baseline] (30.402 ms) : 0, 30402
AppSec [candidate] (30.19 ms) : 0, 30190
Debugger [baseline] (5.981 ms) : 0, 5981
Debugger [candidate] (5.941 ms) : 0, 5941
Remote Config [baseline] (672.43 µs) : 0, 672
Remote Config [candidate] (676.153 µs) : 0, 676
Telemetry [baseline] (8.287 ms) : 0, 8287
Telemetry [candidate] (8.231 ms) : 0, 8231
section appsec
BytebuddyAgent [baseline] (709.579 ms) : 0, 709579
BytebuddyAgent [candidate] (710.441 ms) : 0, 710441
GlobalTracer [baseline] (235.101 ms) : 0, 235101
GlobalTracer [candidate] (235.12 ms) : 0, 235120
AppSec [baseline] (169.966 ms) : 0, 169966
AppSec [candidate] (169.655 ms) : 0, 169655
Debugger [baseline] (5.749 ms) : 0, 5749
Debugger [candidate] (5.7 ms) : 0, 5700
Remote Config [baseline] (598.494 µs) : 0, 598
Remote Config [candidate] (597.267 µs) : 0, 597
Telemetry [baseline] (8.093 ms) : 0, 8093
Telemetry [candidate] (7.986 ms) : 0, 7986
IAST [baseline] (23.457 ms) : 0, 23457
IAST [candidate] (23.612 ms) : 0, 23612
section iast
BytebuddyAgent [baseline] (809.883 ms) : 0, 809883
BytebuddyAgent [candidate] (813.563 ms) : 0, 813563
GlobalTracer [baseline] (233.924 ms) : 0, 233924
GlobalTracer [candidate] (233.766 ms) : 0, 233766
AppSec [baseline] (30.059 ms) : 0, 30059
AppSec [candidate] (30.703 ms) : 0, 30703
Debugger [baseline] (5.803 ms) : 0, 5803
Debugger [candidate] (6.642 ms) : 0, 6642
Remote Config [baseline] (586.704 µs) : 0, 587
Remote Config [candidate] (584.188 µs) : 0, 584
Telemetry [baseline] (7.965 ms) : 0, 7965
Telemetry [candidate] (7.993 ms) : 0, 7993
IAST [baseline] (28.212 ms) : 0, 28212
IAST [candidate] (26.706 ms) : 0, 26706
section profiling
BytebuddyAgent [baseline] (678.118 ms) : 0, 678118
BytebuddyAgent [candidate] (682.955 ms) : 0, 682955
GlobalTracer [baseline] (362.043 ms) : 0, 362043
GlobalTracer [candidate] (363.072 ms) : 0, 363072
AppSec [baseline] (32.371 ms) : 0, 32371
AppSec [candidate] (31.679 ms) : 0, 31679
Debugger [baseline] (10.565 ms) : 0, 10565
Debugger [candidate] (9.719 ms) : 0, 9719
Remote Config [baseline] (658.254 µs) : 0, 658
Remote Config [candidate] (656.538 µs) : 0, 657
Telemetry [baseline] (9.529 ms) : 0, 9529
Telemetry [candidate] (9.583 ms) : 0, 9583
ProfilingAgent [baseline] (104.257 ms) : 0, 104257
ProfilingAgent [candidate] (105.089 ms) : 0, 105089
Profiling [baseline] (104.28 ms) : 0, 104280
Profiling [candidate] (105.113 ms) : 0, 105113
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~9b84d015b2, baseline=1.52.0-SNAPSHOT~ad6d6b9786
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (993.864 ms) : 0, 993864
Total [baseline] (8.555 s) : 0, 8555014
Agent [candidate] (999.944 ms) : 0, 999944
Total [candidate] (8.549 s) : 0, 8548780
section iast
Agent [baseline] (1.133 s) : 0, 1132691
Total [baseline] (9.268 s) : 0, 9267753
Agent [candidate] (1.13 s) : 0, 1130034
Total [candidate] (9.278 s) : 0, 9278300
gantt
title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~9b84d015b2, baseline=1.52.0-SNAPSHOT~ad6d6b9786
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.954 ms) : 0, 686954
BytebuddyAgent [candidate] (690.688 ms) : 0, 690688
GlobalTracer [baseline] (241.218 ms) : 0, 241218
GlobalTracer [candidate] (242.923 ms) : 0, 242923
AppSec [baseline] (30.077 ms) : 0, 30077
AppSec [candidate] (30.426 ms) : 0, 30426
Debugger [baseline] (5.959 ms) : 0, 5959
Debugger [candidate] (6.053 ms) : 0, 6053
Remote Config [baseline] (669.533 µs) : 0, 670
Remote Config [candidate] (685.19 µs) : 0, 685
Telemetry [baseline] (8.269 ms) : 0, 8269
Telemetry [candidate] (8.289 ms) : 0, 8289
section iast
BytebuddyAgent [baseline] (807.37 ms) : 0, 807370
BytebuddyAgent [candidate] (806.266 ms) : 0, 806266
GlobalTracer [baseline] (231.71 ms) : 0, 231710
GlobalTracer [candidate] (231.385 ms) : 0, 231385
AppSec [baseline] (31.748 ms) : 0, 31748
AppSec [candidate] (31.181 ms) : 0, 31181
Debugger [baseline] (5.701 ms) : 0, 5701
Debugger [candidate] (5.644 ms) : 0, 5644
Remote Config [baseline] (585.793 µs) : 0, 586
Remote Config [candidate] (563.893 µs) : 0, 564
Telemetry [baseline] (7.988 ms) : 0, 7988
Telemetry [candidate] (7.85 ms) : 0, 7850
IAST [baseline] (26.853 ms) : 0, 26853
IAST [candidate] (26.354 ms) : 0, 26354
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~9b84d015b2, baseline=1.52.0-SNAPSHOT~ad6d6b9786
dateFormat X
axisFormat %s
section baseline
no_agent (37.289 ms) : 36987, 37590
. : milestone, 37289,
appsec (48.935 ms) : 48490, 49380
. : milestone, 48935,
code_origins (45.45 ms) : 45062, 45839
. : milestone, 45450,
iast (44.219 ms) : 43822, 44616
. : milestone, 44219,
profiling (47.128 ms) : 46718, 47538
. : milestone, 47128,
tracing (45.209 ms) : 44830, 45589
. : milestone, 45209,
section candidate
no_agent (37.165 ms) : 36861, 37468
. : milestone, 37165,
appsec (49.165 ms) : 48735, 49594
. : milestone, 49165,
code_origins (46.338 ms) : 45937, 46740
. : milestone, 46338,
iast (43.926 ms) : 43537, 44316
. : milestone, 43926,
profiling (49.692 ms) : 49223, 50160
. : milestone, 49692,
tracing (43.859 ms) : 43492, 44226
. : milestone, 43859,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~9b84d015b2, baseline=1.52.0-SNAPSHOT~ad6d6b9786
dateFormat X
axisFormat %s
section baseline
no_agent (4.325 ms) : 4270, 4380
. : milestone, 4325,
iast (9.239 ms) : 9089, 9389
. : milestone, 9239,
iast_FULL (13.426 ms) : 13163, 13688
. : milestone, 13426,
iast_GLOBAL (10.247 ms) : 10070, 10425
. : milestone, 10247,
profiling (8.69 ms) : 8551, 8828
. : milestone, 8690,
tracing (7.674 ms) : 7558, 7790
. : milestone, 7674,
section candidate
no_agent (4.353 ms) : 4298, 4408
. : milestone, 4353,
iast (9.274 ms) : 9117, 9431
. : milestone, 9274,
iast_FULL (13.597 ms) : 13328, 13866
. : milestone, 13597,
iast_GLOBAL (10.469 ms) : 10272, 10667
. : milestone, 10469,
profiling (8.524 ms) : 8386, 8662
. : milestone, 8524,
tracing (7.701 ms) : 7583, 7820
. : milestone, 7701,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~9b84d015b2, baseline=1.52.0-SNAPSHOT~ad6d6b9786
dateFormat X
axisFormat %s
section baseline
no_agent (15.076 s) : 15076000, 15076000
. : milestone, 15076000,
appsec (14.905 s) : 14905000, 14905000
. : milestone, 14905000,
iast (18.256 s) : 18256000, 18256000
. : milestone, 18256000,
iast_GLOBAL (18.224 s) : 18224000, 18224000
. : milestone, 18224000,
profiling (15.054 s) : 15054000, 15054000
. : milestone, 15054000,
tracing (14.892 s) : 14892000, 14892000
. : milestone, 14892000,
section candidate
no_agent (15.079 s) : 15079000, 15079000
. : milestone, 15079000,
appsec (14.866 s) : 14866000, 14866000
. : milestone, 14866000,
iast (18.423 s) : 18423000, 18423000
. : milestone, 18423000,
iast_GLOBAL (18.088 s) : 18088000, 18088000
. : milestone, 18088000,
profiling (14.963 s) : 14963000, 14963000
. : milestone, 14963000,
tracing (14.658 s) : 14658000, 14658000
. : milestone, 14658000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~9b84d015b2, baseline=1.52.0-SNAPSHOT~ad6d6b9786
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
. : milestone, 1476,
appsec (2.414 ms) : 2364, 2464
. : milestone, 2414,
iast (2.214 ms) : 2151, 2278
. : milestone, 2214,
iast_GLOBAL (2.246 ms) : 2183, 2309
. : milestone, 2246,
profiling (2.047 ms) : 1997, 2098
. : milestone, 2047,
tracing (2.021 ms) : 1972, 2070
. : milestone, 2021,
section candidate
no_agent (1.476 ms) : 1464, 1487
. : milestone, 1476,
appsec (2.428 ms) : 2377, 2479
. : milestone, 2428,
iast (2.204 ms) : 2141, 2267
. : milestone, 2204,
iast_GLOBAL (2.244 ms) : 2181, 2307
. : milestone, 2244,
profiling (2.047 ms) : 1997, 2098
. : milestone, 2047,
tracing (2.014 ms) : 1966, 2063
. : milestone, 2014,
|
nikita-tkachenko-datadog
approved these changes
Jul 11, 2025
mhlidd
pushed a commit
that referenced
this pull request
Jul 17, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
comp: testing
Testing
tag: no release notes
Changes to exclude from release notes
type: enhancement
Enhancements and improvements
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Update ignoreif reason for karate tests on JDK 24+
Motivation
Clarify why we are skipping these tests for JDK 24+
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]