[WIP] Add file attribute to JUnit reports#8085
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~a3e9bda406
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058533
Total [baseline] (8.57 s) : 0, 8570192
Agent [candidate] (1.06 s) : 0, 1059629
Total [candidate] (8.626 s) : 0, 8626383
section iast
Agent [baseline] (1.184 s) : 0, 1183788
Total [baseline] (9.177 s) : 0, 9177269
Agent [candidate] (1.177 s) : 0, 1177401
Total [candidate] (9.162 s) : 0, 9162234
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.173 s) : 0, 1172892
Total [baseline] (9.144 s) : 0, 9143769
Agent [candidate] (1.185 s) : 0, 1185469
Total [candidate] (9.193 s) : 0, 9192573
section iast_TELEMETRY_OFF
Agent [baseline] (1.172 s) : 0, 1171946
Total [baseline] (9.165 s) : 0, 9164690
Agent [candidate] (1.17 s) : 0, 1170058
Total [candidate] (9.171 s) : 0, 9170897
gantt
title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~a3e9bda406
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.101 ms) : 0, 715101
BytebuddyAgent [candidate] (715.488 ms) : 0, 715488
GlobalTracer [baseline] (256.334 ms) : 0, 256334
GlobalTracer [candidate] (257.123 ms) : 0, 257123
AppSec [baseline] (58.111 ms) : 0, 58111
AppSec [candidate] (58.291 ms) : 0, 58291
Remote Config [baseline] (689.098 µs) : 0, 689
Remote Config [candidate] (698.74 µs) : 0, 699
Telemetry [baseline] (13.313 ms) : 0, 13313
Telemetry [candidate] (12.984 ms) : 0, 12984
section iast
BytebuddyAgent [baseline] (834.023 ms) : 0, 834023
BytebuddyAgent [candidate] (828.692 ms) : 0, 828692
GlobalTracer [baseline] (247.154 ms) : 0, 247154
GlobalTracer [candidate] (246.235 ms) : 0, 246235
AppSec [baseline] (57.361 ms) : 0, 57361
AppSec [candidate] (57.673 ms) : 0, 57673
IAST [baseline] (21.124 ms) : 0, 21124
IAST [candidate] (20.93 ms) : 0, 20930
Remote Config [baseline] (651.617 µs) : 0, 652
Remote Config [candidate] (639.682 µs) : 0, 640
Telemetry [baseline] (8.533 ms) : 0, 8533
Telemetry [candidate] (8.389 ms) : 0, 8389
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (823.981 ms) : 0, 823981
BytebuddyAgent [candidate] (833.72 ms) : 0, 833720
GlobalTracer [baseline] (245.808 ms) : 0, 245808
GlobalTracer [candidate] (247.906 ms) : 0, 247906
AppSec [baseline] (57.897 ms) : 0, 57897
AppSec [candidate] (58.481 ms) : 0, 58481
IAST [baseline] (21.337 ms) : 0, 21337
IAST [candidate] (21.178 ms) : 0, 21178
Remote Config [baseline] (662.287 µs) : 0, 662
Remote Config [candidate] (654.269 µs) : 0, 654
Telemetry [baseline] (8.413 ms) : 0, 8413
Telemetry [candidate] (8.472 ms) : 0, 8472
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (823.855 ms) : 0, 823855
BytebuddyAgent [candidate] (822.247 ms) : 0, 822247
GlobalTracer [baseline] (245.931 ms) : 0, 245931
GlobalTracer [candidate] (245.837 ms) : 0, 245837
AppSec [baseline] (57.715 ms) : 0, 57715
AppSec [candidate] (57.523 ms) : 0, 57523
IAST [baseline] (20.662 ms) : 0, 20662
IAST [candidate] (20.642 ms) : 0, 20642
Remote Config [baseline] (643.193 µs) : 0, 643
Remote Config [candidate] (639.788 µs) : 0, 640
Telemetry [baseline] (8.305 ms) : 0, 8305
Telemetry [candidate] (8.314 ms) : 0, 8314
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~a3e9bda406
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1050429
Total [baseline] (10.346 s) : 0, 10345659
Agent [candidate] (1.051 s) : 0, 1051085
Total [candidate] (10.358 s) : 0, 10357740
section appsec
Agent [baseline] (1.185 s) : 0, 1184618
Total [baseline] (10.69 s) : 0, 10690026
Agent [candidate] (1.199 s) : 0, 1199197
Total [candidate] (10.717 s) : 0, 10716576
section iast
Agent [baseline] (1.175 s) : 0, 1174984
Total [baseline] (10.948 s) : 0, 10948241
Agent [candidate] (1.176 s) : 0, 1176115
Total [candidate] (10.909 s) : 0, 10908507
section profiling
Agent [baseline] (1.277 s) : 0, 1276984
Total [baseline] (10.808 s) : 0, 10807628
Agent [candidate] (1.274 s) : 0, 1273917
Total [candidate] (10.772 s) : 0, 10772112
gantt
title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~a3e9bda406
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (710.072 ms) : 0, 710072
BytebuddyAgent [candidate] (710.627 ms) : 0, 710627
GlobalTracer [baseline] (255.766 ms) : 0, 255766
GlobalTracer [candidate] (255.776 ms) : 0, 255776
AppSec [baseline] (57.809 ms) : 0, 57809
AppSec [candidate] (58.52 ms) : 0, 58520
Remote Config [baseline] (680.764 µs) : 0, 681
Remote Config [candidate] (689.112 µs) : 0, 689
Telemetry [baseline] (11.132 ms) : 0, 11132
Telemetry [candidate] (10.54 ms) : 0, 10540
section appsec
BytebuddyAgent [baseline] (728.124 ms) : 0, 728124
BytebuddyAgent [candidate] (738.722 ms) : 0, 738722
GlobalTracer [baseline] (252.427 ms) : 0, 252427
GlobalTracer [candidate] (255.491 ms) : 0, 255491
AppSec [baseline] (170.582 ms) : 0, 170582
AppSec [candidate] (171.17 ms) : 0, 171170
IAST [baseline] (19.349 ms) : 0, 19349
IAST [candidate] (19.336 ms) : 0, 19336
Remote Config [baseline] (653.319 µs) : 0, 653
Remote Config [candidate] (663.197 µs) : 0, 663
Telemetry [baseline] (8.297 ms) : 0, 8297
Telemetry [candidate] (8.365 ms) : 0, 8365
section iast
BytebuddyAgent [baseline] (826.942 ms) : 0, 826942
BytebuddyAgent [candidate] (827.245 ms) : 0, 827245
GlobalTracer [baseline] (245.564 ms) : 0, 245564
GlobalTracer [candidate] (246.238 ms) : 0, 246238
AppSec [baseline] (57.486 ms) : 0, 57486
AppSec [candidate] (57.463 ms) : 0, 57463
IAST [baseline] (21.097 ms) : 0, 21097
IAST [candidate] (21.145 ms) : 0, 21145
Remote Config [baseline] (646.694 µs) : 0, 647
Remote Config [candidate] (652.672 µs) : 0, 653
Telemetry [baseline] (8.369 ms) : 0, 8369
Telemetry [candidate] (8.465 ms) : 0, 8465
section profiling
BytebuddyAgent [baseline] (703.311 ms) : 0, 703311
BytebuddyAgent [candidate] (700.556 ms) : 0, 700556
GlobalTracer [baseline] (372.609 ms) : 0, 372609
GlobalTracer [candidate] (373.261 ms) : 0, 373261
AppSec [baseline] (54.169 ms) : 0, 54169
AppSec [candidate] (54.314 ms) : 0, 54314
Remote Config [baseline] (654.872 µs) : 0, 655
Remote Config [candidate] (656.049 µs) : 0, 656
Telemetry [baseline] (7.951 ms) : 0, 7951
Telemetry [candidate] (7.886 ms) : 0, 7886
ProfilingAgent [baseline] (96.461 ms) : 0, 96461
ProfilingAgent [candidate] (95.535 ms) : 0, 95535
Profiling [baseline] (96.484 ms) : 0, 96484
Profiling [candidate] (95.558 ms) : 0, 95558
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~e8e9292d06
dateFormat X
axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1365
. : milestone, 1345,
appsec (1.737 ms) : 1713, 1761
. : milestone, 1737,
appsec_no_iast (1.773 ms) : 1748, 1798
. : milestone, 1773,
iast (1.488 ms) : 1464, 1512
. : milestone, 1488,
profiling (1.512 ms) : 1487, 1536
. : milestone, 1512,
tracing (1.454 ms) : 1430, 1479
. : milestone, 1454,
section candidate
no_agent (1.336 ms) : 1317, 1356
. : milestone, 1336,
appsec (1.753 ms) : 1730, 1777
. : milestone, 1753,
appsec_no_iast (1.738 ms) : 1714, 1763
. : milestone, 1738,
iast (1.508 ms) : 1485, 1530
. : milestone, 1508,
profiling (1.503 ms) : 1480, 1527
. : milestone, 1503,
tracing (1.477 ms) : 1452, 1502
. : milestone, 1477,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~e8e9292d06
dateFormat X
axisFormat %s
section baseline
no_agent (370.974 µs) : 351, 391
. : milestone, 371,
iast (490.884 µs) : 469, 513
. : milestone, 491,
iast_FULL (647.229 µs) : 626, 669
. : milestone, 647,
iast_GLOBAL (521.838 µs) : 500, 544
. : milestone, 522,
iast_HARDCODED_SECRET_DISABLED (488.569 µs) : 467, 510
. : milestone, 489,
iast_INACTIVE (450.484 µs) : 429, 472
. : milestone, 450,
iast_TELEMETRY_OFF (479.466 µs) : 457, 502
. : milestone, 479,
tracing (444.233 µs) : 424, 465
. : milestone, 444,
section candidate
no_agent (367.26 µs) : 348, 387
. : milestone, 367,
iast (491.553 µs) : 469, 514
. : milestone, 492,
iast_FULL (650.384 µs) : 629, 672
. : milestone, 650,
iast_GLOBAL (514.763 µs) : 493, 536
. : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (485.641 µs) : 464, 507
. : milestone, 486,
iast_INACTIVE (450.321 µs) : 430, 471
. : milestone, 450,
iast_TELEMETRY_OFF (476.9 µs) : 455, 498
. : milestone, 477,
tracing (439.047 µs) : 419, 459
. : milestone, 439,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~e8e9292d06
dateFormat X
axisFormat %s
section baseline
no_agent (14.672 s) : 14672000, 14672000
. : milestone, 14672000,
appsec (14.958 s) : 14958000, 14958000
. : milestone, 14958000,
iast (18.45 s) : 18450000, 18450000
. : milestone, 18450000,
iast_GLOBAL (17.736 s) : 17736000, 17736000
. : milestone, 17736000,
profiling (15.011 s) : 15011000, 15011000
. : milestone, 15011000,
tracing (14.732 s) : 14732000, 14732000
. : milestone, 14732000,
section candidate
no_agent (14.934 s) : 14934000, 14934000
. : milestone, 14934000,
appsec (15.227 s) : 15227000, 15227000
. : milestone, 15227000,
iast (18.464 s) : 18464000, 18464000
. : milestone, 18464000,
iast_GLOBAL (17.708 s) : 17708000, 17708000
. : milestone, 17708000,
profiling (14.744 s) : 14744000, 14744000
. : milestone, 14744000,
tracing (14.793 s) : 14793000, 14793000
. : milestone, 14793000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~5f361b69f8, baseline=1.45.0-SNAPSHOT~e8e9292d06
dateFormat X
axisFormat %s
section baseline
no_agent (1.47 ms) : 1458, 1481
. : milestone, 1470,
appsec (2.354 ms) : 2312, 2396
. : milestone, 2354,
iast (2.089 ms) : 2036, 2142
. : milestone, 2089,
iast_GLOBAL (2.136 ms) : 2082, 2189
. : milestone, 2136,
profiling (1.965 ms) : 1922, 2008
. : milestone, 1965,
tracing (1.942 ms) : 1901, 1983
. : milestone, 1942,
section candidate
no_agent (1.472 ms) : 1460, 1483
. : milestone, 1472,
appsec (2.349 ms) : 2307, 2390
. : milestone, 2349,
iast (2.09 ms) : 2038, 2143
. : milestone, 2090,
iast_GLOBAL (2.133 ms) : 2080, 2186
. : milestone, 2133,
profiling (1.967 ms) : 1924, 2009
. : milestone, 1967,
tracing (1.935 ms) : 1894, 1976
. : milestone, 1935,
|
72901ad to
f44c08c
Compare
|
Hi! 👋 Looks like you updated a Git Submodule.
|
f44c08c to
5f361b6
Compare
|
Hi! 👋 Looks like you updated a Git Submodule.
|
| } | ||
| } | ||
|
|
||
| TestSourceFileExtension |
There was a problem hiding this comment.
this should be inside extendwith?
There was a problem hiding this comment.
I agree, but for some reason codenarc won't pass unless this specific line is outside and I remove the "redundant" .class specifications when I try to use @ExtendWith(TestSourceFileExtension.class).
|
outdated |
What Does This Do
This PR adds a script that appends a
fileattribute to each XML file that is uploaded to CI.Motivation
The motivation behind this PR is to eventually add the codeowners tag to our tests. This PR would be step 2 under "Using the Github Integration" in this doc.
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueLANGPLAT-80