-
Notifications
You must be signed in to change notification settings - Fork 323
Add one-pipeline CI Checks for Config Inversion
#9706
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
🎯 Code Coverage 🔗 Commit SHA: 0bf09f6 | Docs | Was this helpful? Give us feedback! |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 10 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~0bf09f6992, baseline=1.55.0-SNAPSHOT~9f0225c968
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.03 s) : 0, 1030203
Total [baseline] (8.67 s) : 0, 8670169
Agent [candidate] (1.03 s) : 0, 1029869
Total [candidate] (8.634 s) : 0, 8634338
section iast
Agent [baseline] (1.168 s) : 0, 1167912
Total [baseline] (9.358 s) : 0, 9357611
Agent [candidate] (1.168 s) : 0, 1167892
Total [candidate] (9.405 s) : 0, 9405016
gantt
title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~0bf09f6992, baseline=1.55.0-SNAPSHOT~9f0225c968
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (702.853 ms) : 0, 702853
BytebuddyAgent [candidate] (702.183 ms) : 0, 702183
GlobalTracer [baseline] (244.413 ms) : 0, 244413
GlobalTracer [candidate] (244.678 ms) : 0, 244678
AppSec [baseline] (32.261 ms) : 0, 32261
AppSec [candidate] (32.364 ms) : 0, 32364
Debugger [baseline] (6.385 ms) : 0, 6385
Debugger [candidate] (6.389 ms) : 0, 6389
Remote Config [baseline] (671.153 µs) : 0, 671
Remote Config [candidate] (676.783 µs) : 0, 677
Telemetry [baseline] (12.242 ms) : 0, 12242
Telemetry [candidate] (15.849 ms) : 0, 15849
Flare Poller [baseline] (8.787 ms) : 0, 8787
Flare Poller [candidate] (5.013 ms) : 0, 5013
section iast
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (830.36 ms) : 0, 830360
BytebuddyAgent [candidate] (828.946 ms) : 0, 828946
GlobalTracer [baseline] (233.91 ms) : 0, 233910
GlobalTracer [candidate] (234.995 ms) : 0, 234995
AppSec [baseline] (28.973 ms) : 0, 28973
AppSec [candidate] (28.914 ms) : 0, 28914
Debugger [baseline] (6.074 ms) : 0, 6074
Debugger [candidate] (6.187 ms) : 0, 6187
Remote Config [baseline] (593.777 µs) : 0, 594
Remote Config [candidate] (605.664 µs) : 0, 606
Telemetry [baseline] (8.365 ms) : 0, 8365
Telemetry [candidate] (8.485 ms) : 0, 8485
Flare Poller [baseline] (4.139 ms) : 0, 4139
Flare Poller [candidate] (4.097 ms) : 0, 4097
IAST [baseline] (32.533 ms) : 0, 32533
IAST [candidate] (32.727 ms) : 0, 32727
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~0bf09f6992, baseline=1.55.0-SNAPSHOT~9f0225c968
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.036 s) : 0, 1036268
Total [baseline] (10.707 s) : 0, 10706682
Agent [candidate] (1.037 s) : 0, 1037132
Total [candidate] (10.863 s) : 0, 10862896
section appsec
Agent [baseline] (1.208 s) : 0, 1207550
Total [baseline] (10.925 s) : 0, 10924720
Agent [candidate] (1.204 s) : 0, 1203984
Total [candidate] (10.864 s) : 0, 10864183
section iast
Agent [baseline] (1.156 s) : 0, 1156319
Total [baseline] (11.065 s) : 0, 11065394
Agent [candidate] (1.159 s) : 0, 1158585
Total [candidate] (11.009 s) : 0, 11008577
section profiling
Agent [baseline] (1.17 s) : 0, 1169698
Total [baseline] (10.816 s) : 0, 10815819
Agent [candidate] (1.174 s) : 0, 1173522
Total [candidate] (10.9 s) : 0, 10900050
gantt
title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~0bf09f6992, baseline=1.55.0-SNAPSHOT~9f0225c968
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.487 ms) : 0, 1487
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (706.931 ms) : 0, 706931
BytebuddyAgent [candidate] (707.1 ms) : 0, 707100
GlobalTracer [baseline] (246.376 ms) : 0, 246376
GlobalTracer [candidate] (246.627 ms) : 0, 246627
AppSec [baseline] (32.742 ms) : 0, 32742
AppSec [candidate] (32.61 ms) : 0, 32610
Debugger [baseline] (6.49 ms) : 0, 6490
Debugger [candidate] (6.475 ms) : 0, 6475
Remote Config [baseline] (675.317 µs) : 0, 675
Remote Config [candidate] (684.757 µs) : 0, 685
Telemetry [baseline] (12.363 ms) : 0, 12363
Telemetry [candidate] (14.431 ms) : 0, 14431
Flare Poller [baseline] (7.94 ms) : 0, 7940
Flare Poller [candidate] (6.502 ms) : 0, 6502
section appsec
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (729.521 ms) : 0, 729521
BytebuddyAgent [candidate] (726.812 ms) : 0, 726812
GlobalTracer [baseline] (236.821 ms) : 0, 236821
GlobalTracer [candidate] (236.17 ms) : 0, 236170
IAST [baseline] (25.239 ms) : 0, 25239
IAST [candidate] (25.084 ms) : 0, 25084
AppSec [baseline] (174.232 ms) : 0, 174232
AppSec [candidate] (174.365 ms) : 0, 174365
Debugger [baseline] (5.974 ms) : 0, 5974
Debugger [candidate] (5.962 ms) : 0, 5962
Remote Config [baseline] (638.055 µs) : 0, 638
Remote Config [candidate] (633.099 µs) : 0, 633
Telemetry [baseline] (8.503 ms) : 0, 8503
Telemetry [candidate] (8.451 ms) : 0, 8451
Flare Poller [baseline] (3.889 ms) : 0, 3889
Flare Poller [candidate] (3.922 ms) : 0, 3922
section iast
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (820.287 ms) : 0, 820287
BytebuddyAgent [candidate] (821.426 ms) : 0, 821426
GlobalTracer [baseline] (233.082 ms) : 0, 233082
GlobalTracer [candidate] (233.873 ms) : 0, 233873
IAST [baseline] (34.103 ms) : 0, 34103
IAST [candidate] (33.45 ms) : 0, 33450
AppSec [baseline] (27.032 ms) : 0, 27032
AppSec [candidate] (28.053 ms) : 0, 28053
Debugger [baseline] (6.131 ms) : 0, 6131
Debugger [candidate] (6.16 ms) : 0, 6160
Remote Config [baseline] (593.775 µs) : 0, 594
Remote Config [candidate] (583.703 µs) : 0, 584
Telemetry [baseline] (8.391 ms) : 0, 8391
Telemetry [candidate] (8.354 ms) : 0, 8354
Flare Poller [baseline] (4.069 ms) : 0, 4069
Flare Poller [candidate] (4.031 ms) : 0, 4031
section profiling
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (724.431 ms) : 0, 724431
BytebuddyAgent [candidate] (727.436 ms) : 0, 727436
GlobalTracer [baseline] (219.394 ms) : 0, 219394
GlobalTracer [candidate] (220.486 ms) : 0, 220486
AppSec [baseline] (32.293 ms) : 0, 32293
AppSec [candidate] (32.277 ms) : 0, 32277
Debugger [baseline] (12.309 ms) : 0, 12309
Debugger [candidate] (12.073 ms) : 0, 12073
Remote Config [baseline] (688.568 µs) : 0, 689
Remote Config [candidate] (681.918 µs) : 0, 682
Telemetry [baseline] (10.53 ms) : 0, 10530
Telemetry [candidate] (10.505 ms) : 0, 10505
Flare Poller [baseline] (4.228 ms) : 0, 4228
Flare Poller [candidate] (4.102 ms) : 0, 4102
ProfilingAgent [baseline] (109.141 ms) : 0, 109141
ProfilingAgent [candidate] (109.203 ms) : 0, 109203
Profiling [baseline] (109.748 ms) : 0, 109748
Profiling [candidate] (109.833 ms) : 0, 109833
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~0bf09f6992, baseline=1.55.0-SNAPSHOT~9f0225c968
dateFormat X
axisFormat %s
section baseline
no_agent (38.108 ms) : 37803, 38413
. : milestone, 38108,
appsec (48.148 ms) : 47726, 48571
. : milestone, 48148,
code_origins (42.901 ms) : 42540, 43263
. : milestone, 42901,
iast (45.1 ms) : 44713, 45486
. : milestone, 45100,
profiling (48.898 ms) : 48409, 49386
. : milestone, 48898,
tracing (45.549 ms) : 45163, 45935
. : milestone, 45549,
section candidate
no_agent (37.46 ms) : 37146, 37774
. : milestone, 37460,
appsec (48.967 ms) : 48539, 49395
. : milestone, 48967,
code_origins (43.533 ms) : 43164, 43903
. : milestone, 43533,
iast (44.204 ms) : 43825, 44582
. : milestone, 44204,
profiling (48.997 ms) : 48564, 49430
. : milestone, 48997,
tracing (43.678 ms) : 43288, 44067
. : milestone, 43678,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~0bf09f6992, baseline=1.55.0-SNAPSHOT~9f0225c968
dateFormat X
axisFormat %s
section baseline
no_agent (4.402 ms) : 4353, 4451
. : milestone, 4402,
iast (9.992 ms) : 9822, 10162
. : milestone, 9992,
iast_FULL (14.619 ms) : 14326, 14912
. : milestone, 14619,
iast_GLOBAL (10.357 ms) : 10176, 10538
. : milestone, 10357,
profiling (9.015 ms) : 8872, 9158
. : milestone, 9015,
tracing (8.257 ms) : 8137, 8376
. : milestone, 8257,
section candidate
no_agent (4.426 ms) : 4371, 4480
. : milestone, 4426,
iast (9.654 ms) : 9493, 9814
. : milestone, 9654,
iast_FULL (16.003 ms) : 15680, 16327
. : milestone, 16003,
iast_GLOBAL (10.605 ms) : 10418, 10792
. : milestone, 10605,
profiling (8.982 ms) : 8842, 9122
. : milestone, 8982,
tracing (8.062 ms) : 7942, 8182
. : milestone, 8062,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~0bf09f6992, baseline=1.55.0-SNAPSHOT~9f0225c968
dateFormat X
axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
. : milestone, 1475,
appsec (3.724 ms) : 3506, 3942
. : milestone, 3724,
iast (2.233 ms) : 2166, 2299
. : milestone, 2233,
iast_GLOBAL (2.266 ms) : 2200, 2332
. : milestone, 2266,
profiling (2.076 ms) : 2022, 2129
. : milestone, 2076,
tracing (2.041 ms) : 1990, 2093
. : milestone, 2041,
section candidate
no_agent (1.477 ms) : 1465, 1489
. : milestone, 1477,
appsec (3.802 ms) : 3579, 4026
. : milestone, 3802,
iast (2.234 ms) : 2168, 2300
. : milestone, 2234,
iast_GLOBAL (2.27 ms) : 2204, 2337
. : milestone, 2270,
profiling (2.072 ms) : 2019, 2126
. : milestone, 2072,
tracing (2.053 ms) : 2001, 2106
. : milestone, 2053,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~0bf09f6992, baseline=1.55.0-SNAPSHOT~9f0225c968
dateFormat X
axisFormat %s
section baseline
no_agent (15.378 s) : 15378000, 15378000
. : milestone, 15378000,
appsec (14.863 s) : 14863000, 14863000
. : milestone, 14863000,
iast (18.463 s) : 18463000, 18463000
. : milestone, 18463000,
iast_GLOBAL (18.04 s) : 18040000, 18040000
. : milestone, 18040000,
profiling (15.096 s) : 15096000, 15096000
. : milestone, 15096000,
tracing (15.138 s) : 15138000, 15138000
. : milestone, 15138000,
section candidate
no_agent (14.929 s) : 14929000, 14929000
. : milestone, 14929000,
appsec (14.782 s) : 14782000, 14782000
. : milestone, 14782000,
iast (18.976 s) : 18976000, 18976000
. : milestone, 18976000,
iast_GLOBAL (18.232 s) : 18232000, 18232000
. : milestone, 18232000,
profiling (15.373 s) : 15373000, 15373000
. : milestone, 15373000,
tracing (15.195 s) : 15195000, 15195000
. : milestone, 15195000,
|
one-pipeline CI Checks for Config Inversion
AlexeyKuznetsov-DD
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not an expert with GitLab, just curious what are the meaning of this change?
I can see that only some variables initialized and nothing else..
What Does This Do
Config Inversion has 2 CI checks in
one-pipeline.metadata/supported-configurations.jsonexist in the Feature Parity Dashboard. This is to ensure that we have proper documentation of all configurations that have been added to the library.metadata/supported-configurations.jsonfiles from the current tag and previous tag to see what new configurations have been added/removed since the last release. It will then update the Feature Parity Dashboard in order for the "supported tracer range" of all configurations to be up-to-date.Example:

Motivation
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any useful labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]