Update system-tests to a7eed9cec4b13c700797be1deb3af0ba2f989393 by smola · Pull Request #8182 · DataDog/dd-trace-java

smola · 2025-01-13T06:28:28Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-01-13T07:12:29Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	smola/system-tests-20250113
git_commit_date	1736758880	1736777579
git_commit_sha	`8bcee06`	`bb50ea5`
release_version	1.46.0-SNAPSHOT~8bcee06789	1.46.0-SNAPSHOT~bb50ea5ee9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1736779925	1736779925
ci_job_id	763810424	763810424
ci_pipeline_id	52818476	52818476
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053221
Total [baseline] (8.62 s) : 0, 8620180
Agent [candidate] (1.062 s) : 0, 1062144
Total [candidate] (8.649 s) : 0, 8648977
section iast
Agent [baseline] (1.187 s) : 0, 1187470
Total [baseline] (9.209 s) : 0, 9209073
Agent [candidate] (1.185 s) : 0, 1184799
Total [candidate] (9.211 s) : 0, 9211199
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.185 s) : 0, 1185216
Total [baseline] (9.179 s) : 0, 9179259
Agent [candidate] (1.19 s) : 0, 1190343
Total [candidate] (9.156 s) : 0, 9156165
section iast_TELEMETRY_OFF
Agent [baseline] (1.174 s) : 0, 1174043
Total [baseline] (9.159 s) : 0, 9158960
Agent [candidate] (1.176 s) : 0, 1176098
Total [candidate] (9.225 s) : 0, 9224635

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.053 s	-
Agent	iast	1.187 s	134.248 ms (12.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.185 s	131.995 ms (12.5%)
Agent	iast_TELEMETRY_OFF	1.174 s	120.822 ms (11.5%)
Total	tracing	8.62 s	-
Total	iast	9.209 s	588.893 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.179 s	559.079 ms (6.5%)
Total	iast_TELEMETRY_OFF	9.159 s	538.78 ms (6.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.062 s	-
Agent	iast	1.185 s	122.655 ms (11.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.19 s	128.199 ms (12.1%)
Agent	iast_TELEMETRY_OFF	1.176 s	113.954 ms (10.7%)
Total	tracing	8.649 s	-
Total	iast	9.211 s	562.223 ms (6.5%)
Total	iast_HARDCODED_SECRET_DISABLED	9.156 s	507.188 ms (5.9%)
Total	iast_TELEMETRY_OFF	9.225 s	575.659 ms (6.7%)

gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (711.51 ms) : 0, 711510
BytebuddyAgent [candidate] (718.31 ms) : 0, 718310
GlobalTracer [baseline] (254.772 ms) : 0, 254772
GlobalTracer [candidate] (258.285 ms) : 0, 258285
AppSec [baseline] (55.915 ms) : 0, 55915
AppSec [candidate] (55.834 ms) : 0, 55834
Remote Config [baseline] (717.72 µs) : 0, 718
Remote Config [candidate] (736.983 µs) : 0, 737
Telemetry [baseline] (15.33 ms) : 0, 15330
Telemetry [candidate] (13.909 ms) : 0, 13909
section iast
BytebuddyAgent [baseline] (834.488 ms) : 0, 834488
BytebuddyAgent [candidate] (833.343 ms) : 0, 833343
GlobalTracer [baseline] (247.821 ms) : 0, 247821
GlobalTracer [candidate] (247.377 ms) : 0, 247377
AppSec [baseline] (58.691 ms) : 0, 58691
AppSec [candidate] (58.214 ms) : 0, 58214
IAST [baseline] (21.809 ms) : 0, 21809
IAST [candidate] (21.371 ms) : 0, 21371
Remote Config [baseline] (697.615 µs) : 0, 698
Remote Config [candidate] (677.256 µs) : 0, 677
Telemetry [baseline] (8.986 ms) : 0, 8986
Telemetry [candidate] (8.759 ms) : 0, 8759
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.802 ms) : 0, 834802
BytebuddyAgent [candidate] (833.713 ms) : 0, 833713
GlobalTracer [baseline] (245.94 ms) : 0, 245940
GlobalTracer [candidate] (250.933 ms) : 0, 250933
AppSec [baseline] (58.414 ms) : 0, 58414
AppSec [candidate] (58.964 ms) : 0, 58964
IAST [baseline] (21.493 ms) : 0, 21493
IAST [candidate] (21.988 ms) : 0, 21988
Remote Config [baseline] (669.974 µs) : 0, 670
Remote Config [candidate] (691.259 µs) : 0, 691
Telemetry [baseline] (8.875 ms) : 0, 8875
Telemetry [candidate] (9.01 ms) : 0, 9010
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (826.07 ms) : 0, 826070
BytebuddyAgent [candidate] (826.659 ms) : 0, 826659
GlobalTracer [baseline] (245.96 ms) : 0, 245960
GlobalTracer [candidate] (246.867 ms) : 0, 246867
AppSec [baseline] (57.319 ms) : 0, 57319
AppSec [candidate] (57.575 ms) : 0, 57575
IAST [baseline] (20.569 ms) : 0, 20569
IAST [candidate] (20.78 ms) : 0, 20780
Remote Config [baseline] (646.827 µs) : 0, 647
Remote Config [candidate] (650.319 µs) : 0, 650
Telemetry [baseline] (8.547 ms) : 0, 8547
Telemetry [candidate] (8.558 ms) : 0, 8558

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1054211
Total [baseline] (10.434 s) : 0, 10434397
Agent [candidate] (1.052 s) : 0, 1052270
Total [candidate] (10.44 s) : 0, 10439888
section appsec
Agent [baseline] (1.184 s) : 0, 1184174
Total [baseline] (10.74 s) : 0, 10740280
Agent [candidate] (1.195 s) : 0, 1194769
Total [candidate] (10.728 s) : 0, 10727917
section iast
Agent [baseline] (1.183 s) : 0, 1183403
Total [baseline] (10.995 s) : 0, 10995132
Agent [candidate] (1.182 s) : 0, 1182474
Total [candidate] (10.932 s) : 0, 10932498
section profiling
Agent [baseline] (1.272 s) : 0, 1271781
Total [baseline] (10.799 s) : 0, 10798773
Agent [candidate] (1.272 s) : 0, 1271532
Total [candidate] (10.902 s) : 0, 10902362

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	appsec	1.184 s	129.963 ms (12.3%)
Agent	iast	1.183 s	129.192 ms (12.3%)
Agent	profiling	1.272 s	217.57 ms (20.6%)
Total	tracing	10.434 s	-
Total	appsec	10.74 s	305.883 ms (2.9%)
Total	iast	10.995 s	560.735 ms (5.4%)
Total	profiling	10.799 s	364.375 ms (3.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	appsec	1.195 s	142.5 ms (13.5%)
Agent	iast	1.182 s	130.204 ms (12.4%)
Agent	profiling	1.272 s	219.263 ms (20.8%)
Total	tracing	10.44 s	-
Total	appsec	10.728 s	288.029 ms (2.8%)
Total	iast	10.932 s	492.61 ms (4.7%)
Total	profiling	10.902 s	462.474 ms (4.4%)

gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.318 ms) : 0, 713318
BytebuddyAgent [candidate] (711.838 ms) : 0, 711838
GlobalTracer [baseline] (255.544 ms) : 0, 255544
GlobalTracer [candidate] (255.744 ms) : 0, 255744
AppSec [baseline] (55.314 ms) : 0, 55314
AppSec [candidate] (56.002 ms) : 0, 56002
Remote Config [baseline] (722.309 µs) : 0, 722
Remote Config [candidate] (733.117 µs) : 0, 733
Telemetry [baseline] (14.391 ms) : 0, 14391
Telemetry [candidate] (12.998 ms) : 0, 12998
section appsec
BytebuddyAgent [baseline] (728.113 ms) : 0, 728113
BytebuddyAgent [candidate] (735.385 ms) : 0, 735385
GlobalTracer [baseline] (251.912 ms) : 0, 251912
GlobalTracer [candidate] (254.458 ms) : 0, 254458
AppSec [baseline] (170.815 ms) : 0, 170815
AppSec [candidate] (170.968 ms) : 0, 170968
Remote Config [baseline] (665.724 µs) : 0, 666
Remote Config [candidate] (669.173 µs) : 0, 669
Telemetry [baseline] (8.138 ms) : 0, 8138
Telemetry [candidate] (8.547 ms) : 0, 8547
IAST [baseline] (19.268 ms) : 0, 19268
IAST [candidate] (19.248 ms) : 0, 19248
section iast
BytebuddyAgent [baseline] (832.394 ms) : 0, 832394
BytebuddyAgent [candidate] (831.319 ms) : 0, 831319
GlobalTracer [baseline] (247.057 ms) : 0, 247057
GlobalTracer [candidate] (247.099 ms) : 0, 247099
AppSec [baseline] (58.087 ms) : 0, 58087
AppSec [candidate] (58.175 ms) : 0, 58175
Remote Config [baseline] (689.968 µs) : 0, 690
Remote Config [candidate] (680.399 µs) : 0, 680
Telemetry [baseline] (8.751 ms) : 0, 8751
Telemetry [candidate] (8.719 ms) : 0, 8719
IAST [baseline] (21.416 ms) : 0, 21416
IAST [candidate] (21.436 ms) : 0, 21436
section profiling
BytebuddyAgent [baseline] (703.3 ms) : 0, 703300
BytebuddyAgent [candidate] (703.624 ms) : 0, 703624
GlobalTracer [baseline] (368.316 ms) : 0, 368316
GlobalTracer [candidate] (367.057 ms) : 0, 367057
AppSec [baseline] (53.934 ms) : 0, 53934
AppSec [candidate] (54.209 ms) : 0, 54209
Remote Config [baseline] (684.912 µs) : 0, 685
Remote Config [candidate] (684.758 µs) : 0, 685
Telemetry [baseline] (8.72 ms) : 0, 8720
Telemetry [candidate] (8.825 ms) : 0, 8825
ProfilingAgent [baseline] (94.964 ms) : 0, 94964
ProfilingAgent [candidate] (95.18 ms) : 0, 95180
Profiling [baseline] (94.988 ms) : 0, 94988
Profiling [candidate] (95.206 ms) : 0, 95206

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-01-13T14:24:26	2025-01-13T14:31:22
git_branch	master	smola/system-tests-20250113
git_commit_date	1736758880	1736777579
git_commit_sha	`8bcee06`	`bb50ea5`
release_version	1.46.0-SNAPSHOT~8bcee06789	1.46.0-SNAPSHOT~bb50ea5ee9
start_time	2025-01-13T14:24:12	2025-01-13T14:31:09

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1736779034	1736779034
ci_job_id	763810425	763810425
ci_pipeline_id	52818476	52818476
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.072 µs) : 357, 399
.   : milestone, 378,
iast (489.835 µs) : 468, 511
.   : milestone, 490,
iast_FULL (652.13 µs) : 630, 674
.   : milestone, 652,
iast_GLOBAL (525.751 µs) : 503, 549
.   : milestone, 526,
iast_HARDCODED_SECRET_DISABLED (487.561 µs) : 466, 509
.   : milestone, 488,
iast_INACTIVE (449.388 µs) : 428, 471
.   : milestone, 449,
iast_TELEMETRY_OFF (482.865 µs) : 461, 504
.   : milestone, 483,
tracing (451.14 µs) : 431, 472
.   : milestone, 451,
section candidate
no_agent (375.533 µs) : 356, 395
.   : milestone, 376,
iast (484.178 µs) : 463, 506
.   : milestone, 484,
iast_FULL (652.298 µs) : 631, 674
.   : milestone, 652,
iast_GLOBAL (515.667 µs) : 494, 538
.   : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (487.181 µs) : 466, 509
.   : milestone, 487,
iast_INACTIVE (453.293 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (480.709 µs) : 459, 502
.   : milestone, 481,
tracing (445.048 µs) : 424, 466
.   : milestone, 445,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	378.072 µs [357.323 µs, 398.821 µs]	-
iast	489.835 µs [468.307 µs, 511.363 µs]	111.763 µs (29.6%)
iast_FULL	652.13 µs [630.486 µs, 673.774 µs]	274.058 µs (72.5%)
iast_GLOBAL	525.751 µs [502.971 µs, 548.532 µs]	147.679 µs (39.1%)
iast_HARDCODED_SECRET_DISABLED	487.561 µs [466.061 µs, 509.062 µs]	109.489 µs (29.0%)
iast_INACTIVE	449.388 µs [427.855 µs, 470.922 µs]	71.316 µs (18.9%)
iast_TELEMETRY_OFF	482.865 µs [461.352 µs, 504.378 µs]	104.793 µs (27.7%)
tracing	451.14 µs [430.558 µs, 471.722 µs]	73.068 µs (19.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	375.533 µs [355.891 µs, 395.174 µs]	-
iast	484.178 µs [462.783 µs, 505.573 µs]	108.646 µs (28.9%)
iast_FULL	652.298 µs [630.506 µs, 674.09 µs]	276.766 µs (73.7%)
iast_GLOBAL	515.667 µs [493.775 µs, 537.559 µs]	140.135 µs (37.3%)
iast_HARDCODED_SECRET_DISABLED	487.181 µs [465.774 µs, 508.588 µs]	111.648 µs (29.7%)
iast_INACTIVE	453.293 µs [432.149 µs, 474.438 µs]	77.761 µs (20.7%)
iast_TELEMETRY_OFF	480.709 µs [459.207 µs, 502.21 µs]	105.176 µs (28.0%)
tracing	445.048 µs [424.378 µs, 465.719 µs]	69.516 µs (18.5%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.329 ms) : 1310, 1348
.   : milestone, 1329,
appsec (1.746 ms) : 1722, 1771
.   : milestone, 1746,
appsec_no_iast (1.723 ms) : 1698, 1747
.   : milestone, 1723,
iast (1.49 ms) : 1468, 1513
.   : milestone, 1490,
profiling (1.526 ms) : 1501, 1550
.   : milestone, 1526,
tracing (1.482 ms) : 1456, 1507
.   : milestone, 1482,
section candidate
no_agent (1.365 ms) : 1346, 1384
.   : milestone, 1365,
appsec (1.73 ms) : 1706, 1754
.   : milestone, 1730,
appsec_no_iast (1.731 ms) : 1708, 1754
.   : milestone, 1731,
iast (1.491 ms) : 1468, 1513
.   : milestone, 1491,
profiling (1.501 ms) : 1478, 1524
.   : milestone, 1501,
tracing (1.487 ms) : 1463, 1511
.   : milestone, 1487,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.329 ms [1.31 ms, 1.348 ms]	-
appsec	1.746 ms [1.722 ms, 1.771 ms]	417.198 µs (31.4%)
appsec_no_iast	1.723 ms [1.698 ms, 1.747 ms]	393.619 µs (29.6%)
iast	1.49 ms [1.468 ms, 1.513 ms]	161.099 µs (12.1%)
profiling	1.526 ms [1.501 ms, 1.55 ms]	196.778 µs (14.8%)
tracing	1.482 ms [1.456 ms, 1.507 ms]	152.501 µs (11.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.365 ms [1.346 ms, 1.384 ms]	-
appsec	1.73 ms [1.706 ms, 1.754 ms]	365.546 µs (26.8%)
appsec_no_iast	1.731 ms [1.708 ms, 1.754 ms]	366.432 µs (26.9%)
iast	1.491 ms [1.468 ms, 1.513 ms]	126.254 µs (9.3%)
profiling	1.501 ms [1.478 ms, 1.524 ms]	136.199 µs (10.0%)
tracing	1.487 ms [1.463 ms, 1.511 ms]	122.125 µs (8.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	smola/system-tests-20250113
git_commit_date	1736758880	1736777579
git_commit_sha	`8bcee06`	`bb50ea5`
release_version	1.46.0-SNAPSHOT~8bcee06789	1.46.0-SNAPSHOT~bb50ea5ee9

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1736779665	1736779665
ci_job_id	763810426	763810426
ci_pipeline_id	52818476	52818476
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.697 s) : 14697000, 14697000
.   : milestone, 14697000,
appsec (15.086 s) : 15086000, 15086000
.   : milestone, 15086000,
iast (18.43 s) : 18430000, 18430000
.   : milestone, 18430000,
iast_GLOBAL (18.276 s) : 18276000, 18276000
.   : milestone, 18276000,
profiling (15.13 s) : 15130000, 15130000
.   : milestone, 15130000,
tracing (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
section candidate
no_agent (15.012 s) : 15012000, 15012000
.   : milestone, 15012000,
appsec (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
iast (19.184 s) : 19184000, 19184000
.   : milestone, 19184000,
iast_GLOBAL (17.992 s) : 17992000, 17992000
.   : milestone, 17992000,
profiling (15.22 s) : 15220000, 15220000
.   : milestone, 15220000,
tracing (14.958 s) : 14958000, 14958000
.   : milestone, 14958000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.697 s [14.697 s, 14.697 s]	-
appsec	15.086 s [15.086 s, 15.086 s]	389.0 ms (2.6%)
iast	18.43 s [18.43 s, 18.43 s]	3.733 s (25.4%)
iast_GLOBAL	18.276 s [18.276 s, 18.276 s]	3.579 s (24.4%)
profiling	15.13 s [15.13 s, 15.13 s]	433.0 ms (2.9%)
tracing	15.23 s [15.23 s, 15.23 s]	533.0 ms (3.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.012 s [15.012 s, 15.012 s]	-
appsec	15.075 s [15.075 s, 15.075 s]	63.0 ms (0.4%)
iast	19.184 s [19.184 s, 19.184 s]	4.172 s (27.8%)
iast_GLOBAL	17.992 s [17.992 s, 17.992 s]	2.98 s (19.9%)
profiling	15.22 s [15.22 s, 15.22 s]	208.0 ms (1.4%)
tracing	14.958 s [14.958 s, 14.958 s]	-54.0 ms (-0.4%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.379 ms) : 2336, 2422
.   : milestone, 2379,
iast (2.128 ms) : 2073, 2182
.   : milestone, 2128,
iast_GLOBAL (2.175 ms) : 2120, 2231
.   : milestone, 2175,
profiling (1.986 ms) : 1942, 2031
.   : milestone, 1986,
tracing (1.958 ms) : 1916, 2000
.   : milestone, 1958,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.361 ms) : 2318, 2403
.   : milestone, 2361,
iast (2.132 ms) : 2078, 2187
.   : milestone, 2132,
iast_GLOBAL (2.163 ms) : 2108, 2218
.   : milestone, 2163,
profiling (2.48 ms) : 2290, 2670
.   : milestone, 2480,
tracing (1.95 ms) : 1908, 1992
.   : milestone, 1950,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	2.379 ms [2.336 ms, 2.422 ms]	902.658 µs (61.1%)
iast	2.128 ms [2.073 ms, 2.182 ms]	651.111 µs (44.1%)
iast_GLOBAL	2.175 ms [2.12 ms, 2.231 ms]	698.97 µs (47.3%)
profiling	1.986 ms [1.942 ms, 2.031 ms]	509.934 µs (34.5%)
tracing	1.958 ms [1.916 ms, 2.0 ms]	481.508 µs (32.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	2.361 ms [2.318 ms, 2.403 ms]	882.042 µs (59.7%)
iast	2.132 ms [2.078 ms, 2.187 ms]	653.752 µs (44.2%)
iast_GLOBAL	2.163 ms [2.108 ms, 2.218 ms]	684.815 µs (46.3%)
profiling	2.48 ms [2.29 ms, 2.67 ms]	1.001 ms (67.7%)
tracing	1.95 ms [1.908 ms, 1.992 ms]	471.886 µs (31.9%)

PerfectSlayer · 2025-01-14T17:02:47Z

Closing as outdated/duplicate

Update system-tests to a7eed9cec4b13c700797be1deb3af0ba2f989393

72a4892

smola added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jan 13, 2025

Merge branch 'master' into smola/system-tests-20250113

bb50ea5

PerfectSlayer approved these changes Jan 14, 2025

View reviewed changes

smola marked this pull request as ready for review January 14, 2025 14:21

smola requested a review from a team as a code owner January 14, 2025 14:21

smola requested a review from nayeem-kamal January 14, 2025 14:21

PerfectSlayer mentioned this pull request Jan 14, 2025

Update system-tests to 2d531d6f809cfcdd5d6d375f92bda86202dea332 #8198

Merged

smola closed this Jan 16, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

Update system-tests to a7eed9cec4b13c700797be1deb3af0ba2f989393#8182

Update system-tests to a7eed9cec4b13c700797be1deb3af0ba2f989393#8182
smola wants to merge 2 commits intomasterfrom
smola/system-tests-20250113

smola commented Jan 13, 2025

Uh oh!

pr-commenter bot commented Jan 13, 2025 •

edited

Loading

Uh oh!

PerfectSlayer commented Jan 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Comments

Conversation

smola commented Jan 13, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Jan 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer commented Jan 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

pr-commenter bot commented Jan 13, 2025 •

edited

Loading