Benchmark telemetry #9286

mtoffl01 · 2025-07-31T15:56:59Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

datadog-datadog-prod-us1 · 2025-07-31T16:18:29Z

Code coverage: total 54.48%, patch 100.00% (view details)

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 7bfa6b5 | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-07-31T16:31:02Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mtoff/benchmark-config_sources
git_commit_date	1753968606	1753977309
git_commit_sha	`3a35f77`	`7bfa6b5`
release_version	1.51.1-SNAPSHOT~3a35f77b25	1.51.1-SNAPSHOT~7bfa6b5fc2

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753979204	1753979204
ci_job_id	1058225047	1058225047
ci_pipeline_id	72326137	72326137
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-eai9bx3t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-eai9bx3t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.51.1-SNAPSHOT~7bfa6b5fc2, baseline=1.51.1-SNAPSHOT~3a35f77b25

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1042742
Total [baseline] (10.702 s) : 0, 10702348
Agent [candidate] (1.044 s) : 0, 1044290
Total [candidate] (10.812 s) : 0, 10811807
section appsec
Agent [baseline] (1.228 s) : 0, 1227628
Total [baseline] (10.866 s) : 0, 10866045
Agent [candidate] (1.218 s) : 0, 1218277
Total [candidate] (10.784 s) : 0, 10784087
section iast
Agent [baseline] (1.173 s) : 0, 1173451
Total [baseline] (10.895 s) : 0, 10895073
Agent [candidate] (1.172 s) : 0, 1172437
Total [candidate] (10.899 s) : 0, 10898545
section profiling
Agent [baseline] (1.19 s) : 0, 1189586
Total [baseline] (10.848 s) : 0, 10847677
Agent [candidate] (1.194 s) : 0, 1194333
Total [candidate] (10.871 s) : 0, 10870880

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	appsec	1.228 s	184.886 ms (17.7%)
Agent	iast	1.173 s	130.71 ms (12.5%)
Agent	profiling	1.19 s	146.844 ms (14.1%)
Total	tracing	10.702 s	-
Total	appsec	10.866 s	163.697 ms (1.5%)
Total	iast	10.895 s	192.725 ms (1.8%)
Total	profiling	10.848 s	145.329 ms (1.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	appsec	1.218 s	173.987 ms (16.7%)
Agent	iast	1.172 s	128.148 ms (12.3%)
Agent	profiling	1.194 s	150.043 ms (14.4%)
Total	tracing	10.812 s	-
Total	appsec	10.784 s	-27.72 ms (-0.3%)
Total	iast	10.899 s	86.738 ms (0.8%)
Total	profiling	10.871 s	59.073 ms (0.5%)

gantt
    title petclinic - break down per module: candidate=1.51.1-SNAPSHOT~7bfa6b5fc2, baseline=1.51.1-SNAPSHOT~3a35f77b25

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (730.093 ms) : 0, 730093
BytebuddyAgent [candidate] (731.405 ms) : 0, 731405
GlobalTracer [baseline] (241.629 ms) : 0, 241629
GlobalTracer [candidate] (241.82 ms) : 0, 241820
AppSec [baseline] (30.0 ms) : 0, 30000
AppSec [candidate] (29.949 ms) : 0, 29949
Debugger [baseline] (6.015 ms) : 0, 6015
Debugger [candidate] (6.049 ms) : 0, 6049
Remote Config [baseline] (643.99 µs) : 0, 644
Remote Config [candidate] (640.927 µs) : 0, 641
Telemetry [baseline] (11.902 ms) : 0, 11902
Telemetry [candidate] (11.239 ms) : 0, 11239
section appsec
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.428 ms) : 0, 1428
BytebuddyAgent [baseline] (758.4 ms) : 0, 758400
BytebuddyAgent [candidate] (751.847 ms) : 0, 751847
GlobalTracer [baseline] (236.325 ms) : 0, 236325
GlobalTracer [candidate] (234.487 ms) : 0, 234487
AppSec [baseline] (169.712 ms) : 0, 169712
AppSec [candidate] (169.057 ms) : 0, 169057
Debugger [baseline] (7.19 ms) : 0, 7190
Debugger [candidate] (7.974 ms) : 0, 7974
Remote Config [baseline] (623.791 µs) : 0, 624
Remote Config [candidate] (637.648 µs) : 0, 638
Telemetry [baseline] (9.157 ms) : 0, 9157
Telemetry [candidate] (8.275 ms) : 0, 8275
IAST [baseline] (23.639 ms) : 0, 23639
IAST [candidate] (23.56 ms) : 0, 23560
section iast
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.426 ms) : 0, 1426
BytebuddyAgent [baseline] (846.898 ms) : 0, 846898
BytebuddyAgent [candidate] (846.032 ms) : 0, 846032
GlobalTracer [baseline] (232.438 ms) : 0, 232438
GlobalTracer [candidate] (231.554 ms) : 0, 231554
AppSec [baseline] (27.805 ms) : 0, 27805
AppSec [candidate] (27.914 ms) : 0, 27914
Debugger [baseline] (5.81 ms) : 0, 5810
Debugger [candidate] (6.681 ms) : 0, 6681
Remote Config [baseline] (584.33 µs) : 0, 584
Remote Config [candidate] (588.086 µs) : 0, 588
Telemetry [baseline] (8.141 ms) : 0, 8141
Telemetry [candidate] (8.156 ms) : 0, 8156
IAST [baseline] (29.164 ms) : 0, 29164
IAST [candidate] (29.072 ms) : 0, 29072
section profiling
crashtracking [baseline] (1.393 ms) : 0, 1393
crashtracking [candidate] (1.398 ms) : 0, 1398
BytebuddyAgent [baseline] (757.982 ms) : 0, 757982
BytebuddyAgent [candidate] (760.323 ms) : 0, 760323
GlobalTracer [baseline] (220.706 ms) : 0, 220706
GlobalTracer [candidate] (221.815 ms) : 0, 221815
AppSec [baseline] (29.779 ms) : 0, 29779
AppSec [candidate] (30.067 ms) : 0, 30067
Debugger [baseline] (6.267 ms) : 0, 6267
Debugger [candidate] (6.29 ms) : 0, 6290
Remote Config [baseline] (665.645 µs) : 0, 666
Remote Config [candidate] (689.274 µs) : 0, 689
Telemetry [baseline] (16.087 ms) : 0, 16087
Telemetry [candidate] (16.099 ms) : 0, 16099
ProfilingAgent [baseline] (107.469 ms) : 0, 107469
ProfilingAgent [candidate] (108.35 ms) : 0, 108350
Profiling [baseline] (108.108 ms) : 0, 108108
Profiling [candidate] (109.014 ms) : 0, 109014

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.51.1-SNAPSHOT~7bfa6b5fc2, baseline=1.51.1-SNAPSHOT~3a35f77b25

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1042808
Total [baseline] (8.577 s) : 0, 8577208
Agent [candidate] (1.045 s) : 0, 1044918
Total [candidate] (8.586 s) : 0, 8586382
section iast
Agent [baseline] (1.181 s) : 0, 1180649
Total [baseline] (9.393 s) : 0, 9393496
Agent [candidate] (1.189 s) : 0, 1188546
Total [candidate] (9.372 s) : 0, 9372443

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	iast	1.181 s	137.841 ms (13.2%)
Total	tracing	8.577 s	-
Total	iast	9.393 s	816.288 ms (9.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	iast	1.189 s	143.629 ms (13.7%)
Total	tracing	8.586 s	-
Total	iast	9.372 s	786.061 ms (9.2%)

gantt
    title insecure-bank - break down per module: candidate=1.51.1-SNAPSHOT~7bfa6b5fc2, baseline=1.51.1-SNAPSHOT~3a35f77b25

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.43 ms) : 0, 1430
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (729.774 ms) : 0, 729774
BytebuddyAgent [candidate] (731.717 ms) : 0, 731717
GlobalTracer [baseline] (241.459 ms) : 0, 241459
GlobalTracer [candidate] (242.1 ms) : 0, 242100
AppSec [baseline] (29.871 ms) : 0, 29871
AppSec [candidate] (29.943 ms) : 0, 29943
Debugger [baseline] (6.023 ms) : 0, 6023
Debugger [candidate] (6.069 ms) : 0, 6069
Remote Config [baseline] (645.869 µs) : 0, 646
Remote Config [candidate] (660.25 µs) : 0, 660
Telemetry [baseline] (12.685 ms) : 0, 12685
Telemetry [candidate] (11.93 ms) : 0, 11930
section iast
crashtracking [baseline] (1.428 ms) : 0, 1428
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (850.829 ms) : 0, 850829
BytebuddyAgent [candidate] (858.406 ms) : 0, 858406
GlobalTracer [baseline] (233.675 ms) : 0, 233675
GlobalTracer [candidate] (233.89 ms) : 0, 233890
AppSec [baseline] (28.311 ms) : 0, 28311
AppSec [candidate] (27.523 ms) : 0, 27523
Debugger [baseline] (5.913 ms) : 0, 5913
Debugger [candidate] (7.55 ms) : 0, 7550
Remote Config [baseline] (606.57 µs) : 0, 607
Remote Config [candidate] (593.836 µs) : 0, 594
Telemetry [baseline] (8.326 ms) : 0, 8326
Telemetry [candidate] (8.276 ms) : 0, 8276
IAST [baseline] (30.411 ms) : 0, 30411
IAST [candidate] (29.72 ms) : 0, 29720

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mtoff/benchmark-config_sources
git_commit_date	1753968606	1753977309
git_commit_sha	`3a35f77`	`7bfa6b5`
release_version	1.51.1-SNAPSHOT~3a35f77b25	1.51.1-SNAPSHOT~7bfa6b5fc2

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753978874	1753978874
ci_job_id	1058225050	1058225050
ci_pipeline_id	72326137	72326137
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-gq6ku9ux 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-gq6ku9ux 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	worse [+134.273µs; +248.111µs] or [+3.117%; +5.759%]	unstable [-156.464op/s; +67.401op/s] or [-14.695%; +6.330%]	4.499ms	1020.188op/s	4.308ms	1064.719op/s
scenario:load:petclinic:tracing:high_load	better [-2.455ms; -1.635ms] or [-5.406%; -3.600%]	unstable [-2.742op/s; +12.342op/s] or [-2.662%; +11.980%]	43.367ms	107.825op/s	45.412ms	103.025op/s
scenario:load:petclinic:iast:high_load	worse [+2.079ms; +2.899ms] or [+4.850%; +6.762%]	unstable [-13.843op/s; +1.943op/s] or [-12.685%; +1.780%]	45.353ms	103.175op/s	42.864ms	109.125op/s
scenario:load:petclinic:code_origins:high_load	better [-2.080ms; -1.238ms] or [-4.485%; -2.669%]	unstable [-3.673op/s; +11.148op/s] or [-3.641%; +11.051%]	44.718ms	104.612op/s	46.377ms	100.875op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~7bfa6b5fc2, baseline=1.51.1-SNAPSHOT~3a35f77b25
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.308 ms) : 4253, 4364
.   : milestone, 4308,
iast (9.308 ms) : 9155, 9460
.   : milestone, 9308,
iast_FULL (14.034 ms) : 13752, 14316
.   : milestone, 14034,
iast_GLOBAL (10.34 ms) : 10144, 10535
.   : milestone, 10340,
profiling (8.478 ms) : 8351, 8605
.   : milestone, 8478,
tracing (7.572 ms) : 7462, 7682
.   : milestone, 7572,
section candidate
no_agent (4.499 ms) : 4449, 4550
.   : milestone, 4499,
iast (9.646 ms) : 9486, 9806
.   : milestone, 9646,
iast_FULL (14.221 ms) : 13935, 14508
.   : milestone, 14221,
iast_GLOBAL (9.996 ms) : 9821, 10170
.   : milestone, 9996,
profiling (8.567 ms) : 8438, 8696
.   : milestone, 8567,
tracing (7.687 ms) : 7572, 7802
.   : milestone, 7687,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.308 ms [4.253 ms, 4.364 ms]	-
iast	9.308 ms [9.155 ms, 9.46 ms]	4.999 ms (116.0%)
iast_FULL	14.034 ms [13.752 ms, 14.316 ms]	9.726 ms (225.7%)
iast_GLOBAL	10.34 ms [10.144 ms, 10.535 ms]	6.032 ms (140.0%)
profiling	8.478 ms [8.351 ms, 8.605 ms]	4.17 ms (96.8%)
tracing	7.572 ms [7.462 ms, 7.682 ms]	3.264 ms (75.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.499 ms [4.449 ms, 4.55 ms]	-
iast	9.646 ms [9.486 ms, 9.806 ms]	5.146 ms (114.4%)
iast_FULL	14.221 ms [13.935 ms, 14.508 ms]	9.722 ms (216.1%)
iast_GLOBAL	9.996 ms [9.821 ms, 10.17 ms]	5.496 ms (122.2%)
profiling	8.567 ms [8.438 ms, 8.696 ms]	4.067 ms (90.4%)
tracing	7.687 ms [7.572 ms, 7.802 ms]	3.188 ms (70.8%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~7bfa6b5fc2, baseline=1.51.1-SNAPSHOT~3a35f77b25
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.988 ms) : 36682, 37294
.   : milestone, 36988,
appsec (47.237 ms) : 46809, 47664
.   : milestone, 47237,
code_origins (46.377 ms) : 45972, 46782
.   : milestone, 46377,
iast (42.864 ms) : 42504, 43225
.   : milestone, 42864,
profiling (46.96 ms) : 46497, 47423
.   : milestone, 46960,
tracing (45.412 ms) : 45035, 45789
.   : milestone, 45412,
section candidate
no_agent (37.3 ms) : 37003, 37597
.   : milestone, 37300,
appsec (47.046 ms) : 46622, 47470
.   : milestone, 47046,
code_origins (44.718 ms) : 44341, 45096
.   : milestone, 44718,
iast (45.353 ms) : 44953, 45753
.   : milestone, 45353,
profiling (48.133 ms) : 47694, 48572
.   : milestone, 48133,
tracing (43.367 ms) : 42982, 43752
.   : milestone, 43367,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.988 ms [36.682 ms, 37.294 ms]	-
appsec	47.237 ms [46.809 ms, 47.664 ms]	10.248 ms (27.7%)
code_origins	46.377 ms [45.972 ms, 46.782 ms]	9.389 ms (25.4%)
iast	42.864 ms [42.504 ms, 43.225 ms]	5.876 ms (15.9%)
profiling	46.96 ms [46.497 ms, 47.423 ms]	9.972 ms (27.0%)
tracing	45.412 ms [45.035 ms, 45.789 ms]	8.424 ms (22.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.3 ms [37.003 ms, 37.597 ms]	-
appsec	47.046 ms [46.622 ms, 47.47 ms]	9.746 ms (26.1%)
code_origins	44.718 ms [44.341 ms, 45.096 ms]	7.418 ms (19.9%)
iast	45.353 ms [44.953 ms, 45.753 ms]	8.053 ms (21.6%)
profiling	48.133 ms [47.694 ms, 48.572 ms]	10.833 ms (29.0%)
tracing	43.367 ms [42.982 ms, 43.752 ms]	6.067 ms (16.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mtoff/benchmark-config_sources
git_commit_date	1753968606	1753977309
git_commit_sha	`3a35f77`	`7bfa6b5`
release_version	1.51.1-SNAPSHOT~3a35f77b25	1.51.1-SNAPSHOT~7bfa6b5fc2

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1753979365	1753979365
ci_job_id	1058225052	1058225052
ci_pipeline_id	72326137	72326137
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-mwsmdozv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-mwsmdozv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~7bfa6b5fc2, baseline=1.51.1-SNAPSHOT~3a35f77b25
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.997 s) : 14997000, 14997000
.   : milestone, 14997000,
appsec (14.768 s) : 14768000, 14768000
.   : milestone, 14768000,
iast (18.738 s) : 18738000, 18738000
.   : milestone, 18738000,
iast_GLOBAL (17.864 s) : 17864000, 17864000
.   : milestone, 17864000,
profiling (15.871 s) : 15871000, 15871000
.   : milestone, 15871000,
tracing (14.888 s) : 14888000, 14888000
.   : milestone, 14888000,
section candidate
no_agent (15.485 s) : 15485000, 15485000
.   : milestone, 15485000,
appsec (15.087 s) : 15087000, 15087000
.   : milestone, 15087000,
iast (18.737 s) : 18737000, 18737000
.   : milestone, 18737000,
iast_GLOBAL (18.027 s) : 18027000, 18027000
.   : milestone, 18027000,
profiling (15.717 s) : 15717000, 15717000
.   : milestone, 15717000,
tracing (15.112 s) : 15112000, 15112000
.   : milestone, 15112000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.997 s [14.997 s, 14.997 s]	-
appsec	14.768 s [14.768 s, 14.768 s]	-229.0 ms (-1.5%)
iast	18.738 s [18.738 s, 18.738 s]	3.741 s (24.9%)
iast_GLOBAL	17.864 s [17.864 s, 17.864 s]	2.867 s (19.1%)
profiling	15.871 s [15.871 s, 15.871 s]	874.0 ms (5.8%)
tracing	14.888 s [14.888 s, 14.888 s]	-109.0 ms (-0.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.485 s [15.485 s, 15.485 s]	-
appsec	15.087 s [15.087 s, 15.087 s]	-398.0 ms (-2.6%)
iast	18.737 s [18.737 s, 18.737 s]	3.252 s (21.0%)
iast_GLOBAL	18.027 s [18.027 s, 18.027 s]	2.542 s (16.4%)
profiling	15.717 s [15.717 s, 15.717 s]	232.0 ms (1.5%)
tracing	15.112 s [15.112 s, 15.112 s]	-373.0 ms (-2.4%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~7bfa6b5fc2, baseline=1.51.1-SNAPSHOT~3a35f77b25
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1476, 1499
.   : milestone, 1487,
appsec (3.672 ms) : 3453, 3891
.   : milestone, 3672,
iast (2.204 ms) : 2142, 2266
.   : milestone, 2204,
iast_GLOBAL (2.252 ms) : 2189, 2315
.   : milestone, 2252,
profiling (2.032 ms) : 1982, 2082
.   : milestone, 2032,
tracing (2.026 ms) : 1977, 2075
.   : milestone, 2026,
section candidate
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (3.681 ms) : 3463, 3900
.   : milestone, 3681,
iast (2.208 ms) : 2146, 2270
.   : milestone, 2208,
iast_GLOBAL (2.252 ms) : 2189, 2315
.   : milestone, 2252,
profiling (2.047 ms) : 1997, 2097
.   : milestone, 2047,
tracing (2.022 ms) : 1973, 2070
.   : milestone, 2022,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.476 ms, 1.499 ms]	-
appsec	3.672 ms [3.453 ms, 3.891 ms]	2.184 ms (146.9%)
iast	2.204 ms [2.142 ms, 2.266 ms]	716.635 µs (48.2%)
iast_GLOBAL	2.252 ms [2.189 ms, 2.315 ms]	764.694 µs (51.4%)
profiling	2.032 ms [1.982 ms, 2.082 ms]	544.789 µs (36.6%)
tracing	2.026 ms [1.977 ms, 2.075 ms]	538.976 µs (36.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.483 ms [1.472 ms, 1.495 ms]	-
appsec	3.681 ms [3.463 ms, 3.9 ms]	2.198 ms (148.2%)
iast	2.208 ms [2.146 ms, 2.27 ms]	724.807 µs (48.9%)
iast_GLOBAL	2.252 ms [2.189 ms, 2.315 ms]	768.775 µs (51.8%)
profiling	2.047 ms [1.997 ms, 2.097 ms]	563.593 µs (38.0%)
tracing	2.022 ms [1.973 ms, 2.07 ms]	538.687 µs (36.3%)

mtoffl01 · 2025-08-12T20:18:40Z

closing in favor of #9345

Benchmark telemetry when USTs are configured with sysprops

7bfa6b5

mtoffl01 closed this Aug 12, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Benchmark telemetry #9286

Benchmark telemetry #9286

Uh oh!

mtoffl01 commented Jul 31, 2025

Uh oh!

datadog-datadog-prod-us1 bot commented Jul 31, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Jul 31, 2025

Uh oh!

mtoffl01 commented Aug 12, 2025

Uh oh!

Uh oh!

Benchmark telemetry #9286

Benchmark telemetry #9286

Uh oh!

Conversation

mtoffl01 commented Jul 31, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Jul 31, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Jul 31, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

mtoffl01 commented Aug 12, 2025

Uh oh!

Uh oh!

datadog-datadog-prod-us1 bot commented Jul 31, 2025 •

edited

Loading