Skip to content

Debug freezing test on CI. #9350

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 9 commits into
base: master
Choose a base branch
from
Draft

Conversation

AlexeyKuznetsov-DD
Copy link
Contributor

What Does This Do

Debug. DO NOT MERGE.

Motivation

Green CI.

Additional Notes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Aug 11, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added tag: do not merge Do not merge changes comp: testing Testing labels Aug 11, 2025
Copy link

datadog-official bot commented Aug 11, 2025

Code coverage: total 57.32%, base diff -0.00%, patch 100.00% (view details)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 01b34c3 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Aug 11, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-freeze
git_commit_date 1755185437 1755186748
git_commit_sha dda3d7a 01b34c3
release_version 1.53.0-SNAPSHOT~dda3d7a3d6 1.53.0-SNAPSHOT~01b34c3dad
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1755188496 1755188496
ci_job_id 1080866399 1080866399
ci_pipeline_id 73704194 73704194
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-68cjufbf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-68cjufbf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~01b34c3dad, baseline=1.53.0-SNAPSHOT~dda3d7a3d6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053103
Total [baseline] (10.789 s) : 0, 10789062
Agent [candidate] (1.047 s) : 0, 1047253
Total [candidate] (10.704 s) : 0, 10703690
section appsec
Agent [baseline] (1.236 s) : 0, 1236357
Total [baseline] (10.965 s) : 0, 10965145
Agent [candidate] (1.221 s) : 0, 1220710
Total [candidate] (10.756 s) : 0, 10756441
section iast
Agent [baseline] (1.178 s) : 0, 1177960
Total [baseline] (10.906 s) : 0, 10905725
Agent [candidate] (1.187 s) : 0, 1187057
Total [candidate] (10.897 s) : 0, 10897473
section profiling
Agent [baseline] (1.204 s) : 0, 1204246
Total [baseline] (10.974 s) : 0, 10973913
Agent [candidate] (1.194 s) : 0, 1194083
Total [candidate] (10.905 s) : 0, 10905459
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.236 s 183.254 ms (17.4%)
Agent iast 1.178 s 124.856 ms (11.9%)
Agent profiling 1.204 s 151.143 ms (14.4%)
Total tracing 10.789 s -
Total appsec 10.965 s 176.082 ms (1.6%)
Total iast 10.906 s 116.662 ms (1.1%)
Total profiling 10.974 s 184.851 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.221 s 173.457 ms (16.6%)
Agent iast 1.187 s 139.804 ms (13.3%)
Agent profiling 1.194 s 146.83 ms (14.0%)
Total tracing 10.704 s -
Total appsec 10.756 s 52.751 ms (0.5%)
Total iast 10.897 s 193.783 ms (1.8%)
Total profiling 10.905 s 201.769 ms (1.9%)
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~01b34c3dad, baseline=1.53.0-SNAPSHOT~dda3d7a3d6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.432 ms) : 0, 1432
crashtracking [candidate] (1.418 ms) : 0, 1418
BytebuddyAgent [baseline] (736.35 ms) : 0, 736350
BytebuddyAgent [candidate] (732.352 ms) : 0, 732352
GlobalTracer [baseline] (243.536 ms) : 0, 243536
GlobalTracer [candidate] (242.374 ms) : 0, 242374
AppSec [baseline] (30.431 ms) : 0, 30431
AppSec [candidate] (30.07 ms) : 0, 30070
Debugger [baseline] (6.117 ms) : 0, 6117
Debugger [candidate] (6.017 ms) : 0, 6017
Remote Config [baseline] (652.734 µs) : 0, 653
Remote Config [candidate] (640.171 µs) : 0, 640
Telemetry [baseline] (13.404 ms) : 0, 13404
Telemetry [candidate] (13.309 ms) : 0, 13309
section appsec
crashtracking [baseline] (1.433 ms) : 0, 1433
crashtracking [candidate] (1.427 ms) : 0, 1427
BytebuddyAgent [baseline] (763.639 ms) : 0, 763639
BytebuddyAgent [candidate] (753.098 ms) : 0, 753098
GlobalTracer [baseline] (238.172 ms) : 0, 238172
GlobalTracer [candidate] (235.55 ms) : 0, 235550
AppSec [baseline] (171.234 ms) : 0, 171234
AppSec [candidate] (170.385 ms) : 0, 170385
Debugger [baseline] (7.416 ms) : 0, 7416
Debugger [candidate] (6.44 ms) : 0, 6440
Remote Config [baseline] (633.909 µs) : 0, 634
Remote Config [candidate] (621.086 µs) : 0, 621
Telemetry [baseline] (8.455 ms) : 0, 8455
Telemetry [candidate] (8.418 ms) : 0, 8418
IAST [baseline] (24.026 ms) : 0, 24026
IAST [candidate] (23.675 ms) : 0, 23675
section iast
crashtracking [baseline] (1.427 ms) : 0, 1427
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (849.664 ms) : 0, 849664
BytebuddyAgent [candidate] (857.397 ms) : 0, 857397
GlobalTracer [baseline] (233.366 ms) : 0, 233366
GlobalTracer [candidate] (234.38 ms) : 0, 234380
AppSec [baseline] (26.602 ms) : 0, 26602
AppSec [candidate] (27.662 ms) : 0, 27662
Debugger [baseline] (5.79 ms) : 0, 5790
Debugger [candidate] (7.467 ms) : 0, 7467
Remote Config [baseline] (583.841 µs) : 0, 584
Remote Config [candidate] (577.819 µs) : 0, 578
Telemetry [baseline] (8.409 ms) : 0, 8409
Telemetry [candidate] (8.401 ms) : 0, 8401
IAST [baseline] (31.013 ms) : 0, 31013
IAST [candidate] (28.527 ms) : 0, 28527
section profiling
crashtracking [baseline] (1.408 ms) : 0, 1408
crashtracking [candidate] (1.399 ms) : 0, 1399
BytebuddyAgent [baseline] (766.18 ms) : 0, 766180
BytebuddyAgent [candidate] (760.269 ms) : 0, 760269
GlobalTracer [baseline] (223.547 ms) : 0, 223547
GlobalTracer [candidate] (222.116 ms) : 0, 222116
AppSec [baseline] (30.219 ms) : 0, 30219
AppSec [candidate] (29.942 ms) : 0, 29942
Debugger [baseline] (6.368 ms) : 0, 6368
Debugger [candidate] (6.321 ms) : 0, 6321
Remote Config [baseline] (689.916 µs) : 0, 690
Remote Config [candidate] (685.675 µs) : 0, 686
Telemetry [baseline] (15.718 ms) : 0, 15718
Telemetry [candidate] (16.008 ms) : 0, 16008
ProfilingAgent [baseline] (110.291 ms) : 0, 110291
ProfilingAgent [candidate] (108.083 ms) : 0, 108083
Profiling [baseline] (110.932 ms) : 0, 110932
Profiling [candidate] (108.727 ms) : 0, 108727
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~01b34c3dad, baseline=1.53.0-SNAPSHOT~dda3d7a3d6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1045313
Total [baseline] (8.57 s) : 0, 8570399
Agent [candidate] (1.046 s) : 0, 1046022
Total [candidate] (8.585 s) : 0, 8585017
section iast
Agent [baseline] (1.18 s) : 0, 1179830
Total [baseline] (9.306 s) : 0, 9306498
Agent [candidate] (1.178 s) : 0, 1178492
Total [candidate] (9.3 s) : 0, 9300020
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.18 s 134.518 ms (12.9%)
Total tracing 8.57 s -
Total iast 9.306 s 736.099 ms (8.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.178 s 132.471 ms (12.7%)
Total tracing 8.585 s -
Total iast 9.3 s 715.003 ms (8.3%)
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~01b34c3dad, baseline=1.53.0-SNAPSHOT~dda3d7a3d6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.415 ms) : 0, 1415
crashtracking [candidate] (1.416 ms) : 0, 1416
BytebuddyAgent [baseline] (730.889 ms) : 0, 730889
BytebuddyAgent [candidate] (731.47 ms) : 0, 731470
GlobalTracer [baseline] (241.688 ms) : 0, 241688
GlobalTracer [candidate] (241.983 ms) : 0, 241983
AppSec [baseline] (30.129 ms) : 0, 30129
AppSec [candidate] (30.061 ms) : 0, 30061
Debugger [baseline] (6.048 ms) : 0, 6048
Debugger [candidate] (6.041 ms) : 0, 6041
Remote Config [baseline] (648.022 µs) : 0, 648
Remote Config [candidate] (651.396 µs) : 0, 651
Telemetry [baseline] (13.535 ms) : 0, 13535
Telemetry [candidate] (13.464 ms) : 0, 13464
section iast
crashtracking [baseline] (1.427 ms) : 0, 1427
crashtracking [candidate] (1.416 ms) : 0, 1416
BytebuddyAgent [baseline] (852.086 ms) : 0, 852086
BytebuddyAgent [candidate] (850.691 ms) : 0, 850691
GlobalTracer [baseline] (233.651 ms) : 0, 233651
GlobalTracer [candidate] (233.084 ms) : 0, 233084
AppSec [baseline] (27.222 ms) : 0, 27222
AppSec [candidate] (27.524 ms) : 0, 27524
Debugger [baseline] (6.54 ms) : 0, 6540
Debugger [candidate] (7.443 ms) : 0, 7443
Remote Config [baseline] (569.562 µs) : 0, 570
Remote Config [candidate] (581.228 µs) : 0, 581
Telemetry [baseline] (8.306 ms) : 0, 8306
Telemetry [candidate] (8.32 ms) : 0, 8320
IAST [baseline] (29.026 ms) : 0, 29026
IAST [candidate] (28.368 ms) : 0, 28368
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-freeze
git_commit_date 1755185437 1755186748
git_commit_sha dda3d7a 01b34c3
release_version 1.53.0-SNAPSHOT~dda3d7a3d6 1.53.0-SNAPSHOT~01b34c3dad
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1755188246 1755188246
ci_job_id 1080866400 1080866400
ci_pipeline_id 73704194 73704194
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-8b0l9f8x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-8b0l9f8x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 3 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+302.736µs; +603.569µs] or [+3.448%; +6.874%]
unstable
[-87.506op/s; +37.444op/s] or [-16.564%; +7.088%]
9.234ms 503.250op/s 8.781ms 528.281op/s
scenario:load:petclinic:tracing:high_load better
[-1.740ms; -0.932ms] or [-3.906%; -2.091%]
unstable
[-3.762op/s; +10.262op/s] or [-3.583%; +9.774%]
43.223ms 108.237op/s 44.559ms 104.987op/s
scenario:load:petclinic:no_agent:high_load better
[-2.716ms; -2.072ms] or [-7.072%; -5.395%]
unstable
[+0.012op/s; +16.063op/s] or [+0.010%; +13.196%]
36.017ms 129.762op/s 38.411ms 121.725op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.392ms; +2.204ms] or [+3.195%; +5.060%]
unstable
[-11.264op/s; +2.764op/s] or [-10.490%; +2.574%]
45.361ms 103.125op/s 43.563ms 107.375op/s
scenario:load:petclinic:iast:high_load worse
[+1.939ms; +2.772ms] or [+4.423%; +6.322%]
unstable
[-12.292op/s; +1.442op/s] or [-11.523%; +1.352%]
46.208ms 101.250op/s 43.852ms 106.675op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~01b34c3dad, baseline=1.53.0-SNAPSHOT~dda3d7a3d6
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.411 ms) : 38104, 38719
.   : milestone, 38411,
appsec (47.6 ms) : 47191, 48008
.   : milestone, 47600,
code_origins (43.563 ms) : 43197, 43930
.   : milestone, 43563,
iast (43.852 ms) : 43485, 44220
.   : milestone, 43852,
profiling (47.663 ms) : 47211, 48115
.   : milestone, 47663,
tracing (44.559 ms) : 44173, 44945
.   : milestone, 44559,
section candidate
no_agent (36.017 ms) : 35726, 36308
.   : milestone, 36017,
appsec (48.361 ms) : 47942, 48780
.   : milestone, 48361,
code_origins (45.361 ms) : 44973, 45749
.   : milestone, 45361,
iast (46.208 ms) : 45803, 46613
.   : milestone, 46208,
profiling (47.728 ms) : 47302, 48154
.   : milestone, 47728,
tracing (43.223 ms) : 42857, 43588
.   : milestone, 43223,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.411 ms [38.104 ms, 38.719 ms] -
appsec 47.6 ms [47.191 ms, 48.008 ms] 9.188 ms (23.9%)
code_origins 43.563 ms [43.197 ms, 43.93 ms] 5.152 ms (13.4%)
iast 43.852 ms [43.485 ms, 44.22 ms] 5.441 ms (14.2%)
profiling 47.663 ms [47.211 ms, 48.115 ms] 9.251 ms (24.1%)
tracing 44.559 ms [44.173 ms, 44.945 ms] 6.147 ms (16.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.017 ms [35.726 ms, 36.308 ms] -
appsec 48.361 ms [47.942 ms, 48.78 ms] 12.344 ms (34.3%)
code_origins 45.361 ms [44.973 ms, 45.749 ms] 9.344 ms (25.9%)
iast 46.208 ms [45.803 ms, 46.613 ms] 10.191 ms (28.3%)
profiling 47.728 ms [47.302 ms, 48.154 ms] 11.71 ms (32.5%)
tracing 43.223 ms [42.857 ms, 43.588 ms] 7.205 ms (20.0%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~01b34c3dad, baseline=1.53.0-SNAPSHOT~dda3d7a3d6
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.399 ms) : 4347, 4451
.   : milestone, 4399,
iast (9.325 ms) : 9160, 9490
.   : milestone, 9325,
iast_FULL (13.764 ms) : 13492, 14035
.   : milestone, 13764,
iast_GLOBAL (10.355 ms) : 10173, 10538
.   : milestone, 10355,
profiling (8.781 ms) : 8646, 8915
.   : milestone, 8781,
tracing (7.763 ms) : 7638, 7889
.   : milestone, 7763,
section candidate
no_agent (4.399 ms) : 4343, 4454
.   : milestone, 4399,
iast (9.389 ms) : 9236, 9542
.   : milestone, 9389,
iast_FULL (14.097 ms) : 13818, 14377
.   : milestone, 14097,
iast_GLOBAL (10.736 ms) : 10546, 10926
.   : milestone, 10736,
profiling (9.234 ms) : 9088, 9379
.   : milestone, 9234,
tracing (7.541 ms) : 7429, 7653
.   : milestone, 7541,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.399 ms [4.347 ms, 4.451 ms] -
iast 9.325 ms [9.16 ms, 9.49 ms] 4.927 ms (112.0%)
iast_FULL 13.764 ms [13.492 ms, 14.035 ms] 9.365 ms (212.9%)
iast_GLOBAL 10.355 ms [10.173 ms, 10.538 ms] 5.957 ms (135.4%)
profiling 8.781 ms [8.646 ms, 8.915 ms] 4.382 ms (99.6%)
tracing 7.763 ms [7.638 ms, 7.889 ms] 3.365 ms (76.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.399 ms [4.343 ms, 4.454 ms] -
iast 9.389 ms [9.236 ms, 9.542 ms] 4.99 ms (113.5%)
iast_FULL 14.097 ms [13.818 ms, 14.377 ms] 9.699 ms (220.5%)
iast_GLOBAL 10.736 ms [10.546 ms, 10.926 ms] 6.337 ms (144.1%)
profiling 9.234 ms [9.088 ms, 9.379 ms] 4.835 ms (109.9%)
tracing 7.541 ms [7.429 ms, 7.653 ms] 3.142 ms (71.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-freeze
git_commit_date 1755185437 1755186748
git_commit_sha dda3d7a 01b34c3
release_version 1.53.0-SNAPSHOT~dda3d7a3d6 1.53.0-SNAPSHOT~01b34c3dad
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1755188740 1755188740
ci_job_id 1080866401 1080866401
ci_pipeline_id 73704194 73704194
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-tpkuylug 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-tpkuylug 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.365ms; -1.026ms] or [-37.316%; -28.047%]
2.463ms 3.659ms
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~01b34c3dad, baseline=1.53.0-SNAPSHOT~dda3d7a3d6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1468, 1492
.   : milestone, 1480,
appsec (3.659 ms) : 3442, 3875
.   : milestone, 3659,
iast (2.2 ms) : 2137, 2262
.   : milestone, 2200,
iast_GLOBAL (2.252 ms) : 2188, 2315
.   : milestone, 2252,
profiling (2.071 ms) : 2018, 2123
.   : milestone, 2071,
tracing (2.011 ms) : 1962, 2059
.   : milestone, 2011,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.463 ms) : 2410, 2516
.   : milestone, 2463,
iast (2.213 ms) : 2150, 2276
.   : milestone, 2213,
iast_GLOBAL (2.24 ms) : 2176, 2303
.   : milestone, 2240,
profiling (2.069 ms) : 2017, 2122
.   : milestone, 2069,
tracing (2.02 ms) : 1971, 2069
.   : milestone, 2020,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.492 ms] -
appsec 3.659 ms [3.442 ms, 3.875 ms] 2.179 ms (147.2%)
iast 2.2 ms [2.137 ms, 2.262 ms] 719.495 µs (48.6%)
iast_GLOBAL 2.252 ms [2.188 ms, 2.315 ms] 771.811 µs (52.1%)
profiling 2.071 ms [2.018 ms, 2.123 ms] 590.609 µs (39.9%)
tracing 2.011 ms [1.962 ms, 2.059 ms] 530.788 µs (35.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.463 ms [2.41 ms, 2.516 ms] 988.799 µs (67.1%)
iast 2.213 ms [2.15 ms, 2.276 ms] 738.867 µs (50.1%)
iast_GLOBAL 2.24 ms [2.176 ms, 2.303 ms] 765.471 µs (51.9%)
profiling 2.069 ms [2.017 ms, 2.122 ms] 595.219 µs (40.4%)
tracing 2.02 ms [1.971 ms, 2.069 ms] 546.274 µs (37.1%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~01b34c3dad, baseline=1.53.0-SNAPSHOT~dda3d7a3d6
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.741 s) : 14741000, 14741000
.   : milestone, 14741000,
appsec (14.753 s) : 14753000, 14753000
.   : milestone, 14753000,
iast (18.479 s) : 18479000, 18479000
.   : milestone, 18479000,
iast_GLOBAL (18.18 s) : 18180000, 18180000
.   : milestone, 18180000,
profiling (15.269 s) : 15269000, 15269000
.   : milestone, 15269000,
tracing (15.025 s) : 15025000, 15025000
.   : milestone, 15025000,
section candidate
no_agent (15.527 s) : 15527000, 15527000
.   : milestone, 15527000,
appsec (14.98 s) : 14980000, 14980000
.   : milestone, 14980000,
iast (18.461 s) : 18461000, 18461000
.   : milestone, 18461000,
iast_GLOBAL (18.256 s) : 18256000, 18256000
.   : milestone, 18256000,
profiling (16.061 s) : 16061000, 16061000
.   : milestone, 16061000,
tracing (15.043 s) : 15043000, 15043000
.   : milestone, 15043000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.741 s [14.741 s, 14.741 s] -
appsec 14.753 s [14.753 s, 14.753 s] 12.0 ms (0.1%)
iast 18.479 s [18.479 s, 18.479 s] 3.738 s (25.4%)
iast_GLOBAL 18.18 s [18.18 s, 18.18 s] 3.439 s (23.3%)
profiling 15.269 s [15.269 s, 15.269 s] 528.0 ms (3.6%)
tracing 15.025 s [15.025 s, 15.025 s] 284.0 ms (1.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.527 s [15.527 s, 15.527 s] -
appsec 14.98 s [14.98 s, 14.98 s] -547.0 ms (-3.5%)
iast 18.461 s [18.461 s, 18.461 s] 2.934 s (18.9%)
iast_GLOBAL 18.256 s [18.256 s, 18.256 s] 2.729 s (17.6%)
profiling 16.061 s [16.061 s, 16.061 s] 534.0 ms (3.4%)
tracing 15.043 s [15.043 s, 15.043 s] -484.0 ms (-3.1%)

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added the tag: no release notes Changes to exclude from release notes label Aug 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: testing Testing tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant