Skip to content

Conversation

@github-actions
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Dec 29, 2024
@github-actions github-actions bot requested review from a team as code owners December 29, 2024 04:17
@github-actions github-actions bot requested review from Mariovido, ojung, smola and tonyredondo and removed request for a team December 29, 2024 04:17
@pr-commenter
Copy link

pr-commenter bot commented Dec 29, 2024

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1735446625 1735447015
end_time 2024-12-29T04:31:42 2024-12-29T04:38:11
git_branch master ci/update-gradle-dependencies-20241229
git_commit_sha 46b5986 cdfd534
start_time 2024-12-29T04:30:26 2024-12-29T04:36:56
See matching parameters
Baseline Candidate
ci_job_id 750533039 750533039
ci_pipeline_id 51876845 51876845
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1735445844 1735445844

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:basic better
[-15.065µs; -3.481µs] or [-5.383%; -1.244%]
same same unstable
[-72.484µs; +11.765µs] or [-13.240%; +2.149%]
unstable
[-146.735op/s; +146.735op/s] or [-5.723%; +5.723%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-24.736µs; +13.723µs] or [-9.192%; +5.099%]
unstable
[-34.971µs; +26.864µs] or [-11.340%; +8.712%]
unstable
[-46.148µs; +37.007µs] or [-14.327%; +11.489%]
unstable
[-100.382µs; +78.283µs] or [-16.690%; +13.016%]
same
scenario:loop unsure
[+22.056µs; +55.724µs] or [+0.203%; +0.513%]
unsure
[+0.335µs; +71.874µs] or [+0.003%; +0.650%]
unsure
[+5.594µs; +109.400µs] or [+0.050%; +0.985%]
same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (308.377 µs) : 276, 341
.   : milestone, 308,
basic (306.746 µs) : 298, 316
.   : milestone, 307,
loop (11.054 ms) : 11018, 11089
.   : milestone, 11054,
section candidate
noprobe (304.323 µs) : 279, 330
.   : milestone, 304,
basic (301.394 µs) : 292, 311
.   : milestone, 301,
loop (11.09 ms) : 11059, 11121
.   : milestone, 11090,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 308.377 µs [275.518 µs, 341.235 µs]
basic 306.746 µs [297.649 µs, 315.843 µs]
loop 11.054 ms [11.018 ms, 11.089 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 304.323 µs [278.676 µs, 329.971 µs]
basic 301.394 µs [292.168 µs, 310.62 µs]
loop 11.09 ms [11.059 ms, 11.121 ms]

@pr-commenter
Copy link

pr-commenter bot commented Dec 29, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241229
git_commit_date 1734944119 1735445832
git_commit_sha 46b5986 899d2fc
release_version 1.45.0-SNAPSHOT~46b5986f6a 1.45.0-SNAPSHOT~899d2fc481
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1735448464 1735448464
ci_job_id 750532690 750532690
ci_pipeline_id 51876838 51876838
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~899d2fc481, baseline=1.45.0-SNAPSHOT~46b5986f6a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060551
Total [baseline] (8.601 s) : 0, 8601197
Agent [candidate] (1.052 s) : 0, 1052271
Total [candidate] (8.599 s) : 0, 8599471
section iast
Agent [baseline] (1.185 s) : 0, 1184515
Total [baseline] (9.253 s) : 0, 9253479
Agent [candidate] (1.174 s) : 0, 1174420
Total [candidate] (9.165 s) : 0, 9165013
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.184 s) : 0, 1184072
Total [baseline] (9.169 s) : 0, 9169122
Agent [candidate] (1.184 s) : 0, 1183536
Total [candidate] (9.2 s) : 0, 9199568
section iast_TELEMETRY_OFF
Agent [baseline] (1.169 s) : 0, 1168707
Total [baseline] (9.143 s) : 0, 9142638
Agent [candidate] (1.18 s) : 0, 1179637
Total [candidate] (9.221 s) : 0, 9221138
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.185 s 123.964 ms (11.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.184 s 123.521 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.169 s 108.156 ms (10.2%)
Total tracing 8.601 s -
Total iast 9.253 s 652.282 ms (7.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.169 s 567.926 ms (6.6%)
Total iast_TELEMETRY_OFF 9.143 s 541.442 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.174 s 122.148 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.184 s 131.265 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.18 s 127.366 ms (12.1%)
Total tracing 8.599 s -
Total iast 9.165 s 565.542 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.2 s 600.098 ms (7.0%)
Total iast_TELEMETRY_OFF 9.221 s 621.667 ms (7.2%)
gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~899d2fc481, baseline=1.45.0-SNAPSHOT~46b5986f6a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.287 ms) : 0, 717287
BytebuddyAgent [candidate] (710.757 ms) : 0, 710757
GlobalTracer [baseline] (257.201 ms) : 0, 257201
GlobalTracer [candidate] (256.903 ms) : 0, 256903
AppSec [baseline] (58.6 ms) : 0, 58600
AppSec [candidate] (57.903 ms) : 0, 57903
Remote Config [baseline] (676.982 µs) : 0, 677
Remote Config [candidate] (686.144 µs) : 0, 686
Telemetry [baseline] (11.719 ms) : 0, 11719
Telemetry [candidate] (11.153 ms) : 0, 11153
section iast
BytebuddyAgent [baseline] (834.64 ms) : 0, 834640
BytebuddyAgent [candidate] (826.173 ms) : 0, 826173
GlobalTracer [baseline] (246.679 ms) : 0, 246679
GlobalTracer [candidate] (245.666 ms) : 0, 245666
AppSec [baseline] (57.71 ms) : 0, 57710
AppSec [candidate] (57.385 ms) : 0, 57385
IAST [baseline] (21.369 ms) : 0, 21369
IAST [candidate] (21.199 ms) : 0, 21199
Remote Config [baseline] (657.0 µs) : 0, 657
Remote Config [candidate] (646.083 µs) : 0, 646
Telemetry [baseline] (8.509 ms) : 0, 8509
Telemetry [candidate] (8.405 ms) : 0, 8405
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (833.433 ms) : 0, 833433
BytebuddyAgent [candidate] (833.545 ms) : 0, 833545
GlobalTracer [baseline] (247.362 ms) : 0, 247362
GlobalTracer [candidate] (246.342 ms) : 0, 246342
AppSec [baseline] (57.728 ms) : 0, 57728
AppSec [candidate] (58.025 ms) : 0, 58025
IAST [baseline] (21.453 ms) : 0, 21453
IAST [candidate] (21.375 ms) : 0, 21375
Remote Config [baseline] (674.916 µs) : 0, 675
Remote Config [candidate] (649.582 µs) : 0, 650
Telemetry [baseline] (8.477 ms) : 0, 8477
Telemetry [candidate] (8.549 ms) : 0, 8549
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (821.943 ms) : 0, 821943
BytebuddyAgent [candidate] (829.469 ms) : 0, 829469
GlobalTracer [baseline] (245.524 ms) : 0, 245524
GlobalTracer [candidate] (247.483 ms) : 0, 247483
AppSec [baseline] (56.908 ms) : 0, 56908
AppSec [candidate] (57.842 ms) : 0, 57842
IAST [baseline] (20.533 ms) : 0, 20533
IAST [candidate] (20.855 ms) : 0, 20855
Remote Config [baseline] (637.665 µs) : 0, 638
Remote Config [candidate] (651.559 µs) : 0, 652
Telemetry [baseline] (8.287 ms) : 0, 8287
Telemetry [candidate] (8.336 ms) : 0, 8336
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~899d2fc481, baseline=1.45.0-SNAPSHOT~46b5986f6a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1052543
Total [baseline] (10.444 s) : 0, 10444251
Agent [candidate] (1.066 s) : 0, 1065778
Total [candidate] (10.477 s) : 0, 10477438
section appsec
Agent [baseline] (1.191 s) : 0, 1191185
Total [baseline] (10.674 s) : 0, 10674459
Agent [candidate] (1.193 s) : 0, 1192953
Total [candidate] (10.71 s) : 0, 10710340
section iast
Agent [baseline] (1.173 s) : 0, 1173139
Total [baseline] (10.976 s) : 0, 10975964
Agent [candidate] (1.196 s) : 0, 1196050
Total [candidate] (10.97 s) : 0, 10969961
section profiling
Agent [baseline] (1.273 s) : 0, 1272987
Total [baseline] (10.783 s) : 0, 10782689
Agent [candidate] (1.278 s) : 0, 1277616
Total [candidate] (10.766 s) : 0, 10765506
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.191 s 138.641 ms (13.2%)
Agent iast 1.173 s 120.595 ms (11.5%)
Agent profiling 1.273 s 220.443 ms (20.9%)
Total tracing 10.444 s -
Total appsec 10.674 s 230.209 ms (2.2%)
Total iast 10.976 s 531.713 ms (5.1%)
Total profiling 10.783 s 338.438 ms (3.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.193 s 127.176 ms (11.9%)
Agent iast 1.196 s 130.272 ms (12.2%)
Agent profiling 1.278 s 211.839 ms (19.9%)
Total tracing 10.477 s -
Total appsec 10.71 s 232.902 ms (2.2%)
Total iast 10.97 s 492.523 ms (4.7%)
Total profiling 10.766 s 288.067 ms (2.7%)
gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~899d2fc481, baseline=1.45.0-SNAPSHOT~46b5986f6a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (711.582 ms) : 0, 711582
BytebuddyAgent [candidate] (720.261 ms) : 0, 720261
GlobalTracer [baseline] (256.017 ms) : 0, 256017
GlobalTracer [candidate] (259.0 ms) : 0, 259000
AppSec [baseline] (57.208 ms) : 0, 57208
AppSec [candidate] (59.424 ms) : 0, 59424
Remote Config [baseline] (685.955 µs) : 0, 686
Remote Config [candidate] (693.25 µs) : 0, 693
Telemetry [baseline] (12.026 ms) : 0, 12026
Telemetry [candidate] (11.304 ms) : 0, 11304
section appsec
BytebuddyAgent [baseline] (732.311 ms) : 0, 732311
BytebuddyAgent [candidate] (733.296 ms) : 0, 733296
GlobalTracer [baseline] (254.072 ms) : 0, 254072
GlobalTracer [candidate] (254.344 ms) : 0, 254344
AppSec [baseline] (171.502 ms) : 0, 171502
AppSec [candidate] (171.501 ms) : 0, 171501
Remote Config [baseline] (658.912 µs) : 0, 659
Remote Config [candidate] (651.288 µs) : 0, 651
Telemetry [baseline] (8.047 ms) : 0, 8047
Telemetry [candidate] (8.35 ms) : 0, 8350
IAST [baseline] (19.281 ms) : 0, 19281
IAST [candidate] (19.548 ms) : 0, 19548
section iast
BytebuddyAgent [baseline] (824.94 ms) : 0, 824940
BytebuddyAgent [candidate] (841.625 ms) : 0, 841625
GlobalTracer [baseline] (245.385 ms) : 0, 245385
GlobalTracer [candidate] (249.828 ms) : 0, 249828
AppSec [baseline] (57.74 ms) : 0, 57740
AppSec [candidate] (58.552 ms) : 0, 58552
Remote Config [baseline] (639.369 µs) : 0, 639
Remote Config [candidate] (679.957 µs) : 0, 680
Telemetry [baseline] (8.443 ms) : 0, 8443
Telemetry [candidate] (8.642 ms) : 0, 8642
IAST [baseline] (21.103 ms) : 0, 21103
IAST [candidate] (21.562 ms) : 0, 21562
section profiling
ProfilingAgent [baseline] (95.254 ms) : 0, 95254
ProfilingAgent [candidate] (96.772 ms) : 0, 96772
BytebuddyAgent [baseline] (703.259 ms) : 0, 703259
BytebuddyAgent [candidate] (704.852 ms) : 0, 704852
GlobalTracer [baseline] (370.294 ms) : 0, 370294
GlobalTracer [candidate] (371.167 ms) : 0, 371167
AppSec [baseline] (53.795 ms) : 0, 53795
AppSec [candidate] (54.284 ms) : 0, 54284
Remote Config [baseline] (645.031 µs) : 0, 645
Remote Config [candidate] (680.219 µs) : 0, 680
Telemetry [baseline] (7.787 ms) : 0, 7787
Telemetry [candidate] (7.881 ms) : 0, 7881
Profiling [baseline] (95.277 ms) : 0, 95277
Profiling [candidate] (96.796 ms) : 0, 96796
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-12-29T04:31:02 2024-12-29T04:38:01
git_branch master ci/update-gradle-dependencies-20241229
git_commit_date 1734944119 1735445832
git_commit_sha 46b5986 899d2fc
release_version 1.45.0-SNAPSHOT~46b5986f6a 1.45.0-SNAPSHOT~899d2fc481
start_time 2024-12-29T04:30:49 2024-12-29T04:37:48
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1735447436 1735447436
ci_job_id 750532691 750532691
ci_pipeline_id 51876838 51876838
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~899d2fc481, baseline=1.45.0-SNAPSHOT~46b5986f6a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.369 ms) : 1349, 1389
.   : milestone, 1369,
appsec (1.747 ms) : 1724, 1771
.   : milestone, 1747,
appsec_no_iast (1.758 ms) : 1733, 1783
.   : milestone, 1758,
iast (1.509 ms) : 1485, 1532
.   : milestone, 1509,
profiling (1.507 ms) : 1483, 1530
.   : milestone, 1507,
tracing (1.501 ms) : 1477, 1525
.   : milestone, 1501,
section candidate
no_agent (1.356 ms) : 1336, 1375
.   : milestone, 1356,
appsec (1.745 ms) : 1721, 1769
.   : milestone, 1745,
appsec_no_iast (1.754 ms) : 1729, 1779
.   : milestone, 1754,
iast (1.531 ms) : 1508, 1554
.   : milestone, 1531,
profiling (1.528 ms) : 1504, 1551
.   : milestone, 1528,
tracing (1.49 ms) : 1465, 1515
.   : milestone, 1490,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.369 ms [1.349 ms, 1.389 ms] -
appsec 1.747 ms [1.724 ms, 1.771 ms] 378.359 µs (27.6%)
appsec_no_iast 1.758 ms [1.733 ms, 1.783 ms] 389.166 µs (28.4%)
iast 1.509 ms [1.485 ms, 1.532 ms] 139.801 µs (10.2%)
profiling 1.507 ms [1.483 ms, 1.53 ms] 137.825 µs (10.1%)
tracing 1.501 ms [1.477 ms, 1.525 ms] 132.373 µs (9.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.336 ms, 1.375 ms] -
appsec 1.745 ms [1.721 ms, 1.769 ms] 389.144 µs (28.7%)
appsec_no_iast 1.754 ms [1.729 ms, 1.779 ms] 397.824 µs (29.3%)
iast 1.531 ms [1.508 ms, 1.554 ms] 175.086 µs (12.9%)
profiling 1.528 ms [1.504 ms, 1.551 ms] 171.742 µs (12.7%)
tracing 1.49 ms [1.465 ms, 1.515 ms] 133.863 µs (9.9%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~899d2fc481, baseline=1.45.0-SNAPSHOT~46b5986f6a
    dateFormat X
    axisFormat %s
section baseline
no_agent (390.753 µs) : 369, 413
.   : milestone, 391,
iast (493.556 µs) : 472, 515
.   : milestone, 494,
iast_FULL (655.358 µs) : 634, 677
.   : milestone, 655,
iast_GLOBAL (530.587 µs) : 508, 553
.   : milestone, 531,
iast_HARDCODED_SECRET_DISABLED (499.664 µs) : 478, 521
.   : milestone, 500,
iast_INACTIVE (459.467 µs) : 438, 481
.   : milestone, 459,
iast_TELEMETRY_OFF (481.739 µs) : 460, 503
.   : milestone, 482,
tracing (458.962 µs) : 438, 480
.   : milestone, 459,
section candidate
no_agent (379.817 µs) : 360, 400
.   : milestone, 380,
iast (498.617 µs) : 477, 520
.   : milestone, 499,
iast_FULL (656.902 µs) : 635, 679
.   : milestone, 657,
iast_GLOBAL (531.599 µs) : 508, 555
.   : milestone, 532,
iast_HARDCODED_SECRET_DISABLED (497.012 µs) : 475, 519
.   : milestone, 497,
iast_INACTIVE (455.831 µs) : 435, 477
.   : milestone, 456,
iast_TELEMETRY_OFF (490.236 µs) : 468, 513
.   : milestone, 490,
tracing (452.249 µs) : 431, 473
.   : milestone, 452,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 390.753 µs [368.66 µs, 412.846 µs] -
iast 493.556 µs [472.048 µs, 515.064 µs] 102.803 µs (26.3%)
iast_FULL 655.358 µs [633.681 µs, 677.035 µs] 264.605 µs (67.7%)
iast_GLOBAL 530.587 µs [508.201 µs, 552.973 µs] 139.834 µs (35.8%)
iast_HARDCODED_SECRET_DISABLED 499.664 µs [478.088 µs, 521.241 µs] 108.911 µs (27.9%)
iast_INACTIVE 459.467 µs [438.393 µs, 480.541 µs] 68.714 µs (17.6%)
iast_TELEMETRY_OFF 481.739 µs [460.265 µs, 503.212 µs] 90.986 µs (23.3%)
tracing 458.962 µs [437.611 µs, 480.312 µs] 68.209 µs (17.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.817 µs [359.859 µs, 399.774 µs] -
iast 498.617 µs [476.746 µs, 520.489 µs] 118.801 µs (31.3%)
iast_FULL 656.902 µs [635.17 µs, 678.635 µs] 277.086 µs (73.0%)
iast_GLOBAL 531.599 µs [508.355 µs, 554.843 µs] 151.782 µs (40.0%)
iast_HARDCODED_SECRET_DISABLED 497.012 µs [475.392 µs, 518.632 µs] 117.195 µs (30.9%)
iast_INACTIVE 455.831 µs [434.746 µs, 476.915 µs] 76.014 µs (20.0%)
iast_TELEMETRY_OFF 490.236 µs [467.725 µs, 512.747 µs] 110.419 µs (29.1%)
tracing 452.249 µs [431.17 µs, 473.329 µs] 72.433 µs (19.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241229
git_commit_date 1734944119 1735445832
git_commit_sha 46b5986 899d2fc
release_version 1.45.0-SNAPSHOT~46b5986f6a 1.45.0-SNAPSHOT~899d2fc481
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1735447983 1735447983
ci_job_id 750532692 750532692
ci_pipeline_id 51876838 51876838
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~899d2fc481, baseline=1.45.0-SNAPSHOT~46b5986f6a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.487 s) : 15487000, 15487000
.   : milestone, 15487000,
appsec (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
iast (18.589 s) : 18589000, 18589000
.   : milestone, 18589000,
iast_GLOBAL (17.921 s) : 17921000, 17921000
.   : milestone, 17921000,
profiling (15.78 s) : 15780000, 15780000
.   : milestone, 15780000,
tracing (14.964 s) : 14964000, 14964000
.   : milestone, 14964000,
section candidate
no_agent (15.422 s) : 15422000, 15422000
.   : milestone, 15422000,
appsec (15.035 s) : 15035000, 15035000
.   : milestone, 15035000,
iast (18.995 s) : 18995000, 18995000
.   : milestone, 18995000,
iast_GLOBAL (17.586 s) : 17586000, 17586000
.   : milestone, 17586000,
profiling (14.962 s) : 14962000, 14962000
.   : milestone, 14962000,
tracing (15.125 s) : 15125000, 15125000
.   : milestone, 15125000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.487 s [15.487 s, 15.487 s] -
appsec 14.917 s [14.917 s, 14.917 s] -570.0 ms (-3.7%)
iast 18.589 s [18.589 s, 18.589 s] 3.102 s (20.0%)
iast_GLOBAL 17.921 s [17.921 s, 17.921 s] 2.434 s (15.7%)
profiling 15.78 s [15.78 s, 15.78 s] 293.0 ms (1.9%)
tracing 14.964 s [14.964 s, 14.964 s] -523.0 ms (-3.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.422 s [15.422 s, 15.422 s] -
appsec 15.035 s [15.035 s, 15.035 s] -387.0 ms (-2.5%)
iast 18.995 s [18.995 s, 18.995 s] 3.573 s (23.2%)
iast_GLOBAL 17.586 s [17.586 s, 17.586 s] 2.164 s (14.0%)
profiling 14.962 s [14.962 s, 14.962 s] -460.0 ms (-3.0%)
tracing 15.125 s [15.125 s, 15.125 s] -297.0 ms (-1.9%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~899d2fc481, baseline=1.45.0-SNAPSHOT~46b5986f6a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.34 ms) : 2298, 2381
.   : milestone, 2340,
iast (2.08 ms) : 2027, 2132
.   : milestone, 2080,
iast_GLOBAL (2.124 ms) : 2071, 2177
.   : milestone, 2124,
profiling (1.944 ms) : 1902, 1986
.   : milestone, 1944,
tracing (1.92 ms) : 1880, 1961
.   : milestone, 1920,
section candidate
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (2.332 ms) : 2290, 2373
.   : milestone, 2332,
iast (2.084 ms) : 2031, 2137
.   : milestone, 2084,
iast_GLOBAL (2.125 ms) : 2072, 2178
.   : milestone, 2125,
profiling (1.964 ms) : 1921, 2007
.   : milestone, 1964,
tracing (1.931 ms) : 1890, 1971
.   : milestone, 1931,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.34 ms [2.298 ms, 2.381 ms] 878.253 µs (60.1%)
iast 2.08 ms [2.027 ms, 2.132 ms] 618.005 µs (42.3%)
iast_GLOBAL 2.124 ms [2.071 ms, 2.177 ms] 662.589 µs (45.3%)
profiling 1.944 ms [1.902 ms, 1.986 ms] 482.377 µs (33.0%)
tracing 1.92 ms [1.88 ms, 1.961 ms] 458.968 µs (31.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.455 ms, 1.478 ms] -
appsec 2.332 ms [2.29 ms, 2.373 ms] 865.648 µs (59.0%)
iast 2.084 ms [2.031 ms, 2.137 ms] 617.807 µs (42.1%)
iast_GLOBAL 2.125 ms [2.072 ms, 2.178 ms] 659.265 µs (45.0%)
profiling 1.964 ms [1.921 ms, 2.007 ms] 497.787 µs (34.0%)
tracing 1.931 ms [1.89 ms, 1.971 ms] 464.336 µs (31.7%)

@pr-commenter
Copy link

pr-commenter bot commented Dec 29, 2024

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241229
git_commit_date 1734944119 1735445847
git_commit_sha 46b5986 15699a7
See matching parameters
Baseline Candidate
ci_job_date 1735447088 1735447088
ci_job_id 750533135 750533135
ci_pipeline_id 51876847 51876847
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Dec 29, 2024

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241229
git_commit_date 1734944119 1735445826
git_commit_sha 46b5986 b40af21
See matching parameters
Baseline Candidate
ci_job_date 1735447139 1735447139
ci_job_id 750532499 750532499
ci_pipeline_id 51876834 51876834
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[+322.916op/s; +8483.159op/s] or [+0.104%; +2.728%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@amarziali amarziali enabled auto-merge (squash) December 30, 2024 09:57
@amarziali amarziali merged commit 7d4150e into master Dec 30, 2024
142 of 146 checks passed
@amarziali amarziali deleted the ci/update-gradle-dependencies-20241229 branch December 30, 2024 10:22
@github-actions github-actions bot added this to the 1.45.0 milestone Dec 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants