Skip to content

Update system-test commit to 752456136fab0642446d124ead05aa7d8f4fa5c4#8140

Merged
manuel-alvarez-alvarez merged 1 commit intomasterfrom
malvarez/update-system-tests
Jan 2, 2025
Merged

Update system-test commit to 752456136fab0642446d124ead05aa7d8f4fa5c4#8140
manuel-alvarez-alvarez merged 1 commit intomasterfrom
malvarez/update-system-tests

Conversation

@manuel-alvarez-alvarez
Copy link
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez commented Jan 2, 2025

What Does This Do

Updates pinned commit of system-tests to the latest one in main

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jan 2, 2025
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested a review from a team as a code owner January 2, 2025 10:09
@pr-commenter
Copy link

pr-commenter bot commented Jan 2, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/update-system-tests
git_commit_date 1735696685 1735812468
git_commit_sha e8df8a0 f6c717e
release_version 1.45.0-SNAPSHOT~e8df8a0d00 1.45.0-SNAPSHOT~f6c717eb86
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1735814760 1735814760
ci_job_id 752211819 752211819
ci_pipeline_id 51989584 51989584
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~f6c717eb86, baseline=1.45.0-SNAPSHOT~e8df8a0d00

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054949
Total [baseline] (8.628 s) : 0, 8628147
Agent [candidate] (1.056 s) : 0, 1056012
Total [candidate] (8.617 s) : 0, 8617231
section iast
Agent [baseline] (1.18 s) : 0, 1179702
Total [baseline] (9.203 s) : 0, 9202677
Agent [candidate] (1.184 s) : 0, 1183873
Total [candidate] (9.238 s) : 0, 9237910
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.179 s) : 0, 1178572
Total [baseline] (9.219 s) : 0, 9219468
Agent [candidate] (1.178 s) : 0, 1178283
Total [candidate] (9.157 s) : 0, 9157444
section iast_TELEMETRY_OFF
Agent [baseline] (1.174 s) : 0, 1174213
Total [baseline] (9.158 s) : 0, 9157805
Agent [candidate] (1.175 s) : 0, 1175181
Total [candidate] (9.187 s) : 0, 9187394
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.18 s 124.753 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.179 s 123.623 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.174 s 119.263 ms (11.3%)
Total tracing 8.628 s -
Total iast 9.203 s 574.53 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.219 s 591.32 ms (6.9%)
Total iast_TELEMETRY_OFF 9.158 s 529.658 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.184 s 127.861 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 122.27 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.175 s 119.169 ms (11.3%)
Total tracing 8.617 s -
Total iast 9.238 s 620.679 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.157 s 540.213 ms (6.3%)
Total iast_TELEMETRY_OFF 9.187 s 570.163 ms (6.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~f6c717eb86, baseline=1.45.0-SNAPSHOT~e8df8a0d00

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (714.408 ms) : 0, 714408
BytebuddyAgent [candidate] (714.47 ms) : 0, 714470
GlobalTracer [baseline] (257.128 ms) : 0, 257128
GlobalTracer [candidate] (257.438 ms) : 0, 257438
AppSec [baseline] (55.201 ms) : 0, 55201
AppSec [candidate] (55.039 ms) : 0, 55039
Remote Config [baseline] (709.25 µs) : 0, 709
Remote Config [candidate] (703.913 µs) : 0, 704
Telemetry [baseline] (12.466 ms) : 0, 12466
Telemetry [candidate] (13.326 ms) : 0, 13326
section iast
BytebuddyAgent [baseline] (829.991 ms) : 0, 829991
BytebuddyAgent [candidate] (831.778 ms) : 0, 831778
GlobalTracer [baseline] (246.716 ms) : 0, 246716
GlobalTracer [candidate] (248.508 ms) : 0, 248508
AppSec [baseline] (57.76 ms) : 0, 57760
AppSec [candidate] (57.854 ms) : 0, 57854
Remote Config [baseline] (648.212 µs) : 0, 648
Remote Config [candidate] (662.478 µs) : 0, 662
Telemetry [baseline] (8.492 ms) : 0, 8492
Telemetry [candidate] (8.587 ms) : 0, 8587
IAST [baseline] (21.151 ms) : 0, 21151
IAST [candidate] (21.46 ms) : 0, 21460
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (827.002 ms) : 0, 827002
BytebuddyAgent [candidate] (828.163 ms) : 0, 828163
GlobalTracer [baseline] (247.316 ms) : 0, 247316
GlobalTracer [candidate] (246.746 ms) : 0, 246746
AppSec [baseline] (58.45 ms) : 0, 58450
AppSec [candidate] (57.968 ms) : 0, 57968
Remote Config [baseline] (668.483 µs) : 0, 668
Remote Config [candidate] (642.059 µs) : 0, 642
Telemetry [baseline] (8.6 ms) : 0, 8600
Telemetry [candidate] (8.452 ms) : 0, 8452
IAST [baseline] (21.58 ms) : 0, 21580
IAST [candidate] (21.291 ms) : 0, 21291
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (825.622 ms) : 0, 825622
BytebuddyAgent [candidate] (825.969 ms) : 0, 825969
GlobalTracer [baseline] (245.945 ms) : 0, 245945
GlobalTracer [candidate] (246.503 ms) : 0, 246503
AppSec [baseline] (57.031 ms) : 0, 57031
AppSec [candidate] (57.758 ms) : 0, 57758
Remote Config [baseline] (639.795 µs) : 0, 640
Remote Config [candidate] (649.512 µs) : 0, 650
Telemetry [baseline] (8.345 ms) : 0, 8345
Telemetry [candidate] (8.328 ms) : 0, 8328
IAST [baseline] (21.583 ms) : 0, 21583
IAST [candidate] (20.949 ms) : 0, 20949
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~f6c717eb86, baseline=1.45.0-SNAPSHOT~e8df8a0d00

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053101
Total [baseline] (10.413 s) : 0, 10412656
Agent [candidate] (1.056 s) : 0, 1055906
Total [candidate] (10.455 s) : 0, 10455443
section appsec
Agent [baseline] (1.189 s) : 0, 1189301
Total [baseline] (10.782 s) : 0, 10781993
Agent [candidate] (1.191 s) : 0, 1191255
Total [candidate] (10.785 s) : 0, 10785236
section iast
Agent [baseline] (1.185 s) : 0, 1185360
Total [baseline] (10.978 s) : 0, 10978042
Agent [candidate] (1.185 s) : 0, 1185081
Total [candidate] (11.036 s) : 0, 11036433
section profiling
Agent [baseline] (1.275 s) : 0, 1274709
Total [baseline] (10.919 s) : 0, 10919478
Agent [candidate] (1.275 s) : 0, 1274650
Total [candidate] (10.892 s) : 0, 10891739
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.189 s 136.2 ms (12.9%)
Agent iast 1.185 s 132.259 ms (12.6%)
Agent profiling 1.275 s 221.608 ms (21.0%)
Total tracing 10.413 s -
Total appsec 10.782 s 369.337 ms (3.5%)
Total iast 10.978 s 565.386 ms (5.4%)
Total profiling 10.919 s 506.822 ms (4.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.191 s 135.348 ms (12.8%)
Agent iast 1.185 s 129.174 ms (12.2%)
Agent profiling 1.275 s 218.743 ms (20.7%)
Total tracing 10.455 s -
Total appsec 10.785 s 329.793 ms (3.2%)
Total iast 11.036 s 580.99 ms (5.6%)
Total profiling 10.892 s 436.296 ms (4.2%) 
gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~f6c717eb86, baseline=1.45.0-SNAPSHOT~e8df8a0d00

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (712.482 ms) : 0, 712482
BytebuddyAgent [candidate] (713.112 ms) : 0, 713112
GlobalTracer [baseline] (257.114 ms) : 0, 257114
GlobalTracer [candidate] (257.328 ms) : 0, 257328
AppSec [baseline] (55.135 ms) : 0, 55135
AppSec [candidate] (55.031 ms) : 0, 55031
Remote Config [baseline] (714.256 µs) : 0, 714
Remote Config [candidate] (704.332 µs) : 0, 704
Telemetry [baseline] (12.656 ms) : 0, 12656
Telemetry [candidate] (14.628 ms) : 0, 14628
section appsec
BytebuddyAgent [baseline] (731.329 ms) : 0, 731329
BytebuddyAgent [candidate] (732.224 ms) : 0, 732224
GlobalTracer [baseline] (253.974 ms) : 0, 253974
GlobalTracer [candidate] (254.622 ms) : 0, 254622
AppSec [baseline] (170.437 ms) : 0, 170437
AppSec [candidate] (170.853 ms) : 0, 170853
Remote Config [baseline] (658.96 µs) : 0, 659
Remote Config [candidate] (662.703 µs) : 0, 663
Telemetry [baseline] (8.103 ms) : 0, 8103
Telemetry [candidate] (8.076 ms) : 0, 8076
IAST [baseline] (19.642 ms) : 0, 19642
IAST [candidate] (19.531 ms) : 0, 19531
section iast
BytebuddyAgent [baseline] (834.476 ms) : 0, 834476
BytebuddyAgent [candidate] (832.224 ms) : 0, 832224
GlobalTracer [baseline] (247.296 ms) : 0, 247296
GlobalTracer [candidate] (248.507 ms) : 0, 248507
AppSec [baseline] (58.01 ms) : 0, 58010
AppSec [candidate] (58.193 ms) : 0, 58193
Remote Config [baseline] (643.115 µs) : 0, 643
Remote Config [candidate] (661.123 µs) : 0, 661
Telemetry [baseline] (8.561 ms) : 0, 8561
Telemetry [candidate] (8.691 ms) : 0, 8691
IAST [baseline] (21.259 ms) : 0, 21259
IAST [candidate] (21.79 ms) : 0, 21790
section profiling
BytebuddyAgent [baseline] (701.425 ms) : 0, 701425
BytebuddyAgent [candidate] (702.662 ms) : 0, 702662
GlobalTracer [baseline] (371.333 ms) : 0, 371333
GlobalTracer [candidate] (371.03 ms) : 0, 371030
AppSec [baseline] (54.734 ms) : 0, 54734
AppSec [candidate] (54.909 ms) : 0, 54909
Remote Config [baseline] (683.307 µs) : 0, 683
Remote Config [candidate] (663.739 µs) : 0, 664
Telemetry [baseline] (7.907 ms) : 0, 7907
Telemetry [candidate] (7.889 ms) : 0, 7889
ProfilingAgent [baseline] (96.731 ms) : 0, 96731
ProfilingAgent [candidate] (95.733 ms) : 0, 95733
Profiling [baseline] (96.758 ms) : 0, 96758
Profiling [candidate] (95.76 ms) : 0, 95760
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-02T10:16:15 2025-01-02T10:23:14
git_branch master malvarez/update-system-tests
git_commit_date 1735696685 1735812468
git_commit_sha e8df8a0 f6c717e
release_version 1.45.0-SNAPSHOT~e8df8a0d00 1.45.0-SNAPSHOT~f6c717eb86
start_time 2025-01-02T10:16:02 2025-01-02T10:23:01
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1735813748 1735813748
ci_job_id 752211820 752211820
ci_pipeline_id 51989584 51989584
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~f6c717eb86, baseline=1.45.0-SNAPSHOT~e8df8a0d00
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.35 ms) : 1330, 1369
.   : milestone, 1350,
appsec (1.765 ms) : 1742, 1789
.   : milestone, 1765,
appsec_no_iast (1.742 ms) : 1718, 1766
.   : milestone, 1742,
iast (1.5 ms) : 1476, 1523
.   : milestone, 1500,
profiling (1.581 ms) : 1557, 1606
.   : milestone, 1581,
tracing (1.476 ms) : 1451, 1501
.   : milestone, 1476,
section candidate
no_agent (1.35 ms) : 1329, 1370
.   : milestone, 1350,
appsec (1.733 ms) : 1709, 1756
.   : milestone, 1733,
appsec_no_iast (1.755 ms) : 1731, 1779
.   : milestone, 1755,
iast (1.487 ms) : 1464, 1511
.   : milestone, 1487,
profiling (1.568 ms) : 1543, 1592
.   : milestone, 1568,
tracing (1.472 ms) : 1447, 1498
.   : milestone, 1472,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.33 ms, 1.369 ms] -
appsec 1.765 ms [1.742 ms, 1.789 ms] 415.642 µs (30.8%)
appsec_no_iast 1.742 ms [1.718 ms, 1.766 ms] 392.181 µs (29.1%)
iast 1.5 ms [1.476 ms, 1.523 ms] 149.734 µs (11.1%)
profiling 1.581 ms [1.557 ms, 1.606 ms] 231.69 µs (17.2%)
tracing 1.476 ms [1.451 ms, 1.501 ms] 126.023 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.329 ms, 1.37 ms] -
appsec 1.733 ms [1.709 ms, 1.756 ms] 383.151 µs (28.4%)
appsec_no_iast 1.755 ms [1.731 ms, 1.779 ms] 405.115 µs (30.0%)
iast 1.487 ms [1.464 ms, 1.511 ms] 137.561 µs (10.2%)
profiling 1.568 ms [1.543 ms, 1.592 ms] 217.889 µs (16.1%)
tracing 1.472 ms [1.447 ms, 1.498 ms] 122.848 µs (9.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~f6c717eb86, baseline=1.45.0-SNAPSHOT~e8df8a0d00
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.431 µs) : 351, 392
.   : milestone, 371,
iast (492.157 µs) : 470, 514
.   : milestone, 492,
iast_FULL (654.152 µs) : 632, 676
.   : milestone, 654,
iast_GLOBAL (518.448 µs) : 497, 540
.   : milestone, 518,
iast_HARDCODED_SECRET_DISABLED (494.471 µs) : 473, 516
.   : milestone, 494,
iast_INACTIVE (447.378 µs) : 427, 468
.   : milestone, 447,
iast_TELEMETRY_OFF (481.932 µs) : 460, 504
.   : milestone, 482,
tracing (450.526 µs) : 430, 471
.   : milestone, 451,
section candidate
no_agent (373.161 µs) : 353, 393
.   : milestone, 373,
iast (490.948 µs) : 470, 512
.   : milestone, 491,
iast_FULL (655.719 µs) : 634, 677
.   : milestone, 656,
iast_GLOBAL (528.184 µs) : 506, 551
.   : milestone, 528,
iast_HARDCODED_SECRET_DISABLED (492.597 µs) : 471, 514
.   : milestone, 493,
iast_INACTIVE (448.327 µs) : 427, 469
.   : milestone, 448,
iast_TELEMETRY_OFF (476.493 µs) : 455, 498
.   : milestone, 476,
tracing (440.858 µs) : 421, 461
.   : milestone, 441,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.431 µs [351.127 µs, 391.734 µs] -
iast 492.157 µs [470.424 µs, 513.889 µs] 120.726 µs (32.5%)
iast_FULL 654.152 µs [632.387 µs, 675.916 µs] 282.721 µs (76.1%)
iast_GLOBAL 518.448 µs [497.193 µs, 539.703 µs] 147.017 µs (39.6%)
iast_HARDCODED_SECRET_DISABLED 494.471 µs [472.764 µs, 516.178 µs] 123.04 µs (33.1%)
iast_INACTIVE 447.378 µs [426.638 µs, 468.117 µs] 75.947 µs (20.4%)
iast_TELEMETRY_OFF 481.932 µs [460.01 µs, 503.854 µs] 110.501 µs (29.8%)
tracing 450.526 µs [429.656 µs, 471.397 µs] 79.096 µs (21.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.161 µs [353.414 µs, 392.907 µs] -
iast 490.948 µs [469.662 µs, 512.234 µs] 117.788 µs (31.6%)
iast_FULL 655.719 µs [634.281 µs, 677.158 µs] 282.559 µs (75.7%)
iast_GLOBAL 528.184 µs [505.558 µs, 550.81 µs] 155.023 µs (41.5%)
iast_HARDCODED_SECRET_DISABLED 492.597 µs [471.013 µs, 514.18 µs] 119.436 µs (32.0%)
iast_INACTIVE 448.327 µs [427.188 µs, 469.466 µs] 75.166 µs (20.1%)
iast_TELEMETRY_OFF 476.493 µs [454.741 µs, 498.245 µs] 103.333 µs (27.7%)
tracing 440.858 µs [420.616 µs, 461.099 µs] 67.697 µs (18.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/update-system-tests
git_commit_date 1735696685 1735812468
git_commit_sha e8df8a0 f6c717e
release_version 1.45.0-SNAPSHOT~e8df8a0d00 1.45.0-SNAPSHOT~f6c717eb86
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1735814427 1735814427
ci_job_id 752211821 752211821
ci_pipeline_id 51989584 51989584
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~f6c717eb86, baseline=1.45.0-SNAPSHOT~e8df8a0d00
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
appsec (15.156 s) : 15156000, 15156000
.   : milestone, 15156000,
iast (19.053 s) : 19053000, 19053000
.   : milestone, 19053000,
iast_GLOBAL (18.054 s) : 18054000, 18054000
.   : milestone, 18054000,
profiling (15.237 s) : 15237000, 15237000
.   : milestone, 15237000,
tracing (14.953 s) : 14953000, 14953000
.   : milestone, 14953000,
section candidate
no_agent (14.768 s) : 14768000, 14768000
.   : milestone, 14768000,
appsec (15.027 s) : 15027000, 15027000
.   : milestone, 15027000,
iast (19.199 s) : 19199000, 19199000
.   : milestone, 19199000,
iast_GLOBAL (18.016 s) : 18016000, 18016000
.   : milestone, 18016000,
profiling (15.743 s) : 15743000, 15743000
.   : milestone, 15743000,
tracing (14.794 s) : 14794000, 14794000
.   : milestone, 14794000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.987 s [14.987 s, 14.987 s] -
appsec 15.156 s [15.156 s, 15.156 s] 169.0 ms (1.1%)
iast 19.053 s [19.053 s, 19.053 s] 4.066 s (27.1%)
iast_GLOBAL 18.054 s [18.054 s, 18.054 s] 3.067 s (20.5%)
profiling 15.237 s [15.237 s, 15.237 s] 250.0 ms (1.7%)
tracing 14.953 s [14.953 s, 14.953 s] -34.0 ms (-0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.768 s [14.768 s, 14.768 s] -
appsec 15.027 s [15.027 s, 15.027 s] 259.0 ms (1.8%)
iast 19.199 s [19.199 s, 19.199 s] 4.431 s (30.0%)
iast_GLOBAL 18.016 s [18.016 s, 18.016 s] 3.248 s (22.0%)
profiling 15.743 s [15.743 s, 15.743 s] 975.0 ms (6.6%)
tracing 14.794 s [14.794 s, 14.794 s] 26.0 ms (0.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~f6c717eb86, baseline=1.45.0-SNAPSHOT~e8df8a0d00
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (2.34 ms) : 2298, 2382
.   : milestone, 2340,
iast (2.089 ms) : 2036, 2142
.   : milestone, 2089,
iast_GLOBAL (2.135 ms) : 2082, 2189
.   : milestone, 2135,
profiling (2.459 ms) : 2268, 2650
.   : milestone, 2459,
tracing (1.925 ms) : 1884, 1965
.   : milestone, 1925,
section candidate
no_agent (1.466 ms) : 1454, 1477
.   : milestone, 1466,
appsec (2.337 ms) : 2295, 2378
.   : milestone, 2337,
iast (2.086 ms) : 2033, 2139
.   : milestone, 2086,
iast_GLOBAL (2.124 ms) : 2071, 2177
.   : milestone, 2124,
profiling (1.953 ms) : 1911, 1995
.   : milestone, 1953,
tracing (1.928 ms) : 1888, 1969
.   : milestone, 1928,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.455 ms, 1.478 ms] -
appsec 2.34 ms [2.298 ms, 2.382 ms] 874.205 µs (59.6%)
iast 2.089 ms [2.036 ms, 2.142 ms] 622.859 µs (42.5%)
iast_GLOBAL 2.135 ms [2.082 ms, 2.189 ms] 669.194 µs (45.6%)
profiling 2.459 ms [2.268 ms, 2.65 ms] 992.743 µs (67.7%)
tracing 1.925 ms [1.884 ms, 1.965 ms] 458.633 µs (31.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.454 ms, 1.477 ms] -
appsec 2.337 ms [2.295 ms, 2.378 ms] 871.11 µs (59.4%)
iast 2.086 ms [2.033 ms, 2.139 ms] 620.479 µs (42.3%)
iast_GLOBAL 2.124 ms [2.071 ms, 2.177 ms] 658.51 µs (44.9%)
profiling 1.953 ms [1.911 ms, 1.995 ms] 487.361 µs (33.3%)
tracing 1.928 ms [1.888 ms, 1.969 ms] 462.879 µs (31.6%)

@manuel-alvarez-alvarez manuel-alvarez-alvarez merged commit c24db36 into master Jan 2, 2025
10 checks passed
@manuel-alvarez-alvarez manuel-alvarez-alvarez deleted the malvarez/update-system-tests branch January 2, 2025 11:05
@github-actions github-actions bot added this to the 1.45.0 milestone Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@nayeem-kamal nayeem-kamal Awaiting requested review from nayeem-kamal nayeem-kamal was automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.45.0

Development

Successfully merging this pull request may close these issues.

2 participants

@manuel-alvarez-alvarez @PerfectSlayer