Skip to content

Fix test name uniqueness #8020

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
PerfectSlayer merged 6 commits into from
Nov 28, 2024
Merged

Fix test name uniqueness #8020

PerfectSlayer merged 6 commits into from
Nov 28, 2024

Conversation

@PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Nov 26, 2024 •
edited
Loading

What Does This Do

This PR fixes test name uniqueness.

Motivation

This will help with CI monitoring to keep track of test execution.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Nov 26, 2024
@PerfectSlayer PerfectSlayer requested review from a team as code owners November 26, 2024 15:56
@pr-commenter
Copy link

pr-commenter bot commented Nov 26, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1732745437 1732783592
git_commit_sha 600378f d33ab4b
release_version 1.44.0-SNAPSHOT~600378f050 1.44.0-SNAPSHOT~d33ab4b5f6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1732786129 1732786129
ci_job_id 722604792 722604792
ci_pipeline_id 50095911 50095911
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Remote Config better
[-68.932µs; -20.002µs] or [-10.560%; -3.064%]		 608.273µs 652.740µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.44.0-SNAPSHOT~d33ab4b5f6, baseline=1.44.0-SNAPSHOT~600378f050

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.092 s) : 0, 1092341
Total [baseline] (10.448 s) : 0, 10447680
Agent [candidate] (1.092 s) : 0, 1092234
Total [candidate] (10.455 s) : 0, 10455351
section appsec
Agent [baseline] (1.227 s) : 0, 1227161
Total [baseline] (10.729 s) : 0, 10729433
Agent [candidate] (1.226 s) : 0, 1226346
Total [candidate] (10.755 s) : 0, 10754861
section iast
Agent [baseline] (1.223 s) : 0, 1222743
Total [baseline] (10.978 s) : 0, 10978393
Agent [candidate] (1.217 s) : 0, 1217025
Total [candidate] (10.941 s) : 0, 10941060
section profiling
Agent [baseline] (1.317 s) : 0, 1317447
Total [baseline] (10.838 s) : 0, 10838145
Agent [candidate] (1.318 s) : 0, 1318478
Total [candidate] (10.838 s) : 0, 10837538
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.092 s -
Agent appsec 1.227 s 134.819 ms (12.3%)
Agent iast 1.223 s 130.402 ms (11.9%)
Agent profiling 1.317 s 225.105 ms (20.6%)
Total tracing 10.448 s -
Total appsec 10.729 s 281.753 ms (2.7%)
Total iast 10.978 s 530.713 ms (5.1%)
Total profiling 10.838 s 390.465 ms (3.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.092 s -
Agent appsec 1.226 s 134.112 ms (12.3%)
Agent iast 1.217 s 124.792 ms (11.4%)
Agent profiling 1.318 s 226.245 ms (20.7%)
Total tracing 10.455 s -
Total appsec 10.755 s 299.51 ms (2.9%)
Total iast 10.941 s 485.709 ms (4.6%)
Total profiling 10.838 s 382.187 ms (3.7%) 
gantt
    title petclinic - break down per module: candidate=1.44.0-SNAPSHOT~d33ab4b5f6, baseline=1.44.0-SNAPSHOT~600378f050

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (695.241 ms) : 0, 695241
BytebuddyAgent [candidate] (694.11 ms) : 0, 694110
GlobalTracer [baseline] (318.703 ms) : 0, 318703
GlobalTracer [candidate] (318.431 ms) : 0, 318431
AppSec [baseline] (54.774 ms) : 0, 54774
AppSec [candidate] (54.628 ms) : 0, 54628
Remote Config [baseline] (688.81 µs) : 0, 689
Remote Config [candidate] (701.698 µs) : 0, 702
Telemetry [baseline] (9.172 ms) : 0, 9172
Telemetry [candidate] (10.623 ms) : 0, 10623
section appsec
BytebuddyAgent [baseline] (712.256 ms) : 0, 712256
BytebuddyAgent [candidate] (711.579 ms) : 0, 711579
GlobalTracer [baseline] (315.384 ms) : 0, 315384
GlobalTracer [candidate] (314.719 ms) : 0, 314719
AppSec [baseline] (167.495 ms) : 0, 167495
AppSec [candidate] (166.527 ms) : 0, 166527
Remote Config [baseline] (639.998 µs) : 0, 640
Remote Config [candidate] (646.232 µs) : 0, 646
Telemetry [baseline] (8.107 ms) : 0, 8107
Telemetry [candidate] (9.253 ms) : 0, 9253
IAST [baseline] (19.074 ms) : 0, 19074
IAST [candidate] (19.787 ms) : 0, 19787
section iast
BytebuddyAgent [baseline] (814.943 ms) : 0, 814943
BytebuddyAgent [candidate] (810.44 ms) : 0, 810440
GlobalTracer [baseline] (306.662 ms) : 0, 306662
GlobalTracer [candidate] (305.82 ms) : 0, 305820
AppSec [baseline] (58.235 ms) : 0, 58235
AppSec [candidate] (57.255 ms) : 0, 57255
Remote Config [baseline] (623.831 µs) : 0, 624
Remote Config [candidate] (606.134 µs) : 0, 606
Telemetry [baseline] (7.502 ms) : 0, 7502
Telemetry [candidate] (7.506 ms) : 0, 7506
IAST [baseline] (20.926 ms) : 0, 20926
IAST [candidate] (21.654 ms) : 0, 21654
section profiling
BytebuddyAgent [baseline] (688.143 ms) : 0, 688143
BytebuddyAgent [candidate] (688.667 ms) : 0, 688667
GlobalTracer [baseline] (433.866 ms) : 0, 433866
GlobalTracer [candidate] (434.817 ms) : 0, 434817
AppSec [baseline] (53.647 ms) : 0, 53647
AppSec [candidate] (53.706 ms) : 0, 53706
Remote Config [baseline] (646.871 µs) : 0, 647
Remote Config [candidate] (668.152 µs) : 0, 668
Telemetry [baseline] (7.734 ms) : 0, 7734
Telemetry [candidate] (7.743 ms) : 0, 7743
ProfilingAgent [baseline] (94.317 ms) : 0, 94317
ProfilingAgent [candidate] (93.731 ms) : 0, 93731
Profiling [baseline] (94.341 ms) : 0, 94341
Profiling [candidate] (93.756 ms) : 0, 93756
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.44.0-SNAPSHOT~d33ab4b5f6, baseline=1.44.0-SNAPSHOT~600378f050

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.099 s) : 0, 1098799
Total [baseline] (8.705 s) : 0, 8705392
Agent [candidate] (1.107 s) : 0, 1107377
Total [candidate] (8.746 s) : 0, 8746290
section iast
Agent [baseline] (1.221 s) : 0, 1221089
Total [baseline] (9.226 s) : 0, 9225884
Agent [candidate] (1.22 s) : 0, 1219511
Total [candidate] (9.212 s) : 0, 9211804
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.236 s) : 0, 1236262
Total [baseline] (9.274 s) : 0, 9274221
Agent [candidate] (1.223 s) : 0, 1222696
Total [candidate] (9.227 s) : 0, 9226598
section iast_TELEMETRY_OFF
Agent [baseline] (1.216 s) : 0, 1215527
Total [baseline] (9.181 s) : 0, 9180671
Agent [candidate] (1.226 s) : 0, 1225854
Total [candidate] (9.198 s) : 0, 9198240
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.099 s -
Agent iast 1.221 s 122.291 ms (11.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.236 s 137.464 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.216 s 116.728 ms (10.6%)
Total tracing 8.705 s -
Total iast 9.226 s 520.492 ms (6.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.274 s 568.829 ms (6.5%)
Total iast_TELEMETRY_OFF 9.181 s 475.278 ms (5.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.107 s -
Agent iast 1.22 s 112.134 ms (10.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.223 s 115.32 ms (10.4%)
Agent iast_TELEMETRY_OFF 1.226 s 118.478 ms (10.7%)
Total tracing 8.746 s -
Total iast 9.212 s 465.514 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.227 s 480.308 ms (5.5%)
Total iast_TELEMETRY_OFF 9.198 s 451.95 ms (5.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.44.0-SNAPSHOT~d33ab4b5f6, baseline=1.44.0-SNAPSHOT~600378f050

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (699.824 ms) : 0, 699824
BytebuddyAgent [candidate] (704.631 ms) : 0, 704631
GlobalTracer [baseline] (320.143 ms) : 0, 320143
GlobalTracer [candidate] (322.513 ms) : 0, 322513
AppSec [baseline] (55.055 ms) : 0, 55055
AppSec [candidate] (55.631 ms) : 0, 55631
Remote Config [baseline] (690.531 µs) : 0, 691
Remote Config [candidate] (690.993 µs) : 0, 691
Telemetry [baseline] (9.254 ms) : 0, 9254
Telemetry [candidate] (9.938 ms) : 0, 9938
section iast
BytebuddyAgent [baseline] (813.715 ms) : 0, 813715
BytebuddyAgent [candidate] (811.876 ms) : 0, 811876
GlobalTracer [baseline] (307.065 ms) : 0, 307065
GlobalTracer [candidate] (306.823 ms) : 0, 306823
AppSec [baseline] (57.437 ms) : 0, 57437
AppSec [candidate] (58.228 ms) : 0, 58228
IAST [baseline] (20.897 ms) : 0, 20897
IAST [candidate] (20.655 ms) : 0, 20655
Remote Config [baseline] (652.74 µs) : 0, 653
Remote Config [candidate] (608.273 µs) : 0, 608
Telemetry [baseline] (7.54 ms) : 0, 7540
Telemetry [candidate] (7.525 ms) : 0, 7525
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (824.39 ms) : 0, 824390
BytebuddyAgent [candidate] (812.532 ms) : 0, 812532
GlobalTracer [baseline] (309.941 ms) : 0, 309941
GlobalTracer [candidate] (308.057 ms) : 0, 308057
AppSec [baseline] (56.764 ms) : 0, 56764
AppSec [candidate] (57.366 ms) : 0, 57366
IAST [baseline] (22.829 ms) : 0, 22829
IAST [candidate] (22.73 ms) : 0, 22730
Remote Config [baseline] (626.865 µs) : 0, 627
Remote Config [candidate] (630.292 µs) : 0, 630
Telemetry [baseline] (7.597 ms) : 0, 7597
Telemetry [candidate] (7.629 ms) : 0, 7629
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (808.562 ms) : 0, 808562
BytebuddyAgent [candidate] (815.37 ms) : 0, 815370
GlobalTracer [baseline] (306.532 ms) : 0, 306532
GlobalTracer [candidate] (309.328 ms) : 0, 309328
AppSec [baseline] (58.125 ms) : 0, 58125
AppSec [candidate] (57.086 ms) : 0, 57086
IAST [baseline] (20.456 ms) : 0, 20456
IAST [candidate] (22.091 ms) : 0, 22091
Remote Config [baseline] (630.016 µs) : 0, 630
Remote Config [candidate] (650.652 µs) : 0, 651
Telemetry [baseline] (7.486 ms) : 0, 7486
Telemetry [candidate] (7.462 ms) : 0, 7462
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-28T08:58:52 2024-11-28T09:05:49
git_branch master bbujon/ci
git_commit_date 1732745437 1732783592
git_commit_sha 600378f d33ab4b
release_version 1.44.0-SNAPSHOT~600378f050 1.44.0-SNAPSHOT~d33ab4b5f6
start_time 2024-11-28T08:58:38 2024-11-28T09:05:35
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1732785100 1732785100
ci_job_id 722604793 722604793
ci_pipeline_id 50095911 50095911
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~d33ab4b5f6, baseline=1.44.0-SNAPSHOT~600378f050
    dateFormat X
    axisFormat %s
section baseline
no_agent (364.692 µs) : 345, 384
.   : milestone, 365,
iast (498.816 µs) : 477, 521
.   : milestone, 499,
iast_FULL (650.887 µs) : 629, 672
.   : milestone, 651,
iast_GLOBAL (527.232 µs) : 504, 551
.   : milestone, 527,
iast_HARDCODED_SECRET_DISABLED (487.868 µs) : 467, 509
.   : milestone, 488,
iast_INACTIVE (445.545 µs) : 425, 466
.   : milestone, 446,
iast_TELEMETRY_OFF (475.076 µs) : 454, 497
.   : milestone, 475,
tracing (445.977 µs) : 425, 467
.   : milestone, 446,
section candidate
no_agent (376.695 µs) : 356, 397
.   : milestone, 377,
iast (485.622 µs) : 464, 507
.   : milestone, 486,
iast_FULL (647.465 µs) : 626, 669
.   : milestone, 647,
iast_GLOBAL (524.466 µs) : 502, 547
.   : milestone, 524,
iast_HARDCODED_SECRET_DISABLED (489.928 µs) : 468, 511
.   : milestone, 490,
iast_INACTIVE (439.931 µs) : 419, 461
.   : milestone, 440,
iast_TELEMETRY_OFF (475.667 µs) : 454, 497
.   : milestone, 476,
tracing (451.421 µs) : 431, 472
.   : milestone, 451,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.692 µs [345.02 µs, 384.365 µs] -
iast 498.816 µs [476.975 µs, 520.657 µs] 134.124 µs (36.8%)
iast_FULL 650.887 µs [629.427 µs, 672.346 µs] 286.195 µs (78.5%)
iast_GLOBAL 527.232 µs [503.877 µs, 550.587 µs] 162.54 µs (44.6%)
iast_HARDCODED_SECRET_DISABLED 487.868 µs [466.507 µs, 509.229 µs] 123.176 µs (33.8%)
iast_INACTIVE 445.545 µs [424.895 µs, 466.196 µs] 80.853 µs (22.2%)
iast_TELEMETRY_OFF 475.076 µs [453.644 µs, 496.507 µs] 110.383 µs (30.3%)
tracing 445.977 µs [424.592 µs, 467.362 µs] 81.285 µs (22.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.695 µs [356.198 µs, 397.193 µs] -
iast 485.622 µs [464.355 µs, 506.89 µs] 108.927 µs (28.9%)
iast_FULL 647.465 µs [625.958 µs, 668.973 µs] 270.77 µs (71.9%)
iast_GLOBAL 524.466 µs [502.066 µs, 546.867 µs] 147.771 µs (39.2%)
iast_HARDCODED_SECRET_DISABLED 489.928 µs [468.356 µs, 511.499 µs] 113.233 µs (30.1%)
iast_INACTIVE 439.931 µs [419.328 µs, 460.534 µs] 63.236 µs (16.8%)
iast_TELEMETRY_OFF 475.667 µs [454.117 µs, 497.218 µs] 98.972 µs (26.3%)
tracing 451.421 µs [430.702 µs, 472.141 µs] 74.726 µs (19.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~d33ab4b5f6, baseline=1.44.0-SNAPSHOT~600378f050
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.346 ms) : 1326, 1367
.   : milestone, 1346,
appsec (1.753 ms) : 1728, 1778
.   : milestone, 1753,
appsec_no_iast (1.753 ms) : 1729, 1777
.   : milestone, 1753,
iast (1.502 ms) : 1480, 1524
.   : milestone, 1502,
profiling (1.489 ms) : 1466, 1512
.   : milestone, 1489,
tracing (1.486 ms) : 1460, 1512
.   : milestone, 1486,
section candidate
no_agent (1.35 ms) : 1329, 1370
.   : milestone, 1350,
appsec (1.73 ms) : 1705, 1755
.   : milestone, 1730,
appsec_no_iast (1.749 ms) : 1725, 1773
.   : milestone, 1749,
iast (1.476 ms) : 1453, 1499
.   : milestone, 1476,
profiling (1.534 ms) : 1510, 1558
.   : milestone, 1534,
tracing (1.478 ms) : 1454, 1502
.   : milestone, 1478,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.346 ms [1.326 ms, 1.367 ms] -
appsec 1.753 ms [1.728 ms, 1.778 ms] 406.789 µs (30.2%)
appsec_no_iast 1.753 ms [1.729 ms, 1.777 ms] 407.078 µs (30.2%)
iast 1.502 ms [1.48 ms, 1.524 ms] 155.976 µs (11.6%)
profiling 1.489 ms [1.466 ms, 1.512 ms] 142.901 µs (10.6%)
tracing 1.486 ms [1.46 ms, 1.512 ms] 139.772 µs (10.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.329 ms, 1.37 ms] -
appsec 1.73 ms [1.705 ms, 1.755 ms] 380.347 µs (28.2%)
appsec_no_iast 1.749 ms [1.725 ms, 1.773 ms] 399.353 µs (29.6%)
iast 1.476 ms [1.453 ms, 1.499 ms] 126.442 µs (9.4%)
profiling 1.534 ms [1.51 ms, 1.558 ms] 184.476 µs (13.7%)
tracing 1.478 ms [1.454 ms, 1.502 ms] 128.316 µs (9.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1732745437 1732783592
git_commit_sha 600378f d33ab4b
release_version 1.44.0-SNAPSHOT~600378f050 1.44.0-SNAPSHOT~d33ab4b5f6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1732785675 1732785675
ci_job_id 722604794 722604794
ci_pipeline_id 50095911 50095911
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~d33ab4b5f6, baseline=1.44.0-SNAPSHOT~600378f050
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.342 ms) : 2301, 2383
.   : milestone, 2342,
iast (2.091 ms) : 2039, 2144
.   : milestone, 2091,
iast_GLOBAL (2.125 ms) : 2073, 2178
.   : milestone, 2125,
profiling (1.946 ms) : 1904, 1988
.   : milestone, 1946,
tracing (1.929 ms) : 1889, 1969
.   : milestone, 1929,
section candidate
no_agent (1.47 ms) : 1458, 1482
.   : milestone, 1470,
appsec (2.346 ms) : 2304, 2387
.   : milestone, 2346,
iast (2.092 ms) : 2040, 2145
.   : milestone, 2092,
iast_GLOBAL (2.123 ms) : 2070, 2175
.   : milestone, 2123,
profiling (1.977 ms) : 1933, 2020
.   : milestone, 1977,
tracing (1.926 ms) : 1886, 1966
.   : milestone, 1926,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.342 ms [2.301 ms, 2.383 ms] 871.209 µs (59.2%)
iast 2.091 ms [2.039 ms, 2.144 ms] 620.454 µs (42.2%)
iast_GLOBAL 2.125 ms [2.073 ms, 2.178 ms] 654.536 µs (44.5%)
profiling 1.946 ms [1.904 ms, 1.988 ms] 475.31 µs (32.3%)
tracing 1.929 ms [1.889 ms, 1.969 ms] 457.944 µs (31.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.482 ms] -
appsec 2.346 ms [2.304 ms, 2.387 ms] 875.67 µs (59.6%)
iast 2.092 ms [2.04 ms, 2.145 ms] 622.268 µs (42.3%)
iast_GLOBAL 2.123 ms [2.07 ms, 2.175 ms] 652.491 µs (44.4%)
profiling 1.977 ms [1.933 ms, 2.02 ms] 506.933 µs (34.5%)
tracing 1.926 ms [1.886 ms, 1.966 ms] 456.095 µs (31.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~d33ab4b5f6, baseline=1.44.0-SNAPSHOT~600378f050
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
appsec (15.271 s) : 15271000, 15271000
.   : milestone, 15271000,
iast (18.964 s) : 18964000, 18964000
.   : milestone, 18964000,
iast_GLOBAL (17.94 s) : 17940000, 17940000
.   : milestone, 17940000,
profiling (14.74 s) : 14740000, 14740000
.   : milestone, 14740000,
tracing (14.723 s) : 14723000, 14723000
.   : milestone, 14723000,
section candidate
no_agent (14.896 s) : 14896000, 14896000
.   : milestone, 14896000,
appsec (14.77 s) : 14770000, 14770000
.   : milestone, 14770000,
iast (18.94 s) : 18940000, 18940000
.   : milestone, 18940000,
iast_GLOBAL (17.653 s) : 17653000, 17653000
.   : milestone, 17653000,
profiling (15.445 s) : 15445000, 15445000
.   : milestone, 15445000,
tracing (14.647 s) : 14647000, 14647000
.   : milestone, 14647000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.23 s [15.23 s, 15.23 s] -
appsec 15.271 s [15.271 s, 15.271 s] 41.0 ms (0.3%)
iast 18.964 s [18.964 s, 18.964 s] 3.734 s (24.5%)
iast_GLOBAL 17.94 s [17.94 s, 17.94 s] 2.71 s (17.8%)
profiling 14.74 s [14.74 s, 14.74 s] -490.0 ms (-3.2%)
tracing 14.723 s [14.723 s, 14.723 s] -507.0 ms (-3.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.896 s [14.896 s, 14.896 s] -
appsec 14.77 s [14.77 s, 14.77 s] -126.0 ms (-0.8%)
iast 18.94 s [18.94 s, 18.94 s] 4.044 s (27.1%)
iast_GLOBAL 17.653 s [17.653 s, 17.653 s] 2.757 s (18.5%)
profiling 15.445 s [15.445 s, 15.445 s] 549.0 ms (3.7%)
tracing 14.647 s [14.647 s, 14.647 s] -249.0 ms (-1.7%)

@PerfectSlayer PerfectSlayer requested a review from a team as a code owner November 28, 2024 08:47
@PerfectSlayer PerfectSlayer enabled auto-merge (squash) November 28, 2024 10:48
@PerfectSlayer PerfectSlayer added comp: testing Testing and removed comp: tooling Build & Tooling labels Nov 28, 2024
@PerfectSlayer PerfectSlayer merged commit 4d76fed into master Nov 28, 2024
92 of 102 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/ci branch November 28, 2024 11:09
@github-actions github-actions bot added this to the 1.44.0 milestone Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@smola smola smola approved these changes

@juan-fernandez juan-fernandez Awaiting requested review from juan-fernandez juan-fernandez is a code owner automatically assigned from DataDog/ci-app-libraries-java

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

@jandro996 jandro996 Awaiting requested review from jandro996 jandro996 is a code owner automatically assigned from DataDog/asm-java

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido is a code owner automatically assigned from DataDog/asm-java

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.44.0

Development

Successfully merging this pull request may close these issues.

3 participants

@PerfectSlayer @smola