Skip to content

Conversation

@PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Jun 4, 2025

What Does This Do

DRAFT ONLY

Motivation

Additional Notes

Contributor Checklist

Jira ticket: LANGPLAT-458

@PerfectSlayer PerfectSlayer added the tag: do not merge Do not merge changes label Jun 4, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 4, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1751342160 1751342531
end_time 2025-07-01T03:57:22 2025-07-01T04:03:32
git_branch master bbujon/environment
git_commit_sha 848b075 359dc42
start_time 2025-07-01T03:56:01 2025-07-01T04:02:12
See matching parameters
Baseline Candidate
ci_job_id 1006643614 1006643614
ci_pipeline_id 69250024 69250024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1751341544 1751341544

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 4 metrics, 8 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+143.896µs; +237.783µs] or [+1.434%; +2.369%]
worse
[+144.310µs; +264.421µs] or [+1.416%; +2.595%]
worse
[+111.545µs; +265.561µs] or [+1.083%; +2.579%]
same unsure
[-2.623op/s; -0.137op/s] or [-2.715%; -0.142%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-62.520µs; +24.004µs] or [-21.145%; +8.118%]
unstable
[-81.678µs; +29.669µs] or [-24.041%; +8.733%]
unstable
[-92.432µs; +35.294µs] or [-26.019%; +9.935%]
unstable
[-934.107µs; +330.371µs] or [-72.719%; +25.719%]
unstable
[-98.333op/s; +158.556op/s] or [-4.032%; +6.501%]
scenario:basic same same unstable
[-22.667µs; +13.351µs] or [-6.839%; +4.028%]
unstable
[-254.872µs; +137.809µs] or [-27.103%; +14.654%]
unstable
[-107.370op/s; +223.514op/s] or [-4.510%; +9.388%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (339.739 µs) : 269, 411
.   : milestone, 340,
basic (320.033 µs) : 302, 338
.   : milestone, 320,
loop (10.19 ms) : 10149, 10230
.   : milestone, 10190,
section candidate
noprobe (313.735 µs) : 290, 337
.   : milestone, 314,
basic (315.272 µs) : 307, 324
.   : milestone, 315,
loop (10.394 ms) : 10326, 10462
.   : milestone, 10394,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 339.739 µs [268.583 µs, 410.895 µs]
basic 320.033 µs [302.329 µs, 337.738 µs]
loop 10.19 ms [10.149 ms, 10.23 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 313.735 µs [290.247 µs, 337.223 µs]
basic 315.272 µs [306.888 µs, 323.656 µs]
loop 10.394 ms [10.326 ms, 10.462 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jun 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment
git_commit_date 1751341275 1751341544
git_commit_sha 848b075 359dc42
release_version 1.51.0-SNAPSHOT~848b0754aa 1.51.0-SNAPSHOT~359dc42703
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751343310 1751343310
ci_job_id 1006643607 1006643607
ci_pipeline_id 69250024 69250024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-5i3ajscr-project-304-concurrent-0-6oem83pz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-5i3ajscr-project-304-concurrent-0-6oem83pz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 5 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.001 s) : 0, 1001321
Total [baseline] (8.626 s) : 0, 8625667
Agent [candidate] (999.244 ms) : 0, 999244
Total [candidate] (8.57 s) : 0, 8570287
section iast
Agent [baseline] (1.136 s) : 0, 1136278
Total [baseline] (9.314 s) : 0, 9314322
Agent [candidate] (1.151 s) : 0, 1150908
Total [candidate] (9.32 s) : 0, 9319988
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.001 s -
Agent iast 1.136 s 134.957 ms (13.5%)
Total tracing 8.626 s -
Total iast 9.314 s 688.655 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 999.244 ms -
Agent iast 1.151 s 151.665 ms (15.2%)
Total tracing 8.57 s -
Total iast 9.32 s 749.701 ms (8.7%)
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.731 ms) : 0, 691731
BytebuddyAgent [candidate] (689.747 ms) : 0, 689747
GlobalTracer [baseline] (243.161 ms) : 0, 243161
GlobalTracer [candidate] (243.282 ms) : 0, 243282
AppSec [baseline] (30.682 ms) : 0, 30682
AppSec [candidate] (30.263 ms) : 0, 30263
Debugger [baseline] (6.067 ms) : 0, 6067
Debugger [candidate] (6.092 ms) : 0, 6092
Remote Config [baseline] (682.498 µs) : 0, 682
Remote Config [candidate] (686.839 µs) : 0, 687
Telemetry [baseline] (8.244 ms) : 0, 8244
Telemetry [candidate] (8.286 ms) : 0, 8286
section iast
BytebuddyAgent [baseline] (812.397 ms) : 0, 812397
BytebuddyAgent [candidate] (821.992 ms) : 0, 821992
GlobalTracer [baseline] (232.884 ms) : 0, 232884
GlobalTracer [candidate] (236.364 ms) : 0, 236364
AppSec [baseline] (29.388 ms) : 0, 29388
AppSec [candidate] (31.55 ms) : 0, 31550
Debugger [baseline] (5.832 ms) : 0, 5832
Debugger [candidate] (5.914 ms) : 0, 5914
Remote Config [baseline] (577.838 µs) : 0, 578
Remote Config [candidate] (584.109 µs) : 0, 584
Telemetry [baseline] (8.018 ms) : 0, 8018
Telemetry [candidate] (8.115 ms) : 0, 8115
IAST [baseline] (26.316 ms) : 0, 26316
IAST [candidate] (25.149 ms) : 0, 25149
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (997.399 ms) : 0, 997399
Total [baseline] (10.646 s) : 0, 10645923
Agent [candidate] (1.007 s) : 0, 1007365
Total [candidate] (10.817 s) : 0, 10817032
section appsec
Agent [baseline] (1.172 s) : 0, 1172431
Total [baseline] (10.758 s) : 0, 10757912
Agent [candidate] (1.188 s) : 0, 1187947
Total [candidate] (10.818 s) : 0, 10817540
section iast
Agent [baseline] (1.141 s) : 0, 1140748
Total [baseline] (4.426 s) : 0, 4426350
Agent [candidate] (1.141 s) : 0, 1140669
Total [candidate] (10.873 s) : 0, 10872841
section profiling
Agent [baseline] (1.245 s) : 0, 1244847
Total [baseline] (10.98 s) : 0, 10980194
Agent [candidate] (1.25 s) : 0, 1249946
Total [candidate] (11.02 s) : 0, 11020369
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 997.399 ms -
Agent appsec 1.172 s 175.032 ms (17.5%)
Agent iast 1.141 s 143.348 ms (14.4%)
Agent profiling 1.245 s 247.448 ms (24.8%)
Total tracing 10.646 s -
Total appsec 10.758 s 111.989 ms (1.1%)
Total iast 4.426 s -6.22 s (-58.4%)
Total profiling 10.98 s 334.271 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.007 s -
Agent appsec 1.188 s 180.583 ms (17.9%)
Agent iast 1.141 s 133.305 ms (13.2%)
Agent profiling 1.25 s 242.582 ms (24.1%)
Total tracing 10.817 s -
Total appsec 10.818 s 508.472 µs (0.0%)
Total iast 10.873 s 55.809 ms (0.5%)
Total profiling 11.02 s 203.337 ms (1.9%)
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.588 ms) : 0, 688588
BytebuddyAgent [candidate] (696.128 ms) : 0, 696128
GlobalTracer [baseline] (242.452 ms) : 0, 242452
GlobalTracer [candidate] (244.438 ms) : 0, 244438
AppSec [baseline] (30.562 ms) : 0, 30562
AppSec [candidate] (30.687 ms) : 0, 30687
Debugger [baseline] (6.055 ms) : 0, 6055
Debugger [candidate] (6.114 ms) : 0, 6114
Remote Config [baseline] (677.313 µs) : 0, 677
Remote Config [candidate] (688.675 µs) : 0, 689
Telemetry [baseline] (8.215 ms) : 0, 8215
Telemetry [candidate] (8.331 ms) : 0, 8331
section appsec
BytebuddyAgent [baseline] (709.832 ms) : 0, 709832
BytebuddyAgent [candidate] (718.023 ms) : 0, 718023
GlobalTracer [baseline] (235.16 ms) : 0, 235160
GlobalTracer [candidate] (239.526 ms) : 0, 239526
AppSec [baseline] (170.279 ms) : 0, 170279
AppSec [candidate] (172.101 ms) : 0, 172101
Debugger [baseline] (5.79 ms) : 0, 5790
Debugger [candidate] (5.834 ms) : 0, 5834
Remote Config [baseline] (606.879 µs) : 0, 607
Remote Config [candidate] (611.749 µs) : 0, 612
Telemetry [baseline] (8.086 ms) : 0, 8086
Telemetry [candidate] (8.184 ms) : 0, 8184
IAST [baseline] (21.963 ms) : 0, 21963
IAST [candidate] (22.565 ms) : 0, 22565
section iast
BytebuddyAgent [baseline] (814.279 ms) : 0, 814279
BytebuddyAgent [candidate] (813.935 ms) : 0, 813935
GlobalTracer [baseline] (234.591 ms) : 0, 234591
GlobalTracer [candidate] (235.245 ms) : 0, 235245
AppSec [baseline] (32.522 ms) : 0, 32522
AppSec [candidate] (28.722 ms) : 0, 28722
Debugger [baseline] (5.795 ms) : 0, 5795
Debugger [candidate] (5.883 ms) : 0, 5883
Remote Config [baseline] (574.379 µs) : 0, 574
Remote Config [candidate] (582.917 µs) : 0, 583
Telemetry [baseline] (8.14 ms) : 0, 8140
Telemetry [candidate] (8.02 ms) : 0, 8020
IAST [baseline] (23.844 ms) : 0, 23844
IAST [candidate] (27.322 ms) : 0, 27322
section profiling
BytebuddyAgent [baseline] (679.291 ms) : 0, 679291
BytebuddyAgent [candidate] (680.797 ms) : 0, 680797
GlobalTracer [baseline] (361.421 ms) : 0, 361421
GlobalTracer [candidate] (362.864 ms) : 0, 362864
AppSec [baseline] (32.998 ms) : 0, 32998
AppSec [candidate] (31.129 ms) : 0, 31129
Debugger [baseline] (10.68 ms) : 0, 10680
Debugger [candidate] (12.112 ms) : 0, 12112
Remote Config [baseline] (678.719 µs) : 0, 679
Remote Config [candidate] (660.674 µs) : 0, 661
Telemetry [baseline] (7.99 ms) : 0, 7990
Telemetry [candidate] (9.523 ms) : 0, 9523
ProfilingAgent [baseline] (102.453 ms) : 0, 102453
ProfilingAgent [candidate] (104.229 ms) : 0, 104229
Profiling [baseline] (102.477 ms) : 0, 102477
Profiling [candidate] (104.254 ms) : 0, 104254
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment
git_commit_date 1751341275 1751341544
git_commit_sha 848b075 359dc42
release_version 1.51.0-SNAPSHOT~848b0754aa 1.51.0-SNAPSHOT~359dc42703
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751343094 1751343094
ci_job_id 1006643608 1006643608
ci_pipeline_id 69250024 69250024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-asxyngdr-project-304-concurrent-0-yggw0rs8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-asxyngdr-project-304-concurrent-0-yggw0rs8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:iast:high_load better
[-2.244ms; -1.395ms] or [-4.915%; -3.055%]
unstable
[-2.983op/s; +11.408op/s] or [-2.911%; +11.132%]
43.840ms 106.700op/s 45.660ms 102.487op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.416 ms) : 4366, 4465
.   : milestone, 4416,
iast (9.128 ms) : 8977, 9279
.   : milestone, 9128,
iast_FULL (13.735 ms) : 13466, 14005
.   : milestone, 13735,
iast_GLOBAL (10.141 ms) : 9966, 10315
.   : milestone, 10141,
profiling (8.803 ms) : 8657, 8948
.   : milestone, 8803,
tracing (7.676 ms) : 7568, 7783
.   : milestone, 7676,
section candidate
no_agent (4.291 ms) : 4241, 4340
.   : milestone, 4291,
iast (9.134 ms) : 8987, 9282
.   : milestone, 9134,
iast_FULL (13.933 ms) : 13657, 14209
.   : milestone, 13933,
iast_GLOBAL (10.194 ms) : 10015, 10373
.   : milestone, 10194,
profiling (8.879 ms) : 8736, 9022
.   : milestone, 8879,
tracing (7.613 ms) : 7507, 7719
.   : milestone, 7613,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.416 ms [4.366 ms, 4.465 ms] -
iast 9.128 ms [8.977 ms, 9.279 ms] 4.712 ms (106.7%)
iast_FULL 13.735 ms [13.466 ms, 14.005 ms] 9.32 ms (211.1%)
iast_GLOBAL 10.141 ms [9.966 ms, 10.315 ms] 5.725 ms (129.7%)
profiling 8.803 ms [8.657 ms, 8.948 ms] 4.387 ms (99.4%)
tracing 7.676 ms [7.568 ms, 7.783 ms] 3.26 ms (73.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.291 ms [4.241 ms, 4.34 ms] -
iast 9.134 ms [8.987 ms, 9.282 ms] 4.843 ms (112.9%)
iast_FULL 13.933 ms [13.657 ms, 14.209 ms] 9.642 ms (224.7%)
iast_GLOBAL 10.194 ms [10.015 ms, 10.373 ms] 5.903 ms (137.6%)
profiling 8.879 ms [8.736 ms, 9.022 ms] 4.588 ms (106.9%)
tracing 7.613 ms [7.507 ms, 7.719 ms] 3.322 ms (77.4%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.975 ms) : 36681, 37270
.   : milestone, 36975,
appsec (46.75 ms) : 46322, 47177
.   : milestone, 46750,
code_origins (44.034 ms) : 43645, 44422
.   : milestone, 44034,
iast (45.66 ms) : 45260, 46060
.   : milestone, 45660,
profiling (49.866 ms) : 49372, 50360
.   : milestone, 49866,
tracing (43.359 ms) : 42978, 43740
.   : milestone, 43359,
section candidate
no_agent (37.144 ms) : 36840, 37447
.   : milestone, 37144,
appsec (45.827 ms) : 45424, 46231
.   : milestone, 45827,
code_origins (42.812 ms) : 42457, 43168
.   : milestone, 42812,
iast (43.84 ms) : 43451, 44230
.   : milestone, 43840,
profiling (48.622 ms) : 48199, 49045
.   : milestone, 48622,
tracing (42.314 ms) : 41959, 42668
.   : milestone, 42314,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.975 ms [36.681 ms, 37.27 ms] -
appsec 46.75 ms [46.322 ms, 47.177 ms] 9.774 ms (26.4%)
code_origins 44.034 ms [43.645 ms, 44.422 ms] 7.058 ms (19.1%)
iast 45.66 ms [45.26 ms, 46.06 ms] 8.685 ms (23.5%)
profiling 49.866 ms [49.372 ms, 50.36 ms] 12.891 ms (34.9%)
tracing 43.359 ms [42.978 ms, 43.74 ms] 6.384 ms (17.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.144 ms [36.84 ms, 37.447 ms] -
appsec 45.827 ms [45.424 ms, 46.231 ms] 8.684 ms (23.4%)
code_origins 42.812 ms [42.457 ms, 43.168 ms] 5.669 ms (15.3%)
iast 43.84 ms [43.451 ms, 44.23 ms] 6.697 ms (18.0%)
profiling 48.622 ms [48.199 ms, 49.045 ms] 11.478 ms (30.9%)
tracing 42.314 ms [41.959 ms, 42.668 ms] 5.17 ms (13.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment
git_commit_date 1751341275 1751341544
git_commit_sha 848b075 359dc42
release_version 1.51.0-SNAPSHOT~848b0754aa 1.51.0-SNAPSHOT~359dc42703
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1751343566 1751343566
ci_job_id 1006643609 1006643609
ci_pipeline_id 69250024 69250024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-fj2rtzmv-project-304-concurrent-0-rc52v0w8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-fj2rtzmv-project-304-concurrent-0-rc52v0w8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.573 s) : 15573000, 15573000
.   : milestone, 15573000,
appsec (14.736 s) : 14736000, 14736000
.   : milestone, 14736000,
iast (18.598 s) : 18598000, 18598000
.   : milestone, 18598000,
iast_GLOBAL (18.156 s) : 18156000, 18156000
.   : milestone, 18156000,
profiling (15.372 s) : 15372000, 15372000
.   : milestone, 15372000,
tracing (14.96 s) : 14960000, 14960000
.   : milestone, 14960000,
section candidate
no_agent (15.275 s) : 15275000, 15275000
.   : milestone, 15275000,
appsec (14.881 s) : 14881000, 14881000
.   : milestone, 14881000,
iast (18.308 s) : 18308000, 18308000
.   : milestone, 18308000,
iast_GLOBAL (17.994 s) : 17994000, 17994000
.   : milestone, 17994000,
profiling (15.713 s) : 15713000, 15713000
.   : milestone, 15713000,
tracing (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.573 s [15.573 s, 15.573 s] -
appsec 14.736 s [14.736 s, 14.736 s] -837.0 ms (-5.4%)
iast 18.598 s [18.598 s, 18.598 s] 3.025 s (19.4%)
iast_GLOBAL 18.156 s [18.156 s, 18.156 s] 2.583 s (16.6%)
profiling 15.372 s [15.372 s, 15.372 s] -201.0 ms (-1.3%)
tracing 14.96 s [14.96 s, 14.96 s] -613.0 ms (-3.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.275 s [15.275 s, 15.275 s] -
appsec 14.881 s [14.881 s, 14.881 s] -394.0 ms (-2.6%)
iast 18.308 s [18.308 s, 18.308 s] 3.033 s (19.9%)
iast_GLOBAL 17.994 s [17.994 s, 17.994 s] 2.719 s (17.8%)
profiling 15.713 s [15.713 s, 15.713 s] 438.0 ms (2.9%)
tracing 14.965 s [14.965 s, 14.965 s] -310.0 ms (-2.0%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (2.399 ms) : 2351, 2448
.   : milestone, 2399,
iast (2.187 ms) : 2125, 2248
.   : milestone, 2187,
iast_GLOBAL (2.237 ms) : 2175, 2299
.   : milestone, 2237,
profiling (2.026 ms) : 1977, 2076
.   : milestone, 2026,
tracing (2.014 ms) : 1966, 2063
.   : milestone, 2014,
section candidate
no_agent (1.479 ms) : 1467, 1491
.   : milestone, 1479,
appsec (2.409 ms) : 2360, 2458
.   : milestone, 2409,
iast (2.194 ms) : 2132, 2255
.   : milestone, 2194,
iast_GLOBAL (2.243 ms) : 2180, 2306
.   : milestone, 2243,
profiling (2.051 ms) : 2001, 2102
.   : milestone, 2051,
tracing (2.002 ms) : 1954, 2049
.   : milestone, 2002,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.47 ms, 1.493 ms] -
appsec 2.399 ms [2.351 ms, 2.448 ms] 918.046 µs (62.0%)
iast 2.187 ms [2.125 ms, 2.248 ms] 705.186 µs (47.6%)
iast_GLOBAL 2.237 ms [2.175 ms, 2.299 ms] 755.83 µs (51.0%)
profiling 2.026 ms [1.977 ms, 2.076 ms] 544.656 µs (36.8%)
tracing 2.014 ms [1.966 ms, 2.063 ms] 532.972 µs (36.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.491 ms] -
appsec 2.409 ms [2.36 ms, 2.458 ms] 930.205 µs (62.9%)
iast 2.194 ms [2.132 ms, 2.255 ms] 714.717 µs (48.3%)
iast_GLOBAL 2.243 ms [2.18 ms, 2.306 ms] 763.899 µs (51.7%)
profiling 2.051 ms [2.001 ms, 2.102 ms] 572.138 µs (38.7%)
tracing 2.002 ms [1.954 ms, 2.049 ms] 522.708 µs (35.3%)

@PerfectSlayer PerfectSlayer force-pushed the bbujon/environment branch 2 times, most recently from 3edbbb7 to 1d156ba Compare June 17, 2025 06:07
@PerfectSlayer PerfectSlayer force-pushed the bbujon/environment branch 3 times, most recently from e1d7b71 to 08a110e Compare June 25, 2025 07:56
Comment on lines 5 to 7
import bootstrap.environment.EnvironmentVariables;
import bootstrap.environment.JavaVirtualMachine;
import bootstrap.environment.SystemProperties;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
import bootstrap.environment.EnvironmentVariables;
import bootstrap.environment.JavaVirtualMachine;
import bootstrap.environment.SystemProperties;
import datadog.trace.bootstrap.environment.EnvironmentVariables;
import datadog.trace.bootstrap.environment.JavaVirtualMachine;
import datadog.trace.bootstrap.environment.SystemProperties;

* Add an addition gradle configuration to be consumed by bootstrap only.
*/
tasks.shadowJar {
relocate("datadog.environment", "bootstrap.environment")
Copy link
Contributor

@bric3 bric3 Jun 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bootstrap.environment is not a known excluded package for jacoco instrumentation, this causes the instrumentation of ….core.intr.Instrumenter ….core.internal.instr.ClassInstrumenter to fail.

Relocating under a known excluded prefix solves the issue.

static final String DEFAULT_CIVISIBILITY_JACOCO_PLUGIN_EXCLUDES =
"datadog.trace.*:org.apache.commons.*:org.mockito.*";
static final boolean DEFAULT_CIVISIBILITY_GIT_UPLOAD_ENABLED = true;

Suggested change
relocate("datadog.environment", "bootstrap.environment")
relocate("datadog.environment", "datadog.trace.bootstrap.environment")

FYI datadog.trace.bootstrap is already used for relocation purpose as well, e.g. her

relocate 'java.util.logging.Logger', 'datadog.trace.bootstrap.PatchLogger'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: do not merge Do not merge changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants