Skip to content

Comments

Test Ubuntu 17 JDK fix#8941

Closed
smola wants to merge 1 commit intomasterfrom
smola/ubuntu17-ci-fix
Closed

Test Ubuntu 17 JDK fix#8941
smola wants to merge 1 commit intomasterfrom
smola/ubuntu17-ci-fix

Conversation

@smola
Copy link
Member

@smola smola commented Jun 6, 2025 •
edited
Loading

What Does This Do

Testing DataDog/dd-trace-java-docker-build#101

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola force-pushed the smola/ubuntu17-ci-fix branch from 6024e93 to 1ff2905 Compare June 6, 2025 11:04
@pr-commenter
Copy link

pr-commenter bot commented Jun 6, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ubuntu17-ci-fix
git_commit_date 1749044153 1749209746
git_commit_sha 7787af7 986e4c8
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~986e4c81cf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749212324 1749212324
ci_job_id 971676909 971676909
ci_pipeline_id 67166490 67166490
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xizkxfyi-project-304-concurrent-0-tv6vat78 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xizkxfyi-project-304-concurrent-0-tv6vat78 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~986e4c81cf, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.03 s) : 0, 1029974
Total [baseline] (11.235 s) : 0, 11234820
Agent [candidate] (1.025 s) : 0, 1025033
Total [candidate] (11.113 s) : 0, 11113091
section appsec
Agent [baseline] (1.165 s) : 0, 1165114
Total [baseline] (11.239 s) : 0, 11238686
Agent [candidate] (1.167 s) : 0, 1167021
Total [candidate] (11.29 s) : 0, 11289707
section iast
Agent [baseline] (1.154 s) : 0, 1153564
Total [baseline] (11.425 s) : 0, 11424969
Agent [candidate] (1.161 s) : 0, 1160951
Total [candidate] (11.355 s) : 0, 11354512
section profiling
Agent [baseline] (1.276 s) : 0, 1275801
Total [baseline] (11.483 s) : 0, 11483221
Agent [candidate] (1.266 s) : 0, 1265565
Total [candidate] (11.466 s) : 0, 11465848
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.03 s -
Agent appsec 1.165 s 135.14 ms (13.1%)
Agent iast 1.154 s 123.59 ms (12.0%)
Agent profiling 1.276 s 245.827 ms (23.9%)
Total tracing 11.235 s -
Total appsec 11.239 s 3.866 ms (0.0%)
Total iast 11.425 s 190.149 ms (1.7%)
Total profiling 11.483 s 248.401 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.167 s 141.987 ms (13.9%)
Agent iast 1.161 s 135.917 ms (13.3%)
Agent profiling 1.266 s 240.531 ms (23.5%)
Total tracing 11.113 s -
Total appsec 11.29 s 176.616 ms (1.6%)
Total iast 11.355 s 241.421 ms (2.2%)
Total profiling 11.466 s 352.757 ms (3.2%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~986e4c81cf, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.313 ms) : 0, 688313
BytebuddyAgent [candidate] (683.505 ms) : 0, 683505
GlobalTracer [baseline] (242.547 ms) : 0, 242547
GlobalTracer [candidate] (240.889 ms) : 0, 240889
AppSec [baseline] (56.788 ms) : 0, 56788
AppSec [candidate] (57.093 ms) : 0, 57093
Debugger [baseline] (6.26 ms) : 0, 6260
Debugger [candidate] (6.977 ms) : 0, 6977
Remote Config [baseline] (760.761 µs) : 0, 761
Remote Config [candidate] (759.452 µs) : 0, 759
Telemetry [baseline] (11.569 ms) : 0, 11569
Telemetry [candidate] (12.114 ms) : 0, 12114
section appsec
BytebuddyAgent [baseline] (701.864 ms) : 0, 701864
BytebuddyAgent [candidate] (703.132 ms) : 0, 703132
GlobalTracer [baseline] (238.215 ms) : 0, 238215
GlobalTracer [candidate] (238.321 ms) : 0, 238321
IAST [baseline] (21.996 ms) : 0, 21996
IAST [candidate] (21.805 ms) : 0, 21805
AppSec [baseline] (176.438 ms) : 0, 176438
AppSec [candidate] (176.908 ms) : 0, 176908
Debugger [baseline] (5.96 ms) : 0, 5960
Debugger [candidate] (6.02 ms) : 0, 6020
Remote Config [baseline] (636.668 µs) : 0, 637
Remote Config [candidate] (647.082 µs) : 0, 647
Telemetry [baseline] (7.352 ms) : 0, 7352
Telemetry [candidate] (7.443 ms) : 0, 7443
section iast
BytebuddyAgent [baseline] (804.344 ms) : 0, 804344
BytebuddyAgent [candidate] (809.642 ms) : 0, 809642
GlobalTracer [baseline] (231.627 ms) : 0, 231627
GlobalTracer [candidate] (233.016 ms) : 0, 233016
IAST [baseline] (29.362 ms) : 0, 29362
IAST [candidate] (26.369 ms) : 0, 26369
AppSec [baseline] (50.224 ms) : 0, 50224
AppSec [candidate] (53.536 ms) : 0, 53536
Debugger [baseline] (5.943 ms) : 0, 5943
Debugger [candidate] (5.98 ms) : 0, 5980
Remote Config [baseline] (583.184 µs) : 0, 583
Remote Config [candidate] (608.221 µs) : 0, 608
Telemetry [baseline] (7.922 ms) : 0, 7922
Telemetry [candidate] (8.003 ms) : 0, 8003
section profiling
BytebuddyAgent [baseline] (680.835 ms) : 0, 680835
BytebuddyAgent [candidate] (675.279 ms) : 0, 675279
GlobalTracer [baseline] (363.227 ms) : 0, 363227
GlobalTracer [candidate] (360.349 ms) : 0, 360349
AppSec [baseline] (61.751 ms) : 0, 61751
AppSec [candidate] (61.715 ms) : 0, 61715
Debugger [baseline] (6.157 ms) : 0, 6157
Debugger [candidate] (6.094 ms) : 0, 6094
Remote Config [baseline] (652.136 µs) : 0, 652
Remote Config [candidate] (645.691 µs) : 0, 646
Telemetry [baseline] (8.155 ms) : 0, 8155
Telemetry [candidate] (8.064 ms) : 0, 8064
ProfilingAgent [baseline] (103.753 ms) : 0, 103753
ProfilingAgent [candidate] (102.575 ms) : 0, 102575
Profiling [baseline] (103.777 ms) : 0, 103777
Profiling [candidate] (102.6 ms) : 0, 102600
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~986e4c81cf, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.029 s) : 0, 1029369
Total [baseline] (8.56 s) : 0, 8559648
Agent [candidate] (1.026 s) : 0, 1026128
Total [candidate] (8.529 s) : 0, 8529272
section iast
Agent [baseline] (1.15 s) : 0, 1149874
Total [baseline] (9.19 s) : 0, 9189716
Agent [candidate] (1.152 s) : 0, 1152431
Total [candidate] (9.194 s) : 0, 9193554
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.16 s) : 0, 1160486
Total [baseline] (9.197 s) : 0, 9196947
Agent [candidate] (1.153 s) : 0, 1153413
Total [candidate] (9.176 s) : 0, 9175592
section iast_TELEMETRY_OFF
Agent [baseline] (1.147 s) : 0, 1146596
Total [baseline] (9.269 s) : 0, 9269487
Agent [candidate] (1.151 s) : 0, 1150630
Total [candidate] (9.235 s) : 0, 9234630
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.029 s -
Agent iast 1.15 s 120.505 ms (11.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.16 s 131.118 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.147 s 117.227 ms (11.4%)
Total tracing 8.56 s -
Total iast 9.19 s 630.069 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.197 s 637.299 ms (7.4%)
Total iast_TELEMETRY_OFF 9.269 s 709.839 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.152 s 126.303 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.153 s 127.285 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.151 s 124.501 ms (12.1%)
Total tracing 8.529 s -
Total iast 9.194 s 664.282 ms (7.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.176 s 646.32 ms (7.6%)
Total iast_TELEMETRY_OFF 9.235 s 705.358 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~986e4c81cf, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.59 ms) : 0, 687590
BytebuddyAgent [candidate] (684.877 ms) : 0, 684877
GlobalTracer [baseline] (241.388 ms) : 0, 241388
GlobalTracer [candidate] (241.001 ms) : 0, 241001
AppSec [baseline] (56.617 ms) : 0, 56617
AppSec [candidate] (59.234 ms) : 0, 59234
Debugger [baseline] (6.228 ms) : 0, 6228
Debugger [candidate] (6.112 ms) : 0, 6112
Remote Config [baseline] (735.024 µs) : 0, 735
Remote Config [candidate] (740.175 µs) : 0, 740
Telemetry [baseline] (13.075 ms) : 0, 13075
Telemetry [candidate] (10.507 ms) : 0, 10507
section iast
BytebuddyAgent [baseline] (801.668 ms) : 0, 801668
BytebuddyAgent [candidate] (804.136 ms) : 0, 804136
GlobalTracer [baseline] (230.843 ms) : 0, 230843
GlobalTracer [candidate] (231.023 ms) : 0, 231023
IAST [baseline] (24.409 ms) : 0, 24409
IAST [candidate] (26.92 ms) : 0, 26920
AppSec [baseline] (55.063 ms) : 0, 55063
AppSec [candidate] (52.344 ms) : 0, 52344
Debugger [baseline] (5.898 ms) : 0, 5898
Debugger [candidate] (5.964 ms) : 0, 5964
Remote Config [baseline] (588.516 µs) : 0, 589
Remote Config [candidate] (599.109 µs) : 0, 599
Telemetry [baseline] (7.875 ms) : 0, 7875
Telemetry [candidate] (7.875 ms) : 0, 7875
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (807.946 ms) : 0, 807946
BytebuddyAgent [candidate] (803.651 ms) : 0, 803651
GlobalTracer [baseline] (233.244 ms) : 0, 233244
GlobalTracer [candidate] (231.296 ms) : 0, 231296
IAST [baseline] (27.632 ms) : 0, 27632
IAST [candidate] (26.175 ms) : 0, 26175
AppSec [baseline] (53.375 ms) : 0, 53375
AppSec [candidate] (53.985 ms) : 0, 53985
Debugger [baseline] (6.1 ms) : 0, 6100
Debugger [candidate] (6.051 ms) : 0, 6051
Remote Config [baseline] (606.662 µs) : 0, 607
Remote Config [candidate] (600.323 µs) : 0, 600
Telemetry [baseline] (8.036 ms) : 0, 8036
Telemetry [candidate] (8.076 ms) : 0, 8076
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.579 ms) : 0, 798579
BytebuddyAgent [candidate] (801.393 ms) : 0, 801393
GlobalTracer [baseline] (230.935 ms) : 0, 230935
GlobalTracer [candidate] (231.961 ms) : 0, 231961
IAST [baseline] (30.325 ms) : 0, 30325
IAST [candidate] (28.128 ms) : 0, 28128
AppSec [baseline] (48.748 ms) : 0, 48748
AppSec [candidate] (51.078 ms) : 0, 51078
Debugger [baseline] (6.026 ms) : 0, 6026
Debugger [candidate] (6.019 ms) : 0, 6019
Remote Config [baseline] (605.489 µs) : 0, 605
Remote Config [candidate] (605.789 µs) : 0, 606
Telemetry [baseline] (7.903 ms) : 0, 7903
Telemetry [candidate] (7.885 ms) : 0, 7885
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-06T11:59:15 2025-06-06T12:01:36
git_branch master smola/ubuntu17-ci-fix
git_commit_date 1749044153 1749209746
git_commit_sha 7787af7 986e4c8
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~986e4c81cf
start_time 2025-06-06T11:56:32 2025-06-06T12:01:01
See matching parameters
Baseline Candidate
application petclinic petclinic
ci_job_date 1749211296 1749211296
ci_job_id 971676911 971676911
ci_pipeline_id 67166490 67166490
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xizkxfyi-project-304-concurrent-1-ozthzbbx 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xizkxfyi-project-304-concurrent-1-ozthzbbx 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant appsec_no_iast appsec_no_iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 0 metrics, 11 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:no_agent unstable
[+61.092ms; +63.245ms] or [+640.767%; +663.352%]		 worse
[-466.595op/s; -427.289op/s] or [-90.403%; -82.787%]		 71.703ms 69.188op/s 9.534ms 516.129op/s

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ubuntu17-ci-fix
git_commit_date 1749044153 1749209746
git_commit_sha 7787af7 986e4c8
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~986e4c81cf
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749212118 1749212118
ci_job_id 971676914 971676914
ci_pipeline_id 67166490 67166490
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-n-2qzcrt-project-304-concurrent-0-7e8vco8r 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-n-2qzcrt-project-304-concurrent-0-7e8vco8r 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~986e4c81cf, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.366 s) : 15366000, 15366000
.   : milestone, 15366000,
appsec (14.691 s) : 14691000, 14691000
.   : milestone, 14691000,
iast (18.915 s) : 18915000, 18915000
.   : milestone, 18915000,
iast_GLOBAL (18.224 s) : 18224000, 18224000
.   : milestone, 18224000,
profiling (15.374 s) : 15374000, 15374000
.   : milestone, 15374000,
tracing (14.955 s) : 14955000, 14955000
.   : milestone, 14955000,
section candidate
no_agent (15.463 s) : 15463000, 15463000
.   : milestone, 15463000,
appsec (14.907 s) : 14907000, 14907000
.   : milestone, 14907000,
iast (18.862 s) : 18862000, 18862000
.   : milestone, 18862000,
iast_GLOBAL (18.044 s) : 18044000, 18044000
.   : milestone, 18044000,
profiling (15.282 s) : 15282000, 15282000
.   : milestone, 15282000,
tracing (15.147 s) : 15147000, 15147000
.   : milestone, 15147000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.366 s [15.366 s, 15.366 s] -
appsec 14.691 s [14.691 s, 14.691 s] -675.0 ms (-4.4%)
iast 18.915 s [18.915 s, 18.915 s] 3.549 s (23.1%)
iast_GLOBAL 18.224 s [18.224 s, 18.224 s] 2.858 s (18.6%)
profiling 15.374 s [15.374 s, 15.374 s] 8.0 ms (0.1%)
tracing 14.955 s [14.955 s, 14.955 s] -411.0 ms (-2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.463 s [15.463 s, 15.463 s] -
appsec 14.907 s [14.907 s, 14.907 s] -556.0 ms (-3.6%)
iast 18.862 s [18.862 s, 18.862 s] 3.399 s (22.0%)
iast_GLOBAL 18.044 s [18.044 s, 18.044 s] 2.581 s (16.7%)
profiling 15.282 s [15.282 s, 15.282 s] -181.0 ms (-1.2%)
tracing 15.147 s [15.147 s, 15.147 s] -316.0 ms (-2.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~986e4c81cf, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1490
.   : milestone, 1478,
appsec (2.416 ms) : 2367, 2465
.   : milestone, 2416,
iast (2.189 ms) : 2127, 2251
.   : milestone, 2189,
iast_GLOBAL (2.248 ms) : 2185, 2310
.   : milestone, 2248,
profiling (2.045 ms) : 1995, 2095
.   : milestone, 2045,
tracing (2.005 ms) : 1957, 2052
.   : milestone, 2005,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.417 ms) : 2368, 2466
.   : milestone, 2417,
iast (2.202 ms) : 2140, 2264
.   : milestone, 2202,
iast_GLOBAL (2.24 ms) : 2178, 2302
.   : milestone, 2240,
profiling (2.06 ms) : 2009, 2110
.   : milestone, 2060,
tracing (2.008 ms) : 1960, 2056
.   : milestone, 2008,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.49 ms] -
appsec 2.416 ms [2.367 ms, 2.465 ms] 938.099 µs (63.5%)
iast 2.189 ms [2.127 ms, 2.251 ms] 710.624 µs (48.1%)
iast_GLOBAL 2.248 ms [2.185 ms, 2.31 ms] 769.628 µs (52.1%)
profiling 2.045 ms [1.995 ms, 2.095 ms] 566.96 µs (38.4%)
tracing 2.005 ms [1.957 ms, 2.052 ms] 526.713 µs (35.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 2.417 ms [2.368 ms, 2.466 ms] 938.005 µs (63.4%)
iast 2.202 ms [2.14 ms, 2.264 ms] 722.822 µs (48.9%)
iast_GLOBAL 2.24 ms [2.178 ms, 2.302 ms] 760.73 µs (51.4%)
profiling 2.06 ms [2.009 ms, 2.11 ms] 580.672 µs (39.3%)
tracing 2.008 ms [1.96 ms, 2.056 ms] 529.027 µs (35.8%)

@smola smola force-pushed the smola/ubuntu17-ci-fix branch from 1ff2905 to 986e4c8 Compare June 6, 2025 11:36
@smola
Copy link
Member Author

smola commented Jun 6, 2025

It worked.

@smola smola closed this Jun 6, 2025
@smola smola deleted the smola/ubuntu17-ci-fix branch June 6, 2025 12:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@smola