debugging test environment triggering by daniel-mohedano · Pull Request #9695 · DataDog/dd-trace-java

daniel-mohedano · 2025-10-08T09:00:20Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

datadog-official · 2025-10-08T09:15:00Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.69% (-0.00%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 1910edc | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-10-08T09:29:04Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/test-env-requirement
git_commit_date	1760282194	1760343014
git_commit_sha	`d2f5bb4`	`1910edc`
release_version	1.55.0-SNAPSHOT~d2f5bb4248	1.54.0-SNAPSHOT~1910edcd2c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1760345170	1760345170
ci_job_id	1175816650	1175816650
ci_pipeline_id	79107474	79107474
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-24p8qz5y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-24p8qz5y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~1910edcd2c, baseline=1.55.0-SNAPSHOT~d2f5bb4248

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.015 s) : 0, 1014725
Total [baseline] (10.665 s) : 0, 10664720
Agent [candidate] (1.019 s) : 0, 1018862
Total [candidate] (10.842 s) : 0, 10842390
section appsec
Agent [baseline] (1.202 s) : 0, 1202235
Total [baseline] (11.019 s) : 0, 11018732
Agent [candidate] (1.196 s) : 0, 1196238
Total [candidate] (11.033 s) : 0, 11033211
section iast
Agent [baseline] (1.152 s) : 0, 1152033
Total [baseline] (11.102 s) : 0, 11101738
Agent [candidate] (1.151 s) : 0, 1151340
Total [candidate] (10.988 s) : 0, 10987897
section profiling
Agent [baseline] (1.172 s) : 0, 1171907
Total [baseline] (11.194 s) : 0, 11194014
Agent [candidate] (1.164 s) : 0, 1164484
Total [candidate] (11.13 s) : 0, 11130218

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.015 s	-
Agent	appsec	1.202 s	187.51 ms (18.5%)
Agent	iast	1.152 s	137.308 ms (13.5%)
Agent	profiling	1.172 s	157.182 ms (15.5%)
Total	tracing	10.665 s	-
Total	appsec	11.019 s	354.012 ms (3.3%)
Total	iast	11.102 s	437.018 ms (4.1%)
Total	profiling	11.194 s	529.294 ms (5.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.019 s	-
Agent	appsec	1.196 s	177.376 ms (17.4%)
Agent	iast	1.151 s	132.478 ms (13.0%)
Agent	profiling	1.164 s	145.622 ms (14.3%)
Total	tracing	10.842 s	-
Total	appsec	11.033 s	190.821 ms (1.8%)
Total	iast	10.988 s	145.508 ms (1.3%)
Total	profiling	11.13 s	287.828 ms (2.7%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~1910edcd2c, baseline=1.55.0-SNAPSHOT~d2f5bb4248

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (692.117 ms) : 0, 692117
BytebuddyAgent [candidate] (695.0 ms) : 0, 695000
GlobalTracer [baseline] (241.118 ms) : 0, 241118
GlobalTracer [candidate] (242.789 ms) : 0, 242789
AppSec [baseline] (32.319 ms) : 0, 32319
AppSec [candidate] (33.134 ms) : 0, 33134
Debugger [baseline] (6.378 ms) : 0, 6378
Debugger [candidate] (6.417 ms) : 0, 6417
Remote Config [baseline] (693.512 µs) : 0, 694
Remote Config [candidate] (698.613 µs) : 0, 699
Telemetry [baseline] (9.271 ms) : 0, 9271
Telemetry [candidate] (9.309 ms) : 0, 9309
Flare Poller [baseline] (10.36 ms) : 0, 10360
Flare Poller [candidate] (8.861 ms) : 0, 8861
section appsec
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (723.294 ms) : 0, 723294
BytebuddyAgent [candidate] (719.131 ms) : 0, 719131
GlobalTracer [baseline] (235.944 ms) : 0, 235944
GlobalTracer [candidate] (234.736 ms) : 0, 234736
AppSec [baseline] (176.057 ms) : 0, 176057
AppSec [candidate] (175.931 ms) : 0, 175931
Debugger [baseline] (6.19 ms) : 0, 6190
Debugger [candidate] (6.17 ms) : 0, 6170
Remote Config [baseline] (631.744 µs) : 0, 632
Remote Config [candidate] (648.357 µs) : 0, 648
Telemetry [baseline] (8.511 ms) : 0, 8511
Telemetry [candidate] (8.386 ms) : 0, 8386
Flare Poller [baseline] (3.951 ms) : 0, 3951
Flare Poller [candidate] (3.955 ms) : 0, 3955
IAST [baseline] (24.94 ms) : 0, 24940
IAST [candidate] (24.722 ms) : 0, 24722
section iast
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (816.236 ms) : 0, 816236
BytebuddyAgent [candidate] (815.334 ms) : 0, 815334
GlobalTracer [baseline] (231.687 ms) : 0, 231687
GlobalTracer [candidate] (231.735 ms) : 0, 231735
AppSec [baseline] (34.901 ms) : 0, 34901
AppSec [candidate] (35.621 ms) : 0, 35621
Debugger [baseline] (6.17 ms) : 0, 6170
Debugger [candidate] (6.186 ms) : 0, 6186
Remote Config [baseline] (603.652 µs) : 0, 604
Remote Config [candidate] (605.266 µs) : 0, 605
Telemetry [baseline] (8.805 ms) : 0, 8805
Telemetry [candidate] (8.684 ms) : 0, 8684
Flare Poller [baseline] (4.145 ms) : 0, 4145
Flare Poller [candidate] (4.151 ms) : 0, 4151
IAST [baseline] (26.47 ms) : 0, 26470
IAST [candidate] (26.284 ms) : 0, 26284
section profiling
ProfilingAgent [baseline] (108.658 ms) : 0, 108658
ProfilingAgent [candidate] (107.106 ms) : 0, 107106
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.43 ms) : 0, 1430
BytebuddyAgent [baseline] (728.221 ms) : 0, 728221
BytebuddyAgent [candidate] (722.833 ms) : 0, 722833
GlobalTracer [baseline] (219.319 ms) : 0, 219319
GlobalTracer [candidate] (218.313 ms) : 0, 218313
AppSec [baseline] (32.877 ms) : 0, 32877
AppSec [candidate] (33.147 ms) : 0, 33147
Debugger [baseline] (7.408 ms) : 0, 7408
Debugger [candidate] (7.263 ms) : 0, 7263
Remote Config [baseline] (806.816 µs) : 0, 807
Remote Config [candidate] (688.464 µs) : 0, 688
Telemetry [baseline] (13.908 ms) : 0, 13908
Telemetry [candidate] (15.924 ms) : 0, 15924
Flare Poller [baseline] (5.746 ms) : 0, 5746
Flare Poller [candidate] (4.242 ms) : 0, 4242
Profiling [baseline] (109.652 ms) : 0, 109652
Profiling [candidate] (108.621 ms) : 0, 108621

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~1910edcd2c, baseline=1.55.0-SNAPSHOT~d2f5bb4248

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1017782
Total [baseline] (8.679 s) : 0, 8678983
Agent [candidate] (1.019 s) : 0, 1018790
Total [candidate] (8.701 s) : 0, 8701420
section iast
Agent [baseline] (1.157 s) : 0, 1156966
Total [baseline] (9.296 s) : 0, 9296138
Agent [candidate] (1.158 s) : 0, 1157997
Total [candidate] (9.299 s) : 0, 9299203

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.018 s	-
Agent	iast	1.157 s	139.184 ms (13.7%)
Total	tracing	8.679 s	-
Total	iast	9.296 s	617.155 ms (7.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.019 s	-
Agent	iast	1.158 s	139.207 ms (13.7%)
Total	tracing	8.701 s	-
Total	iast	9.299 s	597.783 ms (6.9%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~1910edcd2c, baseline=1.55.0-SNAPSHOT~d2f5bb4248

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (695.328 ms) : 0, 695328
BytebuddyAgent [candidate] (693.708 ms) : 0, 693708
GlobalTracer [baseline] (241.086 ms) : 0, 241086
GlobalTracer [candidate] (241.986 ms) : 0, 241986
AppSec [baseline] (32.662 ms) : 0, 32662
AppSec [candidate] (33.037 ms) : 0, 33037
Debugger [baseline] (6.477 ms) : 0, 6477
Debugger [candidate] (6.461 ms) : 0, 6461
Remote Config [baseline] (716.542 µs) : 0, 717
Remote Config [candidate] (688.685 µs) : 0, 689
Telemetry [baseline] (9.273 ms) : 0, 9273
Telemetry [candidate] (9.389 ms) : 0, 9389
Flare Poller [baseline] (9.549 ms) : 0, 9549
Flare Poller [candidate] (10.975 ms) : 0, 10975
section iast
crashtracking [baseline] (1.502 ms) : 0, 1502
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (819.801 ms) : 0, 819801
BytebuddyAgent [candidate] (820.77 ms) : 0, 820770
GlobalTracer [baseline] (231.97 ms) : 0, 231970
GlobalTracer [candidate] (232.524 ms) : 0, 232524
IAST [baseline] (26.866 ms) : 0, 26866
IAST [candidate] (26.682 ms) : 0, 26682
AppSec [baseline] (35.41 ms) : 0, 35410
AppSec [candidate] (35.407 ms) : 0, 35407
Debugger [baseline] (6.194 ms) : 0, 6194
Debugger [candidate] (6.183 ms) : 0, 6183
Remote Config [baseline] (626.132 µs) : 0, 626
Remote Config [candidate] (608.869 µs) : 0, 609
Telemetry [baseline] (8.772 ms) : 0, 8772
Telemetry [candidate] (8.727 ms) : 0, 8727
Flare Poller [baseline] (4.23 ms) : 0, 4230
Flare Poller [candidate] (4.199 ms) : 0, 4199

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/test-env-requirement
git_commit_date	1760282194	1760343014
git_commit_sha	`d2f5bb4`	`1910edc`
release_version	1.55.0-SNAPSHOT~d2f5bb4248	1.54.0-SNAPSHOT~1910edcd2c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1760344828	1760344828
ci_job_id	1175816652	1175816652
ci_pipeline_id	79107474	79107474
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-mduy8uv3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-mduy8uv3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 3 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	worse [+136.935µs; +249.333µs] or [+3.178%; +5.786%]	unstable [-151.029op/s; +61.029op/s] or [-14.186%; +5.732%]	4.502ms	1019.625op/s	4.309ms	1064.625op/s
scenario:load:insecure-bank:tracing:high_load	better [-537.776µs; -292.574µs] or [-6.737%; -3.665%]	unstable [-37.067op/s; +99.879op/s] or [-6.387%; +17.211%]	7.568ms	611.719op/s	7.983ms	580.312op/s
scenario:load:insecure-bank:iast:high_load	worse [+325.607µs; +691.177µs] or [+3.345%; +7.101%]	unstable [-75.765op/s; +29.077op/s] or [-15.887%; +6.097%]	10.243ms	453.562op/s	9.734ms	476.906op/s
scenario:load:insecure-bank:profiling:high_load	worse [+519.017µs; +828.760µs] or [+5.832%; +9.312%]	unstable [-91.095op/s; +20.595op/s] or [-17.479%; +3.952%]	9.574ms	485.906op/s	8.900ms	521.156op/s
scenario:load:petclinic:code_origins:high_load	better [-3.093ms; -2.289ms] or [-6.958%; -5.149%]	unstable [-1.050op/s; +14.450op/s] or [-0.997%; +13.729%]	41.765ms	111.950op/s	44.456ms	105.250op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~1910edcd2c, baseline=1.55.0-SNAPSHOT~d2f5bb4248
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.418 ms) : 36134, 36703
.   : milestone, 36418,
appsec (48.664 ms) : 48214, 49115
.   : milestone, 48664,
code_origins (44.456 ms) : 44064, 44849
.   : milestone, 44456,
iast (47.11 ms) : 46709, 47511
.   : milestone, 47110,
profiling (50.256 ms) : 49813, 50700
.   : milestone, 50256,
tracing (45.772 ms) : 45388, 46155
.   : milestone, 45772,
section candidate
no_agent (36.457 ms) : 36158, 36756
.   : milestone, 36457,
appsec (48.959 ms) : 48526, 49391
.   : milestone, 48959,
code_origins (41.765 ms) : 41411, 42119
.   : milestone, 41765,
iast (45.822 ms) : 45427, 46216
.   : milestone, 45822,
profiling (48.821 ms) : 48391, 49250
.   : milestone, 48821,
tracing (44.687 ms) : 44301, 45072
.   : milestone, 44687,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.418 ms [36.134 ms, 36.703 ms]	-
appsec	48.664 ms [48.214 ms, 49.115 ms]	12.246 ms (33.6%)
code_origins	44.456 ms [44.064 ms, 44.849 ms]	8.038 ms (22.1%)
iast	47.11 ms [46.709 ms, 47.511 ms]	10.692 ms (29.4%)
profiling	50.256 ms [49.813 ms, 50.7 ms]	13.838 ms (38.0%)
tracing	45.772 ms [45.388 ms, 46.155 ms]	9.353 ms (25.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.457 ms [36.158 ms, 36.756 ms]	-
appsec	48.959 ms [48.526 ms, 49.391 ms]	12.501 ms (34.3%)
code_origins	41.765 ms [41.411 ms, 42.119 ms]	5.308 ms (14.6%)
iast	45.822 ms [45.427 ms, 46.216 ms]	9.365 ms (25.7%)
profiling	48.821 ms [48.391 ms, 49.25 ms]	12.363 ms (33.9%)
tracing	44.687 ms [44.301 ms, 45.072 ms]	8.23 ms (22.6%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~1910edcd2c, baseline=1.55.0-SNAPSHOT~d2f5bb4248
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.309 ms) : 4256, 4362
.   : milestone, 4309,
iast (9.734 ms) : 9565, 9904
.   : milestone, 9734,
iast_FULL (14.263 ms) : 13975, 14551
.   : milestone, 14263,
iast_GLOBAL (10.981 ms) : 10769, 11194
.   : milestone, 10981,
profiling (8.9 ms) : 8763, 9037
.   : milestone, 8900,
tracing (7.983 ms) : 7869, 8097
.   : milestone, 7983,
section candidate
no_agent (4.502 ms) : 4451, 4554
.   : milestone, 4502,
iast (10.243 ms) : 10072, 10413
.   : milestone, 10243,
iast_FULL (13.929 ms) : 13653, 14206
.   : milestone, 13929,
iast_GLOBAL (10.897 ms) : 10699, 11095
.   : milestone, 10897,
profiling (9.574 ms) : 9423, 9725
.   : milestone, 9574,
tracing (7.568 ms) : 7454, 7682
.   : milestone, 7568,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.309 ms [4.256 ms, 4.362 ms]	-
iast	9.734 ms [9.565 ms, 9.904 ms]	5.425 ms (125.9%)
iast_FULL	14.263 ms [13.975 ms, 14.551 ms]	9.953 ms (231.0%)
iast_GLOBAL	10.981 ms [10.769 ms, 11.194 ms]	6.672 ms (154.8%)
profiling	8.9 ms [8.763 ms, 9.037 ms]	4.591 ms (106.5%)
tracing	7.983 ms [7.869 ms, 8.097 ms]	3.674 ms (85.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.502 ms [4.451 ms, 4.554 ms]	-
iast	10.243 ms [10.072 ms, 10.413 ms]	5.74 ms (127.5%)
iast_FULL	13.929 ms [13.653 ms, 14.206 ms]	9.427 ms (209.4%)
iast_GLOBAL	10.897 ms [10.699 ms, 11.095 ms]	6.395 ms (142.0%)
profiling	9.574 ms [9.423 ms, 9.725 ms]	5.072 ms (112.6%)
tracing	7.568 ms [7.454 ms, 7.682 ms]	3.066 ms (68.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/test-env-requirement
git_commit_date	1760282194	1760343014
git_commit_sha	`d2f5bb4`	`1910edc`
release_version	1.55.0-SNAPSHOT~d2f5bb4248	1.54.0-SNAPSHOT~1910edcd2c

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1760345361	1760345361
ci_job_id	1175816654	1175816654
ci_pipeline_id	79107474	79107474
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-b14sbpud 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-b14sbpud 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~1910edcd2c, baseline=1.55.0-SNAPSHOT~d2f5bb4248
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.782 s) : 14782000, 14782000
.   : milestone, 14782000,
appsec (14.861 s) : 14861000, 14861000
.   : milestone, 14861000,
iast (18.155 s) : 18155000, 18155000
.   : milestone, 18155000,
iast_GLOBAL (18.104 s) : 18104000, 18104000
.   : milestone, 18104000,
profiling (15.481 s) : 15481000, 15481000
.   : milestone, 15481000,
tracing (14.949 s) : 14949000, 14949000
.   : milestone, 14949000,
section candidate
no_agent (14.786 s) : 14786000, 14786000
.   : milestone, 14786000,
appsec (15.021 s) : 15021000, 15021000
.   : milestone, 15021000,
iast (18.447 s) : 18447000, 18447000
.   : milestone, 18447000,
iast_GLOBAL (18.079 s) : 18079000, 18079000
.   : milestone, 18079000,
profiling (15.034 s) : 15034000, 15034000
.   : milestone, 15034000,
tracing (15.348 s) : 15348000, 15348000
.   : milestone, 15348000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.782 s [14.782 s, 14.782 s]	-
appsec	14.861 s [14.861 s, 14.861 s]	79.0 ms (0.5%)
iast	18.155 s [18.155 s, 18.155 s]	3.373 s (22.8%)
iast_GLOBAL	18.104 s [18.104 s, 18.104 s]	3.322 s (22.5%)
profiling	15.481 s [15.481 s, 15.481 s]	699.0 ms (4.7%)
tracing	14.949 s [14.949 s, 14.949 s]	167.0 ms (1.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.786 s [14.786 s, 14.786 s]	-
appsec	15.021 s [15.021 s, 15.021 s]	235.0 ms (1.6%)
iast	18.447 s [18.447 s, 18.447 s]	3.661 s (24.8%)
iast_GLOBAL	18.079 s [18.079 s, 18.079 s]	3.293 s (22.3%)
profiling	15.034 s [15.034 s, 15.034 s]	248.0 ms (1.7%)
tracing	15.348 s [15.348 s, 15.348 s]	562.0 ms (3.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~1910edcd2c, baseline=1.55.0-SNAPSHOT~d2f5bb4248
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.722 ms) : 3497, 3948
.   : milestone, 3722,
iast (2.216 ms) : 2152, 2279
.   : milestone, 2216,
iast_GLOBAL (2.258 ms) : 2194, 2322
.   : milestone, 2258,
profiling (2.078 ms) : 2025, 2131
.   : milestone, 2078,
tracing (2.027 ms) : 1977, 2077
.   : milestone, 2027,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.741 ms) : 3521, 3962
.   : milestone, 3741,
iast (2.206 ms) : 2142, 2269
.   : milestone, 2206,
iast_GLOBAL (2.258 ms) : 2194, 2321
.   : milestone, 2258,
profiling (2.054 ms) : 2003, 2105
.   : milestone, 2054,
tracing (2.023 ms) : 1974, 2072
.   : milestone, 2023,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.464 ms, 1.487 ms]	-
appsec	3.722 ms [3.497 ms, 3.948 ms]	2.247 ms (152.3%)
iast	2.216 ms [2.152 ms, 2.279 ms]	740.662 µs (50.2%)
iast_GLOBAL	2.258 ms [2.194 ms, 2.322 ms]	782.642 µs (53.1%)
profiling	2.078 ms [2.025 ms, 2.131 ms]	602.631 µs (40.8%)
tracing	2.027 ms [1.977 ms, 2.077 ms]	551.835 µs (37.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	3.741 ms [3.521 ms, 3.962 ms]	2.261 ms (152.7%)
iast	2.206 ms [2.142 ms, 2.269 ms]	725.211 µs (49.0%)
iast_GLOBAL	2.258 ms [2.194 ms, 2.321 ms]	777.397 µs (52.5%)
profiling	2.054 ms [2.003 ms, 2.105 ms]	573.442 µs (38.7%)
tracing	2.023 ms [1.974 ms, 2.072 ms]	543.074 µs (36.7%)

daniel-mohedano · 2025-10-08T12:11:56Z

/gitlab resync-job-status

dd-devflow-routing-codex · 2025-10-08T12:16:17Z

View all feedbacks in Devflow UI.

2025-10-08 12:11:58 UTC ℹ️ Start processing command /gitlab resync-job-status
If you need support, contact us on Slack #devflow!

2025-10-08 12:16:15 UTC 🚨 Devflow

404 Not Found

Details

child workflow execution error (type: cirel.Cirel_SyncCommitJobsStatusWorkflow, workflowID: d0778d98-517d-427b-b7d8-befd4defa949_32, runID: 3054e6c5-ee66-4a5d-b1ee-385ec9042721, initiatedEventID: 32, startedEventID: 33): activity error (type: gitlab.GitlabService_GetJobsByCommit, scheduledEventID: 14, startedEventID: 15, identity: 1@gitlab-worker-6b6967fdfd-ztwr6@): 404 Not Found

If you need support, contact us on Slack #devflow with those details!

cit-pr-commenter · 2025-10-09T12:12:42Z

Test Environment Tests

Test environment triggered.

feat: initial version of automatic test environment

7533219

daniel-mohedano added comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements labels Oct 8, 2025

daniel-mohedano added 4 commits October 8, 2025 11:57

Merge branch 'master' into daniel.mohedano/test-env-requirement

7cc9bd5

fix: add artifacts to test environment job

4944e82

fix: try different trigger rule

c59c1f4

fix: change trigger approach away from dotenv

edb069f

test: remove allow_failure in check

0087caa

daniel-mohedano added comp: ci visibility Continuous Integration Visibility and removed comp: ci visibility Continuous Integration Visibility labels Oct 8, 2025

daniel-mohedano added 6 commits October 8, 2025 14:52

feat: test out pr comment

ec68137

fix: multiline comment

ba694fa

fix: use pr commenter service

81764ff

fix: request payload

a85ea5e

debug: add debugging to json payload

d5bee83

feat: util functions and trigger + finish comment

93f1813

DataDog deleted a comment from cit-pr-commenter bot Oct 9, 2025

daniel-mohedano added 6 commits October 9, 2025 15:26

feat: get downstream id

839e37a

fix: move to job token

4dc954c

debug: debug log

b351d2b

test: job token access

df15edc

debug: different query

9f7cc24

debug: add stage back in

1910edc

daniel-mohedano changed the title ~~feat: initial version of automatic test environment~~ debugging test environment triggering Oct 13, 2025

daniel-mohedano added the tag: do not merge Do not merge changes label Oct 13, 2025

daniel-mohedano closed this Oct 13, 2025

daniel-mohedano deleted the daniel.mohedano/test-env-requirement branch October 13, 2025 10:47

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

debugging test environment triggering#9695

debugging test environment triggering#9695
daniel-mohedano wants to merge 18 commits intomasterfrom
daniel.mohedano/test-env-requirement

daniel-mohedano commented Oct 8, 2025

Uh oh!

datadog-official bot commented Oct 8, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Oct 8, 2025 •

edited

Loading

Uh oh!

daniel-mohedano commented Oct 8, 2025

Uh oh!

dd-devflow-routing-codex bot commented Oct 8, 2025

Uh oh!

cit-pr-commenter bot commented Oct 9, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

daniel-mohedano commented Oct 8, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-official bot commented Oct 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Oct 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

daniel-mohedano commented Oct 8, 2025

Uh oh!

dd-devflow-routing-codex bot commented Oct 8, 2025

Uh oh!

cit-pr-commenter bot commented Oct 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment Tests

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

datadog-official bot commented Oct 8, 2025 •

edited

Loading

pr-commenter bot commented Oct 8, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 9, 2025 •

edited

Loading