Improve stability of FixedSizeCacheTest identity/weak tests #9362

mcculls · 2025-08-13T21:28:43Z

What Does This Do

Improve stability of FixedSizeCacheTest identity/weak tests by eliminating the chance identity hash might collide even after 3 rehashes - the easiest way to do this is to bump the size of the cache used in testing.

Motivation

Note this is only necessary because we want to keep both keys in the cache to test the 'visit' method - otherwise we could just relax that assertion.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

by eliminating the chance identity hash might collide even after 3 rehashes the easiest way to do this is to bump the size of the cache used in testing note this is only necessary because we want to keep both keys in the cache to test the 'visit' method - otherwise we'd need to relax that assertion

datadog-datadog-prod-us1 · 2025-08-13T21:39:42Z

Code coverage: total 49.90%, base diff -7.43%, patch 100.00% (view details)

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 65f79d7 | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-08-13T22:02:00Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/FixedSizeCacheTest-stability
git_commit_date	1755014538	1755120232
git_commit_sha	`ee43e5f`	`65f79d7`
release_version	1.53.0-SNAPSHOT~ee43e5f19c	1.53.0-SNAPSHOT~65f79d77f5

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755122154	1755122154
ci_job_id	1079647558	1079647558
ci_pipeline_id	73623691	73623691
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-b5z7iacd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-b5z7iacd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 14 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~65f79d77f5, baseline=1.53.0-SNAPSHOT~ee43e5f19c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1050576
Total [baseline] (8.587 s) : 0, 8587240
Agent [candidate] (1.044 s) : 0, 1043997
Total [candidate] (8.561 s) : 0, 8560645
section iast
Agent [baseline] (1.177 s) : 0, 1176935
Total [baseline] (9.327 s) : 0, 9327160
Agent [candidate] (1.181 s) : 0, 1181479
Total [candidate] (9.328 s) : 0, 9327664

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	iast	1.177 s	126.359 ms (12.0%)
Total	tracing	8.587 s	-
Total	iast	9.327 s	739.92 ms (8.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	iast	1.181 s	137.482 ms (13.2%)
Total	tracing	8.561 s	-
Total	iast	9.328 s	767.019 ms (9.0%)

gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~65f79d77f5, baseline=1.53.0-SNAPSHOT~ee43e5f19c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.44 ms) : 0, 1440
crashtracking [candidate] (1.419 ms) : 0, 1419
BytebuddyAgent [baseline] (737.488 ms) : 0, 737488
BytebuddyAgent [candidate] (731.98 ms) : 0, 731980
GlobalTracer [baseline] (242.418 ms) : 0, 242418
GlobalTracer [candidate] (241.746 ms) : 0, 241746
AppSec [baseline] (30.151 ms) : 0, 30151
AppSec [candidate] (29.944 ms) : 0, 29944
Debugger [baseline] (6.027 ms) : 0, 6027
Debugger [candidate] (6.021 ms) : 0, 6021
Remote Config [baseline] (656.967 µs) : 0, 657
Remote Config [candidate] (648.393 µs) : 0, 648
Telemetry [baseline] (11.323 ms) : 0, 11323
Telemetry [candidate] (11.324 ms) : 0, 11324
section iast
crashtracking [baseline] (1.426 ms) : 0, 1426
crashtracking [candidate] (1.431 ms) : 0, 1431
BytebuddyAgent [baseline] (849.768 ms) : 0, 849768
BytebuddyAgent [candidate] (852.177 ms) : 0, 852177
GlobalTracer [baseline] (232.755 ms) : 0, 232755
GlobalTracer [candidate] (234.262 ms) : 0, 234262
IAST [baseline] (29.3 ms) : 0, 29300
IAST [candidate] (27.62 ms) : 0, 27620
AppSec [baseline] (27.262 ms) : 0, 27262
AppSec [candidate] (29.258 ms) : 0, 29258
Debugger [baseline] (6.613 ms) : 0, 6613
Debugger [candidate] (6.575 ms) : 0, 6575
Remote Config [baseline] (582.907 µs) : 0, 583
Remote Config [candidate] (574.887 µs) : 0, 575
Telemetry [baseline] (8.263 ms) : 0, 8263
Telemetry [candidate] (8.471 ms) : 0, 8471

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~65f79d77f5, baseline=1.53.0-SNAPSHOT~ee43e5f19c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.042 s) : 0, 1041805
Total [baseline] (10.732 s) : 0, 10732425
Agent [candidate] (1.048 s) : 0, 1048382
Total [candidate] (10.746 s) : 0, 10745837
section appsec
Agent [baseline] (1.217 s) : 0, 1216874
Total [baseline] (10.758 s) : 0, 10758272
Agent [candidate] (1.219 s) : 0, 1219230
Total [candidate] (10.894 s) : 0, 10893698
section iast
Agent [baseline] (1.189 s) : 0, 1188524
Total [baseline] (10.97 s) : 0, 10970075
Agent [candidate] (1.177 s) : 0, 1177270
Total [candidate] (10.926 s) : 0, 10925723
section profiling
Agent [baseline] (1.192 s) : 0, 1192225
Total [baseline] (10.879 s) : 0, 10878953
Agent [candidate] (1.191 s) : 0, 1190569
Total [candidate] (10.837 s) : 0, 10837159

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.042 s	-
Agent	appsec	1.217 s	175.069 ms (16.8%)
Agent	iast	1.189 s	146.719 ms (14.1%)
Agent	profiling	1.192 s	150.421 ms (14.4%)
Total	tracing	10.732 s	-
Total	appsec	10.758 s	25.847 ms (0.2%)
Total	iast	10.97 s	237.65 ms (2.2%)
Total	profiling	10.879 s	146.528 ms (1.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.048 s	-
Agent	appsec	1.219 s	170.848 ms (16.3%)
Agent	iast	1.177 s	128.888 ms (12.3%)
Agent	profiling	1.191 s	142.187 ms (13.6%)
Total	tracing	10.746 s	-
Total	appsec	10.894 s	147.861 ms (1.4%)
Total	iast	10.926 s	179.886 ms (1.7%)
Total	profiling	10.837 s	91.323 ms (0.8%)

gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~65f79d77f5, baseline=1.53.0-SNAPSHOT~ee43e5f19c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.418 ms) : 0, 1418
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (729.407 ms) : 0, 729407
BytebuddyAgent [candidate] (735.424 ms) : 0, 735424
GlobalTracer [baseline] (240.818 ms) : 0, 240818
GlobalTracer [candidate] (241.849 ms) : 0, 241849
AppSec [baseline] (29.982 ms) : 0, 29982
AppSec [candidate] (30.072 ms) : 0, 30072
Debugger [baseline] (5.991 ms) : 0, 5991
Debugger [candidate] (5.996 ms) : 0, 5996
Remote Config [baseline] (643.163 µs) : 0, 643
Remote Config [candidate] (643.272 µs) : 0, 643
Telemetry [baseline] (12.689 ms) : 0, 12689
Telemetry [candidate] (11.934 ms) : 0, 11934
section appsec
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.43 ms) : 0, 1430
BytebuddyAgent [baseline] (751.8 ms) : 0, 751800
BytebuddyAgent [candidate] (753.435 ms) : 0, 753435
GlobalTracer [baseline] (234.497 ms) : 0, 234497
GlobalTracer [candidate] (235.012 ms) : 0, 235012
IAST [baseline] (23.383 ms) : 0, 23383
IAST [candidate] (23.276 ms) : 0, 23276
AppSec [baseline] (169.344 ms) : 0, 169344
AppSec [candidate] (169.601 ms) : 0, 169601
Debugger [baseline] (5.727 ms) : 0, 5727
Debugger [candidate] (6.447 ms) : 0, 6447
Remote Config [baseline] (610.393 µs) : 0, 610
Remote Config [candidate] (623.48 µs) : 0, 623
Telemetry [baseline] (9.149 ms) : 0, 9149
Telemetry [candidate] (8.386 ms) : 0, 8386
section iast
crashtracking [baseline] (1.444 ms) : 0, 1444
crashtracking [candidate] (1.428 ms) : 0, 1428
BytebuddyAgent [baseline] (858.532 ms) : 0, 858532
BytebuddyAgent [candidate] (850.059 ms) : 0, 850059
GlobalTracer [baseline] (234.289 ms) : 0, 234289
GlobalTracer [candidate] (232.495 ms) : 0, 232495
IAST [baseline] (29.542 ms) : 0, 29542
IAST [candidate] (29.073 ms) : 0, 29073
AppSec [baseline] (27.019 ms) : 0, 27019
AppSec [candidate] (26.768 ms) : 0, 26768
Debugger [baseline] (7.5 ms) : 0, 7500
Debugger [candidate] (7.516 ms) : 0, 7516
Remote Config [baseline] (598.983 µs) : 0, 599
Remote Config [candidate] (596.856 µs) : 0, 597
Telemetry [baseline] (8.411 ms) : 0, 8411
Telemetry [candidate] (8.348 ms) : 0, 8348
section profiling
crashtracking [baseline] (1.399 ms) : 0, 1399
crashtracking [candidate] (1.389 ms) : 0, 1389
BytebuddyAgent [baseline] (760.026 ms) : 0, 760026
BytebuddyAgent [candidate] (758.447 ms) : 0, 758447
GlobalTracer [baseline] (221.197 ms) : 0, 221197
GlobalTracer [candidate] (221.554 ms) : 0, 221554
AppSec [baseline] (30.002 ms) : 0, 30002
AppSec [candidate] (29.834 ms) : 0, 29834
Debugger [baseline] (6.264 ms) : 0, 6264
Debugger [candidate] (6.24 ms) : 0, 6240
Remote Config [baseline] (708.116 µs) : 0, 708
Remote Config [candidate] (668.57 µs) : 0, 669
Telemetry [baseline] (15.895 ms) : 0, 15895
Telemetry [candidate] (15.096 ms) : 0, 15096
ProfilingAgent [baseline] (107.357 ms) : 0, 107357
ProfilingAgent [candidate] (108.028 ms) : 0, 108028
Profiling [baseline] (107.984 ms) : 0, 107984
Profiling [candidate] (108.662 ms) : 0, 108662

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/FixedSizeCacheTest-stability
git_commit_date	1755014538	1755120232
git_commit_sha	`ee43e5f`	`65f79d7`
release_version	1.53.0-SNAPSHOT~ee43e5f19c	1.53.0-SNAPSHOT~65f79d77f5

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755121823	1755121823
ci_job_id	1079647559	1079647559
ci_pipeline_id	73623691	73623691
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-mkqmul9h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-mkqmul9h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 11 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:appsec:high_load	worse [+2.166ms; +3.083ms] or [+4.758%; +6.771%]	unstable [-12.569op/s; +1.369op/s] or [-12.225%; +1.331%]	48.150ms	97.213op/s	45.526ms	102.812op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~65f79d77f5, baseline=1.53.0-SNAPSHOT~ee43e5f19c
    dateFormat X
    axisFormat %s
section baseline
no_agent (35.465 ms) : 35185, 35745
.   : milestone, 35465,
appsec (45.526 ms) : 45107, 45945
.   : milestone, 45526,
code_origins (45.882 ms) : 45485, 46280
.   : milestone, 45882,
iast (44.772 ms) : 44398, 45146
.   : milestone, 44772,
profiling (48.409 ms) : 47948, 48871
.   : milestone, 48409,
tracing (43.756 ms) : 43381, 44132
.   : milestone, 43756,
section candidate
no_agent (35.749 ms) : 35463, 36036
.   : milestone, 35749,
appsec (48.15 ms) : 47717, 48583
.   : milestone, 48150,
code_origins (45.249 ms) : 44867, 45631
.   : milestone, 45249,
iast (45.039 ms) : 44663, 45415
.   : milestone, 45039,
profiling (47.574 ms) : 47094, 48055
.   : milestone, 47574,
tracing (44.422 ms) : 44037, 44806
.   : milestone, 44422,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.465 ms [35.185 ms, 35.745 ms]	-
appsec	45.526 ms [45.107 ms, 45.945 ms]	10.061 ms (28.4%)
code_origins	45.882 ms [45.485 ms, 46.28 ms]	10.418 ms (29.4%)
iast	44.772 ms [44.398 ms, 45.146 ms]	9.308 ms (26.2%)
profiling	48.409 ms [47.948 ms, 48.871 ms]	12.945 ms (36.5%)
tracing	43.756 ms [43.381 ms, 44.132 ms]	8.291 ms (23.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.749 ms [35.463 ms, 36.036 ms]	-
appsec	48.15 ms [47.717 ms, 48.583 ms]	12.401 ms (34.7%)
code_origins	45.249 ms [44.867 ms, 45.631 ms]	9.499 ms (26.6%)
iast	45.039 ms [44.663 ms, 45.415 ms]	9.29 ms (26.0%)
profiling	47.574 ms [47.094 ms, 48.055 ms]	11.825 ms (33.1%)
tracing	44.422 ms [44.037 ms, 44.806 ms]	8.672 ms (24.3%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~65f79d77f5, baseline=1.53.0-SNAPSHOT~ee43e5f19c
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.454 ms) : 4404, 4505
.   : milestone, 4454,
iast (9.28 ms) : 9119, 9442
.   : milestone, 9280,
iast_FULL (14.181 ms) : 13895, 14467
.   : milestone, 14181,
iast_GLOBAL (10.412 ms) : 10232, 10592
.   : milestone, 10412,
profiling (8.667 ms) : 8529, 8806
.   : milestone, 8667,
tracing (7.452 ms) : 7348, 7556
.   : milestone, 7452,
section candidate
no_agent (4.36 ms) : 4309, 4412
.   : milestone, 4360,
iast (9.379 ms) : 9217, 9540
.   : milestone, 9379,
iast_FULL (14.193 ms) : 13913, 14472
.   : milestone, 14193,
iast_GLOBAL (10.581 ms) : 10392, 10771
.   : milestone, 10581,
profiling (8.737 ms) : 8601, 8873
.   : milestone, 8737,
tracing (7.392 ms) : 7291, 7492
.   : milestone, 7392,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.454 ms [4.404 ms, 4.505 ms]	-
iast	9.28 ms [9.119 ms, 9.442 ms]	4.826 ms (108.3%)
iast_FULL	14.181 ms [13.895 ms, 14.467 ms]	9.727 ms (218.4%)
iast_GLOBAL	10.412 ms [10.232 ms, 10.592 ms]	5.958 ms (133.8%)
profiling	8.667 ms [8.529 ms, 8.806 ms]	4.213 ms (94.6%)
tracing	7.452 ms [7.348 ms, 7.556 ms]	2.998 ms (67.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.36 ms [4.309 ms, 4.412 ms]	-
iast	9.379 ms [9.217 ms, 9.54 ms]	5.018 ms (115.1%)
iast_FULL	14.193 ms [13.913 ms, 14.472 ms]	9.832 ms (225.5%)
iast_GLOBAL	10.581 ms [10.392 ms, 10.771 ms]	6.221 ms (142.7%)
profiling	8.737 ms [8.601 ms, 8.873 ms]	4.377 ms (100.4%)
tracing	7.392 ms [7.291 ms, 7.492 ms]	3.032 ms (69.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/FixedSizeCacheTest-stability
git_commit_date	1755014538	1755120232
git_commit_sha	`ee43e5f`	`65f79d7`
release_version	1.53.0-SNAPSHOT~ee43e5f19c	1.53.0-SNAPSHOT~65f79d77f5

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1755122411	1755122411
ci_job_id	1079647560	1079647560
ci_pipeline_id	73623691	73623691
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-z8hjhs1l 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-z8hjhs1l 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~65f79d77f5, baseline=1.53.0-SNAPSHOT~ee43e5f19c
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.533 s) : 15533000, 15533000
.   : milestone, 15533000,
appsec (14.713 s) : 14713000, 14713000
.   : milestone, 14713000,
iast (18.913 s) : 18913000, 18913000
.   : milestone, 18913000,
iast_GLOBAL (17.985 s) : 17985000, 17985000
.   : milestone, 17985000,
profiling (15.486 s) : 15486000, 15486000
.   : milestone, 15486000,
tracing (14.908 s) : 14908000, 14908000
.   : milestone, 14908000,
section candidate
no_agent (15.067 s) : 15067000, 15067000
.   : milestone, 15067000,
appsec (14.904 s) : 14904000, 14904000
.   : milestone, 14904000,
iast (18.648 s) : 18648000, 18648000
.   : milestone, 18648000,
iast_GLOBAL (17.982 s) : 17982000, 17982000
.   : milestone, 17982000,
profiling (15.269 s) : 15269000, 15269000
.   : milestone, 15269000,
tracing (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.533 s [15.533 s, 15.533 s]	-
appsec	14.713 s [14.713 s, 14.713 s]	-820.0 ms (-5.3%)
iast	18.913 s [18.913 s, 18.913 s]	3.38 s (21.8%)
iast_GLOBAL	17.985 s [17.985 s, 17.985 s]	2.452 s (15.8%)
profiling	15.486 s [15.486 s, 15.486 s]	-47.0 ms (-0.3%)
tracing	14.908 s [14.908 s, 14.908 s]	-625.0 ms (-4.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.067 s [15.067 s, 15.067 s]	-
appsec	14.904 s [14.904 s, 14.904 s]	-163.0 ms (-1.1%)
iast	18.648 s [18.648 s, 18.648 s]	3.581 s (23.8%)
iast_GLOBAL	17.982 s [17.982 s, 17.982 s]	2.915 s (19.3%)
profiling	15.269 s [15.269 s, 15.269 s]	202.0 ms (1.3%)
tracing	14.948 s [14.948 s, 14.948 s]	-119.0 ms (-0.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~65f79d77f5, baseline=1.53.0-SNAPSHOT~ee43e5f19c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.6 ms) : 3388, 3812
.   : milestone, 3600,
iast (2.202 ms) : 2140, 2264
.   : milestone, 2202,
iast_GLOBAL (2.234 ms) : 2171, 2297
.   : milestone, 2234,
profiling (2.06 ms) : 2009, 2112
.   : milestone, 2060,
tracing (2.016 ms) : 1968, 2065
.   : milestone, 2016,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.657 ms) : 3442, 3872
.   : milestone, 3657,
iast (2.201 ms) : 2138, 2264
.   : milestone, 2201,
iast_GLOBAL (2.246 ms) : 2184, 2309
.   : milestone, 2246,
profiling (2.035 ms) : 1985, 2085
.   : milestone, 2035,
tracing (2.008 ms) : 1960, 2057
.   : milestone, 2008,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	3.6 ms [3.388 ms, 3.812 ms]	2.126 ms (144.3%)
iast	2.202 ms [2.14 ms, 2.264 ms]	728.371 µs (49.4%)
iast_GLOBAL	2.234 ms [2.171 ms, 2.297 ms]	760.604 µs (51.6%)
profiling	2.06 ms [2.009 ms, 2.112 ms]	586.697 µs (39.8%)
tracing	2.016 ms [1.968 ms, 2.065 ms]	542.893 µs (36.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.462 ms, 1.485 ms]	-
appsec	3.657 ms [3.442 ms, 3.872 ms]	2.184 ms (148.2%)
iast	2.201 ms [2.138 ms, 2.264 ms]	727.758 µs (49.4%)
iast_GLOBAL	2.246 ms [2.184 ms, 2.309 ms]	773.253 µs (52.5%)
profiling	2.035 ms [1.985 ms, 2.085 ms]	561.794 µs (38.1%)
tracing	2.008 ms [1.96 ms, 2.057 ms]	535.049 µs (36.3%)

mcculls added comp: testing Testing type: refactoring labels Aug 13, 2025

mcculls marked this pull request as ready for review August 13, 2025 22:15

mcculls requested a review from a team as a code owner August 13, 2025 22:15

mcculls requested a review from PerfectSlayer August 13, 2025 22:15

mcculls enabled auto-merge (squash) August 13, 2025 22:15

mcculls requested a review from AlexeyKuznetsov-DD August 13, 2025 22:16

AlexeyKuznetsov-DD approved these changes Aug 13, 2025

View reviewed changes

mcculls merged commit 6d9e2c4 into master Aug 13, 2025
506 checks passed

mcculls deleted the mcculls/FixedSizeCacheTest-stability branch August 13, 2025 23:19

github-actions bot added this to the 1.53.0 milestone Aug 13, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Improve stability of FixedSizeCacheTest identity/weak tests #9362

Improve stability of FixedSizeCacheTest identity/weak tests #9362

Uh oh!

mcculls commented Aug 13, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Aug 13, 2025

Uh oh!

pr-commenter bot commented Aug 13, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Improve stability of FixedSizeCacheTest identity/weak tests #9362

Improve stability of FixedSizeCacheTest identity/weak tests #9362

Uh oh!

Conversation

mcculls commented Aug 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Aug 13, 2025

Uh oh!

pr-commenter bot commented Aug 13, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

mcculls commented Aug 13, 2025 •

edited

Loading