fix(bin_tests): race conditions between concurrent tests

[morrisonlevi]

What does this PR do?

Force certain tests to run serially to avoid unintentional dependencies on global state, which might affect reliability.

• Added serial_test = "3.2" as a dev-dependency in bin_tests/Cargo.toml
• Applied #[serial(runtime_callback)] to three tests that manipulate global runtime callback state:
  • test_010_runtime_callback_frame
  • test_011_runtime_callback_string (the flaky one)
  • test_012_runtime_callback_frame_invalid_utf8
• These three tests now run sequentially; all other tests still run in parallel.

Motivation

In another PR, I hit a failure:

failures:

---- modes::unix::test_011_runtime_callback_string::tests::test_runtime_callback_string_registration stdout ----

thread 'modes::unix::test_011_runtime_callback_string::tests::test_runtime_callback_string_registration' (4970) panicked at bin_tests/src/modes/unix/test_011_runtime_callback_string.rs:69:9:
Callback should be registered
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace


failures:
    modes::unix::test_011_runtime_callback_string::tests::test_runtime_callback_string_registration

test result: FAILED. 13 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s

error: test failed, to rerun pass `-p bin_tests --lib`
Error: Process completed with exit code 101.

This was a race condition: cargo test runs tests in parallel threads within the same process, and three tests (test_010, test_011, test_012) were all manipulating the same global runtime callback state simultaneously. One test would register a callback, then another would clear it before the first could verify registration, causing intermittent failures.

Additional Notes

The serial_tests intentionally leaks some memory as part of its organization, so we ignore these 3 tests under miri.

How to test the change?

Run the affected tests multiple times to verify they no longer fail intermittently:

# Run the runtime callback tests repeatedly
for i in {1..10}; do 
  cargo test -p bin_tests --lib runtime_callback || exit 1
done

All runs should pass consistently. The CI job "build and test using cross - on centos7" should also now pass reliably.

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.18%. Comparing base (73c675b) to head (301db70).

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1402      +/-   ##
==========================================
+ Coverage   71.16%   71.18%   +0.01%     
==========================================
  Files         403      403              
  Lines       64368    64365       -3     
==========================================
+ Hits        45810    45820      +10     
+ Misses      18558    18545      -13     

Components	Coverage Δ
libdd-crashtracker	58.99% <ø> (+0.01%)	⬆️
libdd-crashtracker-ffi	16.74% <ø> (ø)
libdd-alloc	98.73% <ø> (ø)
libdd-data-pipeline	85.81% <ø> (ø)
libdd-data-pipeline-ffi	76.59% <ø> (ø)
libdd-common	81.13% <ø> (ø)
libdd-common-ffi	74.96% <ø> (ø)
libdd-telemetry	59.95% <ø> (ø)
libdd-telemetry-ffi	21.17% <ø> (ø)
libdd-dogstatsd-client	83.75% <ø> (ø)
datadog-ipc	82.61% <ø> (ø)
libdd-profiling	80.42% <ø> (-0.03%)	⬇️
libdd-profiling-ffi	63.41% <ø> (ø)
datadog-sidecar	35.86% <ø> (ø)
datdog-sidecar-ffi	10.79% <ø> (ø)
spawn-worker	55.18% <ø> (ø)
libdd-tinybytes	92.44% <ø> (ø)
libdd-trace-normalization	98.24% <ø> (ø)
libdd-trace-obfuscation	94.17% <ø> (ø)
libdd-trace-protobuf	61.18% <ø> (ø)
libdd-trace-utils	89.97% <ø> (ø)
datadog-tracer-flare	63.49% <ø> (ø)
libdd-log	75.57% <ø> (ø)

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2025-12-13 19:48:51

Comparing candidate commit 301db70 in PR branch levi/bin_tests with baseline commit 73c675b in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

• 🟩 execution_time [-167.684ns; -161.019ns] or [-6.620%; -6.356%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	205.105µs	205.653µs ± 0.351µs	205.572µs ± 0.221µs	205.917µs	206.340µs	206.662µs	206.704µs	0.55%	0.912	0.204	0.17%	0.025µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	4837825.625op/s	4862565.191op/s ± 8283.812op/s	4864471.231op/s ± 5230.044op/s	4868706.929op/s	4872255.550op/s	4873190.738op/s	4875545.765op/s	0.23%	-0.905	0.186	0.17%	585.754op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	18.581µs	18.669µs ± 0.065µs	18.648µs ± 0.027µs	18.685µs	18.809µs	18.906µs	18.934µs	1.53%	1.826	3.602	0.35%	0.005µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	52815609.071op/s	53566223.696op/s ± 185203.054op/s	53625614.140op/s ± 78135.200op/s	53683556.370op/s	53747834.236op/s	53782038.438op/s	53818122.112op/s	0.36%	-1.802	3.499	0.34%	13095.834op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	10.870µs	10.926µs ± 0.028µs	10.925µs ± 0.018µs	10.944µs	10.980µs	11.001µs	11.016µs	0.84%	0.498	0.245	0.26%	0.002µs	1	200
normalization/normalize_name/normalize_name/good	throughput	90776170.909op/s	91522219.951op/s ± 235237.407op/s	91534459.929op/s ± 150812.334op/s	91678769.542op/s	91884369.204op/s	91941514.532op/s	91997547.668op/s	0.51%	-0.483	0.220	0.26%	16633.797op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[205.605µs; 205.702µs] or [-0.024%; +0.024%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[4861417.135op/s; 4863713.248op/s] or [-0.024%; +0.024%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[18.660µs; 18.678µs] or [-0.048%; +0.048%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[53540556.334op/s; 53591891.058op/s] or [-0.048%; +0.048%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[10.922µs; 10.930µs] or [-0.036%; +0.036%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[91489618.308op/s; 91554821.593op/s] or [-0.036%; +0.036%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	532.963µs	533.827µs ± 0.483µs	533.761µs ± 0.276µs	534.049µs	534.695µs	534.910µs	536.886µs	0.59%	1.716	7.151	0.09%	0.034µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1862591.375op/s	1873268.832op/s ± 1691.066op/s	1873496.760op/s ± 968.862op/s	1874383.504op/s	1875409.187op/s	1876043.829op/s	1876302.858op/s	0.15%	-1.699	7.024	0.09%	119.576op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	381.381µs	381.901µs ± 0.324µs	381.828µs ± 0.182µs	382.067µs	382.442µs	382.616µs	384.347µs	0.66%	2.448	14.755	0.08%	0.023µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2601814.664op/s	2618484.479op/s ± 2217.394op/s	2618979.677op/s ± 1249.839op/s	2619916.274op/s	2621070.987op/s	2621738.671op/s	2622050.464op/s	0.12%	-2.421	14.488	0.08%	156.793op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	188.952µs	189.725µs ± 0.251µs	189.783µs ± 0.139µs	189.897µs	190.063µs	190.133µs	190.168µs	0.20%	-0.842	0.416	0.13%	0.018µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5258496.922op/s	5270782.355op/s ± 6984.895op/s	5269165.882op/s ± 3865.920op/s	5274317.071op/s	5284387.906op/s	5290263.319op/s	5292350.098op/s	0.44%	0.849	0.430	0.13%	493.907op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	36.944µs	37.044µs ± 0.044µs	37.039µs ± 0.029µs	37.074µs	37.113µs	37.178µs	37.188µs	0.40%	0.454	0.432	0.12%	0.003µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	26890163.531op/s	26995143.252op/s ± 32028.864op/s	26998469.485op/s ± 21274.390op/s	27016717.458op/s	27042561.847op/s	27057049.413op/s	27067922.387op/s	0.26%	-0.446	0.417	0.12%	2264.783op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	45.050µs	45.165µs ± 0.065µs	45.160µs ± 0.042µs	45.202µs	45.282µs	45.374µs	45.403µs	0.54%	0.945	1.350	0.14%	0.005µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	22024816.345op/s	22140883.619op/s ± 31785.564op/s	22143568.061op/s ± 20825.010op/s	22164258.497op/s	22183489.225op/s	22193112.362op/s	22197484.883op/s	0.24%	-0.935	1.319	0.14%	2247.579op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[533.760µs; 533.894µs] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1873034.467op/s; 1873503.198op/s] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[381.856µs; 381.945µs] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2618177.169op/s; 2618791.788op/s] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[189.691µs; 189.760µs] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5269814.316op/s; 5271750.395op/s] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[37.038µs; 37.050µs] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[26990704.360op/s; 26999582.145op/s] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[45.156µs; 45.174µs] or [-0.020%; +0.020%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[22136478.445op/s; 22145288.792op/s] or [-0.020%; +0.020%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	60.987ms	61.639ms ± 2.385ms	61.348ms ± 0.086ms	61.416ms	61.669ms	78.156ms	82.898ms	35.13%	8.046	63.681	3.86%	0.169ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[61.309ms; 61.970ms] or [-0.536%; +0.536%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample2_frames_x1000	execution_time	531.132µs	531.677µs ± 0.324µs	531.624µs ± 0.141µs	531.801µs	532.101µs	532.993µs	534.334µs	0.51%	3.770	24.902	0.06%	0.023µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample2_frames_x1000	execution_time	[531.632µs; 531.722µs] or [-0.008%; +0.008%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.291µs	2.369µs ± 0.019µs	2.371µs ± 0.008µs	2.380µs	2.393µs	2.400µs	2.404µs	1.41%	-1.811	4.219	0.81%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.366µs; 2.371µs] or [-0.113%; +0.113%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.450µs	25.450µs ± 9.533µs	17.885µs ± 0.218µs	34.074µs	42.232µs	43.381µs	60.584µs	238.75%	0.825	-0.079	37.36%	0.674µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[24.128µs; 26.771µs] or [-5.191%; +5.191%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.194µs	3.229µs ± 1.427µs	3.008µs ± 0.030µs	3.040µs	3.656µs	14.110µs	14.732µs	389.75%	7.303	54.654	44.07%	0.101µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[3.031µs; 3.427µs] or [-6.124%; +6.124%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	162.663µs	163.300µs ± 0.254µs	163.265µs ± 0.157µs	163.451µs	163.769µs	164.052µs	164.449µs	0.72%	1.062	2.343	0.16%	0.018µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[163.265µs; 163.335µs] or [-0.022%; +0.022%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
ip_address/quantize_peer_ip_address_benchmark	execution_time	4.998µs	5.079µs ± 0.045µs	5.087µs ± 0.046µs	5.107µs	5.139µs	5.144µs	5.145µs	1.14%	-0.149	-1.367	0.88%	0.003µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark	execution_time	[5.073µs; 5.085µs] or [-0.122%; +0.122%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
single_flag_killswitch/rules-based	execution_time	187.899ns	190.589ns ± 2.355ns	190.004ns ± 1.426ns	191.735ns	194.388ns	198.402ns	201.690ns	6.15%	1.688	3.982	1.23%	0.166ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
single_flag_killswitch/rules-based	execution_time	[190.263ns; 190.915ns] or [-0.171%; +0.171%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
receiver_entry_point/report/2597	execution_time	9.889ms	10.101ms ± 0.061ms	10.089ms ± 0.029ms	10.122ms	10.214ms	10.280ms	10.417ms	3.25%	1.460	5.181	0.60%	0.004ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
receiver_entry_point/report/2597	execution_time	[10.093ms; 10.109ms] or [-0.084%; +0.084%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching serializing traces from their internal representation to msgpack	execution_time	14.171ms	14.243ms ± 0.038ms	14.240ms ± 0.023ms	14.262ms	14.295ms	14.376ms	14.408ms	1.17%	1.408	3.489	0.26%	0.003ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching serializing traces from their internal representation to msgpack	execution_time	[14.238ms; 14.248ms] or [-0.037%; +0.037%]	None	None	None

Group 13

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	35.133µs	35.599µs ± 0.678µs	35.291µs ± 0.063µs	35.419µs	36.989µs	37.024µs	38.922µs	10.29%	1.916	2.837	1.90%	0.048µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[35.505µs; 35.693µs] or [-0.264%; +0.264%]	None	None	None

Group 14

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	243.358ns	255.706ns ± 13.993ns	249.890ns ± 4.895ns	260.916ns	290.438ns	299.741ns	299.891ns	20.01%	1.748	2.400	5.46%	0.989ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[253.767ns; 257.645ns] or [-0.758%; +0.758%]	None	None	None

Group 15

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	85.425µs	85.670µs ± 0.168µs	85.648µs ± 0.052µs	85.705µs	85.856µs	86.113µs	87.415µs	2.06%	6.131	58.110	0.20%	0.012µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[85.647µs; 85.693µs] or [-0.027%; +0.027%]	None	None	None

Group 16

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	10.589ms	10.621ms ± 0.016ms	10.620ms ± 0.010ms	10.630ms	10.646ms	10.673ms	10.702ms	0.78%	1.084	2.942	0.15%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[10.619ms; 10.624ms] or [-0.021%; +0.021%]	None	None	None

Group 17

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample_frames_x1000	execution_time	3.909ms	3.914ms ± 0.007ms	3.913ms ± 0.001ms	3.915ms	3.919ms	3.923ms	4.000ms	2.23%	10.902	137.337	0.17%	0.000ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample_frames_x1000	execution_time	[3.913ms; 3.915ms] or [-0.024%; +0.024%]	None	None	None

Group 18

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.890µs	3.911µs ± 0.003µs	3.910µs ± 0.001µs	3.912µs	3.917µs	3.920µs	3.921µs	0.27%	-0.614	10.658	0.08%	0.000µs	1	200
credit_card/is_card_number/	throughput	255029651.687op/s	255692876.795op/s ± 206475.658op/s	255724819.285op/s ± 88657.061op/s	255809443.983op/s	255897521.830op/s	255960108.510op/s	257100722.628op/s	0.54%	0.644	10.844	0.08%	14600.034op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	80.066µs	81.882µs ± 0.684µs	81.891µs ± 0.562µs	82.450µs	82.948µs	83.132µs	83.502µs	1.97%	-0.136	-0.656	0.83%	0.048µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	11975829.243op/s	12213500.824op/s ± 102125.010op/s	12211332.732op/s ± 84107.750op/s	12295420.158op/s	12382298.581op/s	12428736.684op/s	12489638.463op/s	2.28%	0.169	-0.632	0.83%	7221.329op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	74.644µs	75.076µs ± 0.189µs	75.060µs ± 0.113µs	75.182µs	75.382µs	75.675µs	75.887µs	1.10%	0.950	2.431	0.25%	0.013µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	13177459.071op/s	13319897.914op/s ± 33396.440op/s	13322709.632op/s ± 20030.701op/s	13339780.569op/s	13366193.970op/s	13385470.900op/s	13396881.206op/s	0.56%	-0.924	2.344	0.25%	2361.485op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.892µs	3.911µs ± 0.002µs	3.911µs ± 0.001µs	3.912µs	3.914µs	3.917µs	3.917µs	0.16%	-2.028	18.909	0.06%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	255299409.696op/s	255710458.647op/s ± 151722.546op/s	255719715.991op/s ± 77284.618op/s	255796019.431op/s	255884007.475op/s	255925138.628op/s	256920733.172op/s	0.47%	2.058	19.175	0.06%	10728.404op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	71.724µs	72.206µs ± 0.217µs	72.196µs ± 0.139µs	72.333µs	72.595µs	72.698µs	72.796µs	0.83%	0.165	-0.171	0.30%	0.015µs	1	200
credit_card/is_card_number/378282246310005	throughput	13737074.179op/s	13849398.925op/s ± 41535.016op/s	13851194.640op/s ± 26655.197op/s	13879846.466op/s	13918261.595op/s	13940819.165op/s	13942425.406op/s	0.66%	-0.149	-0.179	0.30%	2936.969op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	52.122µs	52.188µs ± 0.039µs	52.181µs ± 0.024µs	52.209µs	52.254µs	52.299µs	52.438µs	0.49%	1.786	7.292	0.08%	0.003µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	19070011.176op/s	19161383.914op/s ± 14462.069op/s	19164218.488op/s ± 8794.538op/s	19171546.550op/s	19178606.169op/s	19181245.789op/s	19185821.678op/s	0.11%	-1.773	7.186	0.08%	1022.623op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	5.693µs	5.859µs ± 0.075µs	5.863µs ± 0.050µs	5.903µs	5.985µs	6.004µs	6.033µs	2.89%	-0.140	-0.477	1.28%	0.005µs	1	200
credit_card/is_card_number/x371413321323331	throughput	165757708.366op/s	170704519.985op/s ± 2197612.548op/s	170554510.004op/s ± 1476829.470op/s	172170864.699op/s	174566139.847op/s	175583049.999op/s	175656323.401op/s	2.99%	0.198	-0.462	1.28%	155394.674op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.890µs	3.911µs ± 0.003µs	3.910µs ± 0.001µs	3.912µs	3.914µs	3.917µs	3.918µs	0.18%	-2.314	20.922	0.06%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	255261639.187op/s	255720834.633op/s ± 165008.377op/s	255729523.974op/s ± 95846.082op/s	255817957.660op/s	255896910.114op/s	255942466.854op/s	257073363.027op/s	0.53%	2.348	21.243	0.06%	11667.854op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	64.070µs	64.381µs ± 0.172µs	64.332µs ± 0.084µs	64.433µs	64.736µs	64.872µs	65.043µs	1.10%	1.348	1.631	0.27%	0.012µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	15374474.903op/s	15532647.991op/s ± 41438.653op/s	15544252.094op/s ± 20329.682op/s	15562674.495op/s	15575646.464op/s	15579082.533op/s	15607830.449op/s	0.41%	-1.333	1.577	0.27%	2930.155op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	57.376µs	57.562µs ± 0.137µs	57.522µs ± 0.067µs	57.627µs	57.826µs	58.057µs	58.144µs	1.08%	1.650	3.362	0.24%	0.010µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	17198818.540op/s	17372634.373op/s ± 41216.982op/s	17384635.462op/s ± 20125.785op/s	17401365.573op/s	17416992.986op/s	17425170.329op/s	17428849.975op/s	0.25%	-1.631	3.275	0.24%	2914.481op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.892µs	3.912µs ± 0.003µs	3.912µs ± 0.002µs	3.914µs	3.916µs	3.918µs	3.918µs	0.17%	-1.291	8.602	0.08%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	255224771.476op/s	255641229.685op/s ± 193778.690op/s	255653343.324op/s ± 127087.756op/s	255763422.945op/s	255899946.144op/s	255974329.737op/s	256945750.080op/s	0.51%	1.311	8.758	0.08%	13702.223op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	54.613µs	54.883µs ± 0.192µs	54.832µs ± 0.111µs	55.018µs	55.241µs	55.507µs	55.638µs	1.47%	1.147	1.234	0.35%	0.014µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	17973272.859op/s	18220818.185op/s ± 63569.661op/s	18237424.680op/s ± 37044.066op/s	18268591.272op/s	18292825.282op/s	18305085.320op/s	18310741.081op/s	0.40%	-1.127	1.159	0.35%	4495.054op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	52.133µs	52.201µs ± 0.041µs	52.193µs ± 0.028µs	52.226µs	52.279µs	52.305µs	52.331µs	0.26%	0.770	0.044	0.08%	0.003µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	19109204.526op/s	19156854.057op/s ± 15091.614op/s	19159731.991op/s ± 10366.489op/s	19169154.435op/s	19175738.760op/s	19179737.797op/s	19181712.156op/s	0.11%	-0.767	0.037	0.08%	1067.138op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	5.693µs	5.850µs ± 0.073µs	5.843µs ± 0.051µs	5.897µs	5.965µs	6.016µs	6.033µs	3.26%	0.141	-0.434	1.25%	0.005µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	165751754.440op/s	170975750.602op/s ± 2137664.845op/s	171152622.434op/s ± 1496986.304op/s	172582440.190op/s	174567777.716op/s	175577034.419op/s	175660624.085op/s	2.63%	-0.083	-0.454	1.25%	151155.731op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.911µs; 3.911µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/	throughput	[255664261.254op/s; 255721492.335op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[81.788µs; 81.977µs] or [-0.116%; +0.116%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[12199347.280op/s; 12227654.369op/s] or [-0.116%; +0.116%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[75.050µs; 75.102µs] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[13315269.489op/s; 13324526.339op/s] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.910µs; 3.911µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[255689431.362op/s; 255731485.933op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[72.176µs; 72.236µs] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[13843642.571op/s; 13855155.279op/s] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[52.183µs; 52.194µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[19159379.610op/s; 19163388.217op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[5.849µs; 5.869µs] or [-0.178%; +0.178%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[170399952.022op/s; 171009087.949op/s] or [-0.178%; +0.178%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.910µs; 3.911µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[255697966.059op/s; 255743703.207op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[64.357µs; 64.405µs] or [-0.037%; +0.037%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[15526904.993op/s; 15538390.990op/s] or [-0.037%; +0.037%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[57.543µs; 57.581µs] or [-0.033%; +0.033%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[17366922.095op/s; 17378346.650op/s] or [-0.033%; +0.033%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.911µs; 3.912µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[255614373.823op/s; 255668085.548op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[54.856µs; 54.910µs] or [-0.049%; +0.049%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[18212008.041op/s; 18229628.328op/s] or [-0.048%; +0.048%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[52.195µs; 52.206µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[19154762.505op/s; 19158945.610op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[5.840µs; 5.860µs] or [-0.174%; +0.174%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[170679490.814op/s; 171272010.391op/s] or [-0.173%; +0.173%]	None	None	None

Group 19

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	301db70	1765654322	levi/bin_tests

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sdk_test_data/rules-based	execution_time	144.992µs	146.826µs ± 1.802µs	146.640µs ± 0.527µs	147.030µs	148.193µs	153.126µs	164.930µs	12.47%	6.605	57.115	1.22%	0.127µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sdk_test_data/rules-based	execution_time	[146.576µs; 147.075µs] or [-0.170%; +0.170%]	None	None	None

Baseline

Omitted due to size.

[dd-octo-sts]

Artifact Size Benchmark Report

aarch64-alpine-linux-musl

Artifact	Baseline	Commit	Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so	7.44 MB	7.44 MB	0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a	86.48 MB	86.48 MB	0% (0 B) 👌

aarch64-apple-darwin

Artifact	Baseline	Commit	Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a	58.49 MB	58.49 MB	0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib	8.45 MB	8.45 MB	0% (0 B) 👌

aarch64-unknown-linux-gnu

Artifact	Baseline	Commit	Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so	9.61 MB	9.61 MB	0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a	100.27 MB	100.27 MB	0% (0 B) 👌

libdatadog-x64-windows

Artifact	Baseline	Commit	Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll	19.72 MB	19.72 MB	0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib	69.82 KB	69.82 KB	0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb	140.15 MB	140.14 MB	-0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib	744.89 MB	744.89 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll	6.37 MB	6.37 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib	69.82 KB	69.82 KB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb	19.75 MB	19.75 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib	38.79 MB	38.79 MB	0% (0 B) 👌

libdatadog-x86-windows

Artifact	Baseline	Commit	Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll	16.83 MB	16.83 MB	0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib	70.90 KB	70.90 KB	0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb	142.76 MB	142.76 MB	0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib	733.41 MB	733.41 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll	4.89 MB	4.89 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib	70.90 KB	70.90 KB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb	20.98 MB	20.98 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib	36.54 MB	36.54 MB	0% (0 B) 👌

x86_64-alpine-linux-musl

Artifact	Baseline	Commit	Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a	74.80 MB	74.80 MB	0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so	8.88 MB	8.88 MB	0% (0 B) 👌

x86_64-apple-darwin

Artifact	Baseline	Commit	Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a	59.83 MB	59.83 MB	0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib	9.50 MB	9.50 MB	0% (0 B) 👌

x86_64-unknown-linux-gnu

Artifact	Baseline	Commit	Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a	94.46 MB	94.46 MB	0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so	10.32 MB	10.32 MB	0% (0 B) 👌

[gyuheon0h]

Thanks for this.

[gyuheon0h]

/merge

[dd-devflow-routing-codex]

View all feedbacks in Devflow UI.

2025-12-15 13:49:12 UTC ℹ️ Start processing command /merge

---

2025-12-15 13:49:18 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in main is approximately 34m (p90).

---

2025-12-15 14:13:54 UTC ℹ️ MergeQueue: This merge request was merged