Skip to content

[WIP][crashtracking] Add minimal LD preload test for crashtracker collector #1428

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
gyuheon0h wants to merge 6 commits into
base: main
Choose a base branch
from
Draft

[WIP][crashtracking] Add minimal LD preload test for crashtracker collector #1428

gyuheon0h wants to merge 6 commits into from

Conversation

@gyuheon0h
Copy link
Contributor

@gyuheon0h gyuheon0h commented Jan 4, 2026

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@gyuheon0h Graphite App
Copy link
Contributor Author

gyuheon0h commented Jan 4, 2026

This stack of pull requests is managed by Graphite. Learn more about stacking.

@gyuheon0h gyuheon0h changed the title First pass, need to isolate only collector from test harness [crashtracking] Add minimal LD preload test for crashtracker collector Jan 4, 2026
@codecov-commenter
Copy link

codecov-commenter commented Jan 4, 2026 •
edited
Loading

Codecov Report

❌ Patch coverage is 5.88235% with 48 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.37%. Comparing base (e13f239) to head (5d2087f).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1428      +/-   ##
==========================================
- Coverage   71.41%   71.37%   -0.04%     
==========================================
  Files         411      412       +1     
  Lines       66047    66094      +47     
==========================================
+ Hits        47168    47177       +9     
- Misses      18879    18917      +38
Components Coverage Δ
libdd-crashtracker 58.70% <ø> (+0.04%) ⬆️
libdd-crashtracker-ffi 14.72% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.01% <ø> (ø)
libdd-data-pipeline-ffi 77.74% <ø> (ø)
libdd-common 81.33% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.95% <ø> (+0.03%) ⬆️
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 81.72% <ø> (+0.01%) ⬆️
libdd-profiling-ffi 67.83% <ø> (ø)
datadog-sidecar 35.88% <ø> (ø)
datdog-sidecar-ffi 10.88% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.92% <ø> (ø)
datadog-tracer-flare 62.06% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Jan 4, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-01-06 16:02:24

Comparing candidate commit 5d2087f in PR branch gyuheon0h/prof-13289-ld-preload_ with baseline commit e13f239 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.178µs 3.252µs ± 1.430µs 3.035µs ± 0.027µs 3.062µs 3.678µs 14.206µs 14.821µs 388.34% 7.286 54.498 43.87% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.053µs; 3.450µs] or [-6.095%; +6.095%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.447µs 2.474µs ± 0.020µs 2.469µs ± 0.008µs 2.481µs 2.513µs 2.521µs 2.650µs 7.33% 4.023 29.583 0.80% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.472µs; 2.477µs] or [-0.111%; +0.111%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 186.368ns 189.291ns ± 2.373ns 189.066ns ± 1.594ns 190.608ns 193.065ns 195.395ns 203.804ns 7.80% 1.712 6.724 1.25% 0.168ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [188.963ns; 189.620ns] or [-0.174%; +0.174%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.019ms 4.025ms ± 0.007ms 4.024ms ± 0.001ms 4.025ms 4.030ms 4.034ms 4.117ms 2.31% 11.031 139.739 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.024ms; 4.026ms] or [-0.024%; +0.024%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.909µs 25.796µs ± 9.285µs 18.312µs ± 0.332µs 33.577µs 42.321µs 43.119µs 62.360µs 240.54% 0.900 0.484 35.90% 0.657µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.509µs; 27.083µs] or [-4.988%; +4.988%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.553µs 35.221µs ± 1.089µs 34.716µs ± 0.061µs 34.879µs 37.519µs 37.562µs 39.263µs 13.10% 1.749 1.323 3.08% 0.077µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.070µs; 35.372µs] or [-0.428%; +0.428%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.687ms 9.915ms ± 0.061ms 9.912ms ± 0.032ms 9.951ms 10.001ms 10.052ms 10.177ms 2.67% -0.247 2.907 0.61% 0.004ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.906ms; 9.923ms] or [-0.085%; +0.085%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.709µs 534.645µs ± 0.467µs 534.658µs ± 0.303µs 534.875µs 535.301µs 535.907µs 538.082µs 0.64% 2.206 13.410 0.09% 0.033µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1858452.801op/s 1870401.515op/s ± 1632.141op/s 1870355.947op/s ± 1059.039op/s 1871563.256op/s 1872467.979op/s 1872983.237op/s 1873681.672op/s 0.18% -2.178 13.160 0.09% 115.410op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.961µs 382.531µs ± 0.292µs 382.479µs ± 0.195µs 382.722µs 383.010µs 383.409µs 383.516µs 0.27% 0.741 0.476 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2607456.396op/s 2614167.411op/s ± 1994.955op/s 2614525.897op/s ± 1334.161op/s 2615748.358op/s 2616851.463op/s 2617513.907op/s 2618071.317op/s 0.14% -0.736 0.465 0.08% 141.065op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.101µs 190.555µs ± 0.156µs 190.556µs ± 0.108µs 190.660µs 190.786µs 190.905µs 191.107µs 0.29% 0.100 0.227 0.08% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5232662.980op/s 5247834.481op/s ± 4298.684op/s 5247806.821op/s ± 2979.985op/s 5250931.763op/s 5254419.427op/s 5256674.465op/s 5260358.759op/s 0.24% -0.094 0.222 0.08% 303.963op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.957µs 37.202µs ± 0.090µs 37.227µs ± 0.057µs 37.273µs 37.317µs 37.339µs 37.359µs 0.35% -0.576 -0.683 0.24% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26767534.859op/s 26880393.924op/s ± 64952.270op/s 26861936.327op/s ± 41321.670op/s 26933180.433op/s 26995754.943op/s 27028007.074op/s 27058512.819op/s 0.73% 0.583 -0.673 0.24% 4592.819op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.793µs 45.908µs ± 0.064µs 45.900µs ± 0.040µs 45.940µs 46.030µs 46.053µs 46.244µs 0.75% 1.197 3.134 0.14% 0.005µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21624582.826op/s 21782966.110op/s ± 30515.883op/s 21786410.631op/s ± 18846.009op/s 21805340.458op/s 21824314.847op/s 21829930.455op/s 21837441.118op/s 0.23% -1.181 3.052 0.14% 2157.799op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.580µs; 534.710µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1870175.316op/s; 1870627.714op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [382.491µs; 382.572µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2613890.930op/s; 2614443.893op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.533µs; 190.577µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5247238.725op/s; 5248430.238op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.190µs; 37.214µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26871392.164op/s; 26889395.684op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.899µs; 45.916µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21778736.902op/s; 21787195.318op/s] or [-0.019%; +0.019%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.791ms 13.846ms ± 0.033ms 13.841ms ± 0.012ms 13.854ms 13.904ms 13.959ms 14.052ms 1.53% 3.133 14.565 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [13.842ms; 13.851ms] or [-0.033%; +0.033%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 90.048µs 90.387µs ± 0.155µs 90.363µs ± 0.059µs 90.426µs 90.589µs 90.861µs 91.898µs 1.70% 5.157 44.732 0.17% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [90.365µs; 90.408µs] or [-0.024%; +0.024%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.378µs 146.569µs ± 1.741µs 146.347µs ± 0.498µs 146.848µs 148.263µs 152.395µs 164.865µs 12.65% 6.660 62.131 1.18% 0.123µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.328µs; 146.811µs] or [-0.165%; +0.165%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.921µs 161.679µs ± 0.275µs 161.640µs ± 0.127µs 161.773µs 162.148µs 162.658µs 163.309µs 1.03% 1.833 7.594 0.17% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.640µs; 161.717µs] or [-0.024%; +0.024%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.001µs 5.062µs ± 0.039µs 5.080µs ± 0.028µs 5.099µs 5.108µs 5.110µs 5.112µs 0.64% -0.190 -1.743 0.76% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.056µs; 5.067µs] or [-0.106%; +0.106%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.686ms 61.207ms ± 1.823ms 60.967ms ± 0.100ms 61.062ms 61.350ms 70.574ms 78.721ms 29.12% 8.445 72.315 2.97% 0.129ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.955ms; 61.460ms] or [-0.413%; +0.413%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.651ms 10.677ms ± 0.014ms 10.677ms ± 0.009ms 10.684ms 10.703ms 10.716ms 10.732ms 0.52% 0.753 0.758 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.675ms; 10.679ms] or [-0.019%; +0.019%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 241.919ns 253.622ns ± 13.297ns 248.065ns ± 4.079ns 256.521ns 285.512ns 287.833ns 289.202ns 16.58% 1.430 0.738 5.23% 0.940ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [251.780ns; 255.465ns] or [-0.727%; +0.727%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.291µs 204.834µs ± 0.343µs 204.811µs ± 0.254µs 205.063µs 205.476µs 205.780µs 205.855µs 0.51% 0.621 0.114 0.17% 0.024µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4857776.769op/s 4882018.594op/s ± 8170.479op/s 4882549.609op/s ± 6061.085op/s 4888578.560op/s 4893361.939op/s 4894427.426op/s 4894982.127op/s 0.25% -0.612 0.095 0.17% 577.740op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.596µs 18.687µs ± 0.082µs 18.657µs ± 0.028µs 18.698µs 18.849µs 18.895µs 19.225µs 3.04% 2.346 8.682 0.44% 0.006µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52016590.648op/s 53512836.691op/s ± 233095.702op/s 53598041.098op/s ± 79251.528op/s 53658790.577op/s 53715599.071op/s 53733126.251op/s 53776059.172op/s 0.33% -2.281 8.082 0.43% 16482.355op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.758µs 10.854µs ± 0.051µs 10.846µs ± 0.034µs 10.886µs 10.951µs 10.987µs 11.007µs 1.48% 0.628 0.084 0.47% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 90847721.050op/s 92133753.093op/s ± 431690.090op/s 92196195.049op/s ± 287084.152op/s 92446022.201op/s 92744646.916op/s 92874393.732op/s 92950491.708op/s 0.82% -0.604 0.041 0.47% 30525.099op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [204.786µs; 204.881µs] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4880886.244op/s; 4883150.944op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.676µs; 18.699µs] or [-0.061%; +0.061%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53480531.868op/s; 53545141.513op/s] or [-0.060%; +0.060%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.847µs; 10.861µs] or [-0.065%; +0.065%] None None None
normalization/normalize_name/normalize_name/good throughput [92073924.998op/s; 92193581.187op/s] or [-0.065%; +0.065%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 533.590µs 534.292µs ± 0.391µs 534.223µs ± 0.234µs 534.499µs 535.052µs 535.339µs 535.388µs 0.22% 0.728 0.267 0.07% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [534.238µs; 534.346µs] or [-0.010%; +0.010%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2087f 1767714346 gyuheon0h/prof-13289-ld-preload_
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.916µs 3.918µs 3.920µs 0.24% -1.163 11.226 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255072954.157op/s 255668087.642op/s ± 183559.131op/s 255676196.561op/s ± 98298.895op/s 255779700.976op/s 255888251.871op/s 255941763.132op/s 256957059.631op/s 0.50% 1.189 11.408 0.07% 12979.591op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.389µs 78.897µs ± 0.866µs 78.767µs ± 0.590µs 79.441µs 80.454µs 80.897µs 82.303µs 4.49% 0.590 0.317 1.10% 0.061µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12150154.479op/s 12676190.818op/s ± 138326.503op/s 12695741.254op/s ± 94396.548op/s 12763207.244op/s 12871440.582op/s 12920367.962op/s 12921802.744op/s 1.78% -0.527 0.160 1.09% 9781.161op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.168µs 71.980µs ± 0.406µs 71.951µs ± 0.296µs 72.264µs 72.633µs 73.019µs 73.640µs 2.35% 0.579 0.621 0.56% 0.029µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13579560.397op/s 13893251.845op/s ± 78168.136op/s 13898414.886op/s ± 56943.547op/s 13952293.253op/s 14002855.792op/s 14034104.178op/s 14051321.491op/s 1.10% -0.541 0.511 0.56% 5527.322op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.916µs 3.918µs 3.919µs 0.20% -0.462 5.112 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255187023.046op/s 255664254.595op/s ± 179823.578op/s 255688532.374op/s ± 106713.401op/s 255773458.137op/s 255900272.689op/s 255979242.893op/s 256718994.706op/s 0.40% 0.477 5.188 0.07% 12715.447op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.099µs 68.623µs ± 0.292µs 68.569µs ± 0.208µs 68.827µs 69.150µs 69.373µs 69.448µs 1.28% 0.558 -0.253 0.43% 0.021µs 1 200
credit_card/is_card_number/378282246310005 throughput 14399244.296op/s 14572579.179op/s ± 61959.035op/s 14583785.070op/s ± 44214.567op/s 14619466.551op/s 14659741.528op/s 14674658.026op/s 14684593.538op/s 0.69% -0.540 -0.283 0.42% 4381.165op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.616µs 44.932µs ± 0.124µs 44.962µs ± 0.089µs 45.035µs 45.085µs 45.123µs 45.151µs 0.42% -0.602 -0.497 0.27% 0.009µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 22148057.680op/s 22256163.815op/s ± 61373.001op/s 22241105.553op/s ± 44005.551op/s 22297246.876op/s 22366518.924op/s 22406909.329op/s 22413387.084op/s 0.77% 0.611 -0.482 0.28% 4339.726op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.691µs 5.698µs ± 0.003µs 5.697µs ± 0.002µs 5.699µs 5.704µs 5.706µs 5.708µs 0.20% 0.711 0.359 0.06% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 175180645.683op/s 175515055.659op/s ± 96979.713op/s 175529278.284op/s ± 57838.081op/s 175584056.477op/s 175647219.604op/s 175673512.785op/s 175707528.162op/s 0.10% -0.708 0.353 0.06% 6857.501op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.890µs 3.912µs ± 0.003µs 3.911µs ± 0.002µs 3.914µs 3.916µs 3.917µs 3.920µs 0.22% -1.599 11.798 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255106214.774op/s 255640618.227op/s ± 196929.344op/s 255666239.275op/s ± 140724.872op/s 255771289.855op/s 255899791.203op/s 255939744.448op/s 257060802.772op/s 0.55% 1.625 12.015 0.08% 13925.007op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 59.772µs 60.954µs ± 0.645µs 60.897µs ± 0.478µs 61.393µs 61.959µs 62.531µs 63.353µs 4.03% 0.631 0.757 1.05% 0.046µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15784658.755op/s 16407583.890op/s ± 172445.411op/s 16421070.808op/s ± 129808.664op/s 16549806.804op/s 16664168.167op/s 16716032.092op/s 16730108.462op/s 1.88% -0.559 0.560 1.05% 12193.732op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.267µs 53.795µs ± 0.139µs 53.819µs ± 0.071µs 53.887µs 53.966µs 54.014µs 54.039µs 0.41% -1.288 2.042 0.26% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18505118.892op/s 18589096.953op/s ± 48086.035op/s 18580803.218op/s ± 24634.863op/s 18608706.163op/s 18676445.570op/s 18745310.172op/s 18773206.117op/s 1.04% 1.307 2.105 0.26% 3400.196op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.892µs 3.911µs ± 0.003µs 3.911µs ± 0.001µs 3.912µs 3.915µs 3.918µs 3.922µs 0.28% -0.932 13.032 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254995981.594op/s 255690454.439op/s ± 172006.416op/s 255705229.172op/s ± 73137.837op/s 255774884.505op/s 255887948.421op/s 255979886.619op/s 256910356.070op/s 0.47% 0.961 13.206 0.07% 12162.690op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.214µs 50.489µs ± 0.129µs 50.494µs ± 0.065µs 50.551µs 50.649µs 50.997µs 51.094µs 1.19% 1.542 5.581 0.26% 0.009µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19571619.539op/s 19806355.977op/s ± 50441.872op/s 19804435.678op/s ± 25613.598op/s 19836904.784op/s 19873432.698op/s 19899429.248op/s 19914571.492op/s 0.56% -1.503 5.409 0.25% 3566.779op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.585µs 44.952µs ± 0.112µs 44.965µs ± 0.071µs 45.032µs 45.101µs 45.171µs 45.205µs 0.53% -0.643 0.424 0.25% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 22121679.355op/s 22246207.423op/s ± 55473.254op/s 22239750.293op/s ± 35008.634op/s 22276384.267op/s 22344902.887op/s 22403103.067op/s 22429309.455op/s 0.85% 0.658 0.452 0.25% 3922.551op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.692µs 5.698µs ± 0.007µs 5.697µs ± 0.002µs 5.700µs 5.704µs 5.707µs 5.792µs 1.66% 10.704 134.662 0.13% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 172656434.846op/s 175490905.221op/s ± 221224.157op/s 175522545.871op/s ± 57543.349op/s 175571058.012op/s 175627210.301op/s 175651247.323op/s 175675640.505op/s 0.09% -10.619 133.196 0.13% 15642.910op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255642648.112op/s; 255693527.172op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.777µs; 79.018µs] or [-0.152%; +0.152%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12657020.095op/s; 12695361.541op/s] or [-0.151%; +0.151%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.923µs; 72.036µs] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13882418.493op/s; 13904085.196op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255639332.777op/s; 255689176.414op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.583µs; 68.664µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/378282246310005 throughput [14563992.253op/s; 14581166.105op/s] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [44.915µs; 44.949µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22247658.107op/s; 22264669.522op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.697µs; 5.698µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 throughput [175501615.203op/s; 175528496.114op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255613325.714op/s; 255667910.740op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [60.865µs; 61.044µs] or [-0.147%; +0.147%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [16383684.615op/s; 16431483.165op/s] or [-0.146%; +0.146%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.776µs; 53.815µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18582432.691op/s; 18595761.215op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255666616.004op/s; 255714292.874op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.471µs; 50.507µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19799365.219op/s; 19813346.736op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [44.936µs; 44.967µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22238519.363op/s; 22253895.482op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.697µs; 5.699µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [175460245.681op/s; 175521564.762op/s] or [-0.017%; +0.017%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Jan 4, 2026 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 87.06 MB 87.06 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.50 MB 7.50 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.86 MB 58.86 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.49 MB 8.49 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.62 MB 9.62 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.74 MB 100.74 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 20.05 MB 20.05 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 74.31 KB 74.31 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.00 MB 142.00 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 747.80 MB 747.80 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.41 MB 6.41 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 74.31 KB 74.31 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.89 MB 19.89 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.98 MB 38.98 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 17.11 MB 17.11 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 75.46 KB 75.46 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 144.70 MB 144.71 MB +0% (+8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 736.69 MB 736.69 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.92 MB 4.92 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 75.46 KB 75.46 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 21.17 MB 21.18 MB +.03% (+8.00 KB) 🔍
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.78 MB 36.78 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 75.34 MB 75.34 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.93 MB 8.93 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 60.20 MB 60.20 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.54 MB 9.54 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.90 MB 94.90 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.35 MB 10.35 MB 0% (0 B) 👌

@gyuheon0h gyuheon0h force-pushed the gyuheon0h/prof-13289-ld-preload_ branch from c9a32e0 to 5d2087f Compare January 6, 2026 15:46
danielsn
danielsn reviewed Jan 6, 2026
View reviewed changes
bin_tests/preload/preload.c
}

void *ptr = real_malloc(size);
log_line("malloc", size, ptr);
Copy link
Contributor

@danielsn danielsn Jan 6, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should there be a global atomic that controls whether to log, enabled when the signal handler is active disabled otherwise?

@gyuheon0h gyuheon0h changed the title [crashtracking] Add minimal LD preload test for crashtracker collector [WIP][crashtracking] Add minimal LD preload test for crashtracker collector Jan 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@danielsn danielsn danielsn left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@gyuheon0h @codecov-commenter @danielsn