Skip to content

Conversation

@morrisonlevi
Copy link
Contributor

What does this PR do?

Adds supporting FFI infrastructure for the profiling library, including:

  • ArcHandle<T>: Generic wrapper for exposing libdd-profiling's Arc<T> across FFI boundaries.
  • ProfileStatus: FFI-safe status/result type for error handling.
  • ProfileError: Structured error types with FFI-safe string formatting. Basically, a more Rust-ergonomic ProfileStatus with convenient conversions from many error types.
  • Utf8Option: UTF-8 validation options for string handling, which will be used in the ProfilesDictionary FFI methods.
  • FallibleStringWriter: Utility for formatting errors into strings, accounting for allocation failures.

Motivation

This lays the groundwork for upcoming FFI enhancements, specifically:

  1. ProfilesDictionary FFI bindings (next PR).
  2. New ddog_prof_Profile_add2 API (after that).

Additional Notes

  • No existing functionality is changed; this is purely additive.
  • No FFI functions are exported yet; these are internal building blocks that I split out because the PR was getting too large.

How to test the change?

Build and test the profiling and profiling FFI libraries:

cargo test -p "libdd-profiling" -p "libdd-profiling-ffi" --lib

@morrisonlevi morrisonlevi changed the title Levi/generic ffi infrastructure feat(profiling-ffi): ProfileStatus, ProfileError, and more supporting types Dec 13, 2025
@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 73.58121% with 135 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.18%. Comparing base (73c675b) to head (b3b3164).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1401      +/-   ##
==========================================
+ Coverage   71.16%   71.18%   +0.01%     
==========================================
  Files         403      407       +4     
  Lines       64368    64879     +511     
==========================================
+ Hits        45810    46185     +375     
- Misses      18558    18694     +136     
Components Coverage Δ
libdd-crashtracker 58.99% <ø> (+0.01%) ⬆️
libdd-crashtracker-ffi 16.74% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.81% <ø> (ø)
libdd-data-pipeline-ffi 76.59% <ø> (ø)
libdd-common 81.13% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.95% <ø> (ø)
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 80.05% <73.58%> (-0.40%) ⬇️
libdd-profiling-ffi 64.53% <68.92%> (+1.11%) ⬆️
datadog-sidecar 35.86% <ø> (ø)
datdog-sidecar-ffi 10.79% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.97% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Dec 13, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-12-13 19:20:45

Comparing candidate commit b3b3164 in PR branch levi/generic-ffi-infrastructure with baseline commit 73c675b in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.891µs 3.911µs ± 0.003µs 3.910µs ± 0.001µs 3.912µs 3.915µs 3.917µs 3.919µs 0.22% -1.438 15.053 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255188568.191op/s 255707557.750op/s ± 174388.216op/s 255751931.425op/s ± 83322.674op/s 255804367.867op/s 255876789.906op/s 255943228.907op/s 257022682.603op/s 0.50% 1.469 15.299 0.07% 12331.109op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 80.223µs 82.177µs ± 0.682µs 82.234µs ± 0.426µs 82.637µs 83.239µs 83.519µs 83.656µs 1.73% -0.474 0.086 0.83% 0.048µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11953663.680op/s 12169645.162op/s ± 101472.098op/s 12160393.010op/s ± 62681.579op/s 12230635.611op/s 12355309.497op/s 12449352.132op/s 12465295.137op/s 2.51% 0.521 0.147 0.83% 7175.161op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 74.372µs 75.073µs ± 0.207µs 75.052µs ± 0.127µs 75.211µs 75.408µs 75.557µs 75.768µs 0.95% 0.194 0.924 0.27% 0.015µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13198207.329op/s 13320400.488op/s ± 36627.237op/s 13324184.068op/s ± 22577.982op/s 13341739.975op/s 13375048.411op/s 13403090.431op/s 13445832.810op/s 0.91% -0.171 0.918 0.27% 2589.937op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.889µs 3.912µs ± 0.003µs 3.913µs ± 0.001µs 3.914µs 3.916µs 3.920µs 3.926µs 0.35% -1.589 16.388 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254704744.130op/s 255603196.206op/s ± 202262.398op/s 255589713.566op/s ± 89907.046op/s 255688960.677op/s 255880430.944op/s 255962903.803op/s 257127678.769op/s 0.60% 1.627 16.637 0.08% 14302.111op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.571µs 72.159µs ± 0.200µs 72.153µs ± 0.128µs 72.281µs 72.503µs 72.660µs 72.702µs 0.76% -0.067 0.408 0.28% 0.014µs 1 200
credit_card/is_card_number/378282246310005 throughput 13754847.842op/s 13858457.167op/s ± 38513.369op/s 13859462.460op/s ± 24598.640op/s 13883993.839op/s 13925961.059op/s 13959838.926op/s 13972140.958op/s 0.81% 0.087 0.416 0.28% 2723.306op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.142µs 52.175µs ± 0.018µs 52.171µs ± 0.009µs 52.182µs 52.212µs 52.244µs 52.246µs 0.14% 1.395 2.469 0.04% 0.001µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19140215.537op/s 19166271.619op/s ± 6761.002op/s 19167804.797op/s ± 3321.376op/s 19170773.676op/s 19173869.563op/s 19176199.021op/s 19178512.395op/s 0.06% -1.392 2.459 0.04% 478.075op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.699µs 5.881µs ± 0.070µs 5.874µs ± 0.055µs 5.935µs 5.984µs 6.009µs 6.014µs 2.38% -0.228 -0.596 1.20% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 166289216.540op/s 170062436.623op/s ± 2044805.825op/s 170246324.560op/s ± 1588399.397op/s 171457026.899op/s 173617369.092op/s 174614256.912op/s 175459136.124op/s 3.06% 0.277 -0.545 1.20% 144589.607op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.890µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.916µs 3.919µs 3.920µs 0.24% -1.267 12.118 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255086446.683op/s 255685849.305op/s ± 193401.626op/s 255708520.277op/s ± 116026.088op/s 255800057.562op/s 255902016.643op/s 255972243.516op/s 257070674.638op/s 0.53% 1.295 12.328 0.08% 13675.560op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.175µs 64.512µs ± 0.219µs 64.443µs ± 0.131µs 64.659µs 64.895µs 65.098µs 65.375µs 1.45% 1.072 1.083 0.34% 0.015µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15296431.607op/s 15501158.414op/s ± 52347.556op/s 15517611.576op/s ± 31590.735op/s 15539730.324op/s 15563188.701op/s 15577721.757op/s 15582477.504op/s 0.42% -1.053 1.013 0.34% 3701.531op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.381µs 57.539µs ± 0.125µs 57.501µs ± 0.049µs 57.569µs 57.830µs 58.013µs 58.032µs 0.92% 1.983 4.345 0.22% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17231798.690op/s 17379481.321op/s ± 37490.478op/s 17390869.793op/s ± 14962.983op/s 17402040.391op/s 17417265.217op/s 17425425.770op/s 17427446.485op/s 0.21% -1.967 4.276 0.22% 2650.977op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.898µs 3.910µs ± 0.002µs 3.910µs ± 0.001µs 3.912µs 3.914µs 3.917µs 3.918µs 0.19% -0.152 3.953 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255260670.859op/s 255726012.642op/s ± 151087.221op/s 255736186.682op/s ± 85885.100op/s 255818527.122op/s 255930613.963op/s 256005907.869op/s 256534017.745op/s 0.31% 0.162 3.990 0.06% 10683.480op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.583µs 54.996µs ± 0.291µs 54.915µs ± 0.167µs 55.145µs 55.557µs 55.890µs 56.370µs 2.65% 1.385 2.601 0.53% 0.021µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17740077.838op/s 18183805.505op/s ± 95613.114op/s 18210110.255op/s ± 55163.898op/s 18252580.211op/s 18292799.279op/s 18307829.648op/s 18320571.344op/s 0.61% -1.344 2.404 0.52% 6760.868op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.133µs 52.205µs ± 0.039µs 52.201µs ± 0.024µs 52.226µs 52.282µs 52.320µs 52.346µs 0.28% 0.864 0.983 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19103521.485op/s 19155288.324op/s ± 14178.056op/s 19156868.311op/s ± 8685.333op/s 19164686.669op/s 19175368.472op/s 19179144.177op/s 19181637.418op/s 0.13% -0.859 0.971 0.07% 1002.540op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.695µs 5.887µs ± 0.065µs 5.895µs ± 0.037µs 5.931µs 5.990µs 6.031µs 6.040µs 2.46% -0.304 0.086 1.11% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165554387.526op/s 169887540.613op/s ± 1896402.364op/s 169631314.317op/s ± 1045323.613op/s 170772151.377op/s 173414854.666op/s 174656712.471op/s 175602794.913op/s 3.52% 0.371 0.146 1.11% 134095.897op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.910µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [255683389.221op/s; 255731726.280op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.083µs; 82.272µs] or [-0.115%; +0.115%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12155582.105op/s; 12183708.218op/s] or [-0.116%; +0.116%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [75.045µs; 75.102µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13315324.305op/s; 13325476.671op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255575164.583op/s; 255631227.829op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.131µs; 72.186µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/378282246310005 throughput [13853119.584op/s; 13863794.749op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.172µs; 52.178µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19165334.609op/s; 19167208.629op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.871µs; 5.891µs] or [-0.166%; +0.166%] None None None
credit_card/is_card_number/x371413321323331 throughput [169779046.202op/s; 170345827.044op/s] or [-0.167%; +0.167%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.911µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255659045.700op/s; 255712652.910op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.482µs; 64.542µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15493903.547op/s; 15508413.282op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.522µs; 57.557µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17374285.502op/s; 17384677.141op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.910µs; 3.911µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255705073.406op/s; 255746951.878op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.955µs; 55.036µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18170554.446op/s; 18197056.563op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.200µs; 52.210µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19153323.382op/s; 19157253.266op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.878µs; 5.896µs] or [-0.154%; +0.154%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [169624717.484op/s; 170150363.742op/s] or [-0.155%; +0.155%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 84.915µs 85.141µs ± 0.176µs 85.123µs ± 0.057µs 85.181µs 85.311µs 85.719µs 86.966µs 2.16% 6.443 59.313 0.21% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.116µs; 85.165µs] or [-0.029%; +0.029%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.878µs 162.675µs ± 0.395µs 162.632µs ± 0.149µs 162.766µs 163.235µs 164.259µs 165.935µs 2.03% 3.623 24.613 0.24% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.621µs; 162.730µs] or [-0.034%; +0.034%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.790µs 34.382µs ± 0.921µs 33.952µs ± 0.065µs 34.118µs 36.378µs 36.414µs 37.346µs 10.00% 1.698 1.032 2.67% 0.065µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.255µs; 34.510µs] or [-0.371%; +0.371%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.726ms 10.009ms ± 0.108ms 10.041ms ± 0.057ms 10.085ms 10.137ms 10.177ms 10.229ms 1.87% -0.778 -0.332 1.08% 0.008ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.994ms; 10.024ms] or [-0.150%; +0.150%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.577ms 10.607ms ± 0.014ms 10.605ms ± 0.010ms 10.615ms 10.630ms 10.646ms 10.666ms 0.57% 0.798 1.602 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.605ms; 10.609ms] or [-0.018%; +0.018%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.900µs 205.399µs ± 0.319µs 205.300µs ± 0.196µs 205.634µs 205.976µs 206.308µs 206.507µs 0.59% 0.939 0.460 0.16% 0.023µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4842449.594op/s 4868589.139op/s ± 7558.604op/s 4870914.833op/s ± 4651.490op/s 4874460.573op/s 4877563.757op/s 4879095.700op/s 4880433.984op/s 0.20% -0.932 0.438 0.15% 534.474op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.566µs 18.660µs ± 0.117µs 18.616µs ± 0.029µs 18.667µs 18.875µs 19.130µs 19.421µs 4.33% 2.849 10.985 0.63% 0.008µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 51489598.447op/s 53593652.180op/s ± 331040.404op/s 53717012.545op/s ± 84460.477op/s 53788364.665op/s 53823522.704op/s 53853017.762op/s 53861013.025op/s 0.27% -2.761 10.200 0.62% 23408.091op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.771µs 10.856µs ± 0.039µs 10.852µs ± 0.024µs 10.879µs 10.936µs 10.964µs 10.979µs 1.17% 0.773 0.702 0.36% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 91086396.490op/s 92116804.349op/s ± 328847.610op/s 92151473.117op/s ± 206451.626op/s 92346697.047op/s 92597844.913op/s 92691886.574op/s 92841429.673op/s 0.75% -0.750 0.660 0.36% 23253.037op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.355µs; 205.443µs] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4867541.589op/s; 4869636.689op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.643µs; 18.676µs] or [-0.087%; +0.087%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53547773.164op/s; 53639531.196op/s] or [-0.086%; +0.086%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.851µs; 10.861µs] or [-0.050%; +0.050%] None None None
normalization/normalize_name/normalize_name/good throughput [92071229.233op/s; 92162379.465op/s] or [-0.049%; +0.049%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.138ns 257.639ns ± 14.385ns 250.998ns ± 3.465ns 257.914ns 285.716ns 301.723ns 303.665ns 20.98% 1.586 1.370 5.57% 1.017ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.646ns; 259.633ns] or [-0.774%; +0.774%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.237ms 14.299ms ± 0.034ms 14.295ms ± 0.018ms 14.314ms 14.352ms 14.431ms 14.474ms 1.25% 1.777 5.533 0.24% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.295ms; 14.304ms] or [-0.033%; +0.033%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.417µs 2.444µs ± 0.026µs 2.436µs ± 0.008µs 2.454µs 2.514µs 2.524µs 2.558µs 5.00% 2.075 4.281 1.04% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.440µs; 2.447µs] or [-0.145%; +0.145%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.485µs 25.353µs ± 9.450µs 17.971µs ± 0.145µs 34.393µs 42.952µs 43.658µs 58.083µs 223.21% 0.771 -0.643 37.18% 0.668µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.043µs; 26.662µs] or [-5.166%; +5.166%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.943ms 3.948ms ± 0.006ms 3.947ms ± 0.001ms 3.948ms 3.950ms 3.953ms 4.025ms 1.99% 11.329 143.754 0.15% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.947ms; 3.948ms] or [-0.021%; +0.021%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.199ns 190.718ns ± 2.113ns 190.453ns ± 1.317ns 191.584ns 195.102ns 197.010ns 199.694ns 4.85% 1.319 1.983 1.10% 0.149ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.426ns; 191.011ns] or [-0.154%; +0.154%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.058µs 533.863µs ± 0.498µs 533.804µs ± 0.281µs 534.121µs 534.506µs 534.804µs 538.447µs 0.87% 4.017 34.069 0.09% 0.035µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1857193.204op/s 1873142.215op/s ± 1741.119op/s 1873348.217op/s ± 986.153op/s 1874317.063op/s 1875033.382op/s 1875730.293op/s 1875967.020op/s 0.14% -3.962 33.399 0.09% 123.116op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.760µs 381.268µs ± 0.842µs 381.615µs ± 0.619µs 381.979µs 382.355µs 382.515µs 382.587µs 0.25% -0.297 -1.433 0.22% 0.060µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2613783.389op/s 2622842.117op/s ± 5798.922op/s 2620444.905op/s ± 4245.855op/s 2628414.850op/s 2632111.860op/s 2632956.020op/s 2633242.048op/s 0.49% 0.301 -1.431 0.22% 410.046op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 188.932µs 189.328µs ± 0.211µs 189.310µs ± 0.136µs 189.446µs 189.708µs 189.808µs 190.043µs 0.39% 0.540 0.028 0.11% 0.015µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5261969.105op/s 5281845.461op/s ± 5896.481op/s 5282333.460op/s ± 3796.908op/s 5286060.622op/s 5290853.424op/s 5292460.144op/s 5292902.615op/s 0.20% -0.535 0.018 0.11% 416.944op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.877µs 37.009µs ± 0.051µs 37.006µs ± 0.035µs 37.043µs 37.096µs 37.126µs 37.163µs 0.43% 0.167 -0.074 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26908400.052op/s 27020351.073op/s ± 37246.815op/s 27022988.866op/s ± 25610.313op/s 27045690.031op/s 27080436.011op/s 27097117.819op/s 27116938.170op/s 0.35% -0.159 -0.078 0.14% 2633.748op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.915µs 45.131µs ± 0.173µs 45.111µs ± 0.131µs 45.244µs 45.363µs 45.438µs 46.528µs 3.14% 2.696 19.212 0.38% 0.012µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21492521.916op/s 22158130.554op/s ± 84221.863op/s 22167419.437op/s ± 64154.391op/s 22226601.693op/s 22257935.769op/s 22263541.817op/s 22264425.678op/s 0.44% -2.541 17.598 0.38% 5955.385op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [533.794µs; 533.932µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1872900.913op/s; 1873383.517op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.151µs; 381.384µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2622038.442op/s; 2623645.792op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.299µs; 189.357µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5281028.266op/s; 5282662.657op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.002µs; 37.016µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27015189.022op/s; 27025513.123op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.107µs; 45.155µs] or [-0.053%; +0.053%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22146458.213op/s; 22169802.894op/s] or [-0.053%; +0.053%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.935ms 61.436ms ± 2.480ms 61.127ms ± 0.054ms 61.184ms 61.335ms 80.199ms 83.282ms 36.25% 8.021 62.728 4.03% 0.175ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.093ms; 61.780ms] or [-0.559%; +0.559%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.464µs 146.645µs ± 1.627µs 146.497µs ± 0.587µs 147.013µs 148.052µs 152.366µs 161.504µs 10.24% 5.160 38.755 1.11% 0.115µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.420µs; 146.871µs] or [-0.154%; +0.154%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.209µs 3.228µs ± 1.437µs 2.991µs ± 0.030µs 3.024µs 3.672µs 14.187µs 14.843µs 396.28% 7.283 54.446 44.39% 0.102µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.029µs; 3.427µs] or [-6.168%; +6.168%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 534.421µs 535.083µs ± 0.467µs 535.035µs ± 0.294µs 535.329µs 535.814µs 536.334µs 538.517µs 0.65% 2.453 13.732 0.09% 0.033µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [535.018µs; 535.147µs] or [-0.012%; +0.012%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b3b3164 1765652640 levi/generic-ffi-infrastructure
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.041µs 5.111µs ± 0.042µs 5.121µs ± 0.033µs 5.137µs 5.183µs 5.188µs 5.200µs 1.54% 0.149 -0.977 0.81% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.105µs; 5.117µs] or [-0.113%; +0.113%] None None None

Baseline

Omitted due to size.

@morrisonlevi
Copy link
Contributor Author

Crap, after adding tests and such, this got too big as well >.<
I'll split this further.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants