Skip to content

Add endpoints collection #1182

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 22 commits into
base: main
Choose a base branch
from
Draft

Add endpoints collection #1182

wants to merge 22 commits into from

Conversation

estringana
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@estringana estringana force-pushed the estringana/add-routes-collection branch from a120146 to c6ec532 Compare August 14, 2025 08:47
@pr-commenter
Copy link

pr-commenter bot commented Aug 14, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-10-06 08:36:44

Comparing candidate commit 3681f4c in PR branch estringana/add-routes-collection with baseline commit cbbd077 in branch main.

Found 20 performance improvements and 0 performance regressions! Performance is the same for 33 metrics, 2 unstable metrics.

scenario:benching serializing traces from their internal representation to msgpack

  • 🟩 execution_time [-961.954µs; -948.812µs] or [-6.388%; -6.300%]

scenario:concentrator/add_spans_to_concentrator

  • 🟩 execution_time [-2.471ms; -2.467ms] or [-22.961%; -22.915%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟩 execution_time [-7.420µs; -7.368µs] or [-13.966%; -13.868%]
  • 🟩 throughput [+3030960.837op/s; +3055873.887op/s] or [+16.103%; +16.235%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟩 execution_time [-5.594µs; -5.542µs] or [-9.483%; -9.395%]
  • 🟩 throughput [+1759195.760op/s; +1774204.535op/s] or [+10.377%; +10.466%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟩 execution_time [-5.446µs; -5.393µs] or [-9.788%; -9.692%]
  • 🟩 throughput [+1930781.018op/s; +1948039.044op/s] or [+10.742%; +10.838%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟩 execution_time [-7.495µs; -7.456µs] or [-14.109%; -14.036%]
  • 🟩 throughput [+3073990.259op/s; +3092409.327op/s] or [+16.329%; +16.427%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

  • 🟩 execution_time [-19.359µs; -19.164µs] or [-9.433%; -9.338%]
  • 🟩 throughput [+502190.619op/s; +507140.548op/s] or [+10.306%; +10.408%]

scenario:normalization/normalize_name/normalize_name/bad-name

  • 🟩 execution_time [-864.845ns; -844.080ns] or [-4.641%; -4.529%]
  • 🟩 throughput [+2547731.286op/s; +2608879.275op/s] or [+4.748%; +4.862%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

  • 🟩 execution_time [-41.104µs; -40.716µs] or [-7.667%; -7.594%]
  • 🟩 throughput [+153359.838op/s; +154796.655op/s] or [+8.222%; +8.299%]

scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて

  • 🟩 throughput [+107486.414op/s; +108512.022op/s] or [+4.158%; +4.198%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

  • 🟩 execution_time [-22.990µs; -22.848µs] or [-12.066%; -11.992%]
  • 🟩 throughput [+715328.546op/s; +720033.430op/s] or [+13.629%; +13.719%]

scenario:redis/obfuscate_redis_string

  • 🟩 execution_time [-2.432µs; -2.041µs] or [-6.721%; -5.641%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 155.124µs 155.949µs ± 0.692µs 155.887µs ± 0.137µs 156.023µs 156.348µs 156.690µs 165.065µs 5.89% 11.523 149.268 0.44% 0.049µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [155.853µs; 156.045µs] or [-0.061%; +0.061%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.247ms 61.833ms ± 2.529ms 61.519ms ± 0.051ms 61.568ms 61.737ms 80.972ms 84.169ms 36.82% 8.015 62.704 4.08% 0.179ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.483ms; 62.184ms] or [-0.567%; +0.567%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.275ms 8.295ms ± 0.009ms 8.294ms ± 0.005ms 8.299ms 8.312ms 8.328ms 8.328ms 0.41% 1.130 2.012 0.11% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.294ms; 8.296ms] or [-0.015%; +0.015%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.280µs 185.969µs ± 0.402µs 185.895µs ± 0.234µs 186.172µs 186.599µs 187.398µs 188.053µs 1.16% 1.711 5.159 0.22% 0.028µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5317636.380op/s 5377276.173op/s ± 11579.207op/s 5379378.301op/s ± 6776.695op/s 5385164.829op/s 5391139.613op/s 5393304.122op/s 5397225.691op/s 0.33% -1.683 5.011 0.21% 818.774op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.696µs 17.781µs ± 0.043µs 17.781µs ± 0.033µs 17.810µs 17.855µs 17.881µs 17.910µs 0.72% 0.286 -0.474 0.24% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55836248.705op/s 56238706.713op/s ± 135968.520op/s 56239208.516op/s ± 104968.230op/s 56347785.163op/s 56436050.181op/s 56470400.565op/s 56510401.950op/s 0.48% -0.276 -0.488 0.24% 9614.426op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.528µs 10.644µs ± 0.047µs 10.647µs ± 0.032µs 10.677µs 10.720µs 10.742µs 10.759µs 1.05% -0.016 -0.529 0.44% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 92947404.444op/s 93948147.957op/s ± 411450.423op/s 93927114.015op/s ± 285467.251op/s 94223073.400op/s 94633896.056op/s 94809510.772op/s 94983093.729op/s 1.12% 0.035 -0.528 0.44% 29093.938op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.913µs; 186.024µs] or [-0.030%; +0.030%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5375671.406op/s; 5378880.940op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.775µs; 17.787µs] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [56219862.784op/s; 56257550.643op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.638µs; 10.651µs] or [-0.061%; +0.061%] None None None
normalization/normalize_name/normalize_name/good throughput [93891124.885op/s; 94005171.028op/s] or [-0.061%; +0.061%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.914µs ± 0.005µs 3.914µs ± 0.001µs 3.916µs 3.919µs 3.923µs 3.965µs 1.32% 5.931 68.662 0.12% 0.000µs 1 200
credit_card/is_card_number/ throughput 252182887.175op/s 255474260.299op/s ± 306551.830op/s 255515509.810op/s ± 94046.484op/s 255585940.803op/s 255738935.613op/s 255826786.491op/s 256949632.743op/s 0.56% -5.803 67.227 0.12% 21676.488op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.877µs 78.605µs ± 0.481µs 78.531µs ± 0.276µs 78.803µs 79.606µs 79.941µs 80.512µs 2.52% 1.049 1.317 0.61% 0.034µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12420508.744op/s 12722272.045op/s ± 77395.837op/s 12733885.146op/s ± 44881.661op/s 12778620.734op/s 12830438.746op/s 12835670.470op/s 12840710.188op/s 0.84% -1.009 1.199 0.61% 5472.712op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.444µs 71.889µs ± 0.302µs 71.846µs ± 0.220µs 72.066µs 72.472µs 72.770µs 72.850µs 1.40% 0.752 0.286 0.42% 0.021µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13726861.536op/s 13910547.048op/s ± 58228.077op/s 13918605.478op/s ± 42677.967op/s 13962033.193op/s 13986283.177op/s 13991767.877op/s 13996973.854op/s 0.56% -0.730 0.233 0.42% 4117.347op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.915µs 3.919µs 3.921µs 3.932µs 0.45% -0.217 13.071 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254355641.173op/s 255491283.634op/s ± 202413.635op/s 255500028.261op/s ± 100884.243op/s 255597468.220op/s 255717977.637op/s 255760002.158op/s 256837907.022op/s 0.52% 0.253 13.169 0.08% 14312.805op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.245µs 68.845µs ± 0.315µs 68.804µs ± 0.212µs 69.031µs 69.409µs 69.525µs 69.729µs 1.34% 0.356 -0.419 0.46% 0.022µs 1 200
credit_card/is_card_number/378282246310005 throughput 14341145.197op/s 14525768.369op/s ± 66402.052op/s 14533977.952op/s ± 44884.554op/s 14571553.113op/s 14623391.081op/s 14647676.504op/s 14653101.374op/s 0.82% -0.336 -0.439 0.46% 4695.334op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.348µs 45.734µs ± 0.186µs 45.778µs ± 0.130µs 45.898µs 45.946µs 45.987µs 46.063µs 0.62% -0.565 -0.917 0.41% 0.013µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21709376.478op/s 21865880.667op/s ± 89039.365op/s 21844659.843op/s ± 62035.514op/s 21927549.855op/s 22026504.714op/s 22044104.272op/s 22051462.677op/s 0.95% 0.575 -0.906 0.41% 6296.034op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.557µs 6.627µs ± 0.015µs 6.632µs ± 0.005µs 6.636µs 6.642µs 6.646µs 6.649µs 0.24% -1.799 4.047 0.22% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150408107.664op/s 150888830.547op/s ± 334421.432op/s 150774718.626op/s ± 123425.963op/s 151010360.556op/s 151577739.966op/s 152007618.048op/s 152520099.393op/s 1.16% 1.818 4.149 0.22% 23647.166op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.915µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.920µs 3.922µs 3.923µs 0.22% -0.675 5.301 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254917538.915op/s 255458729.410op/s ± 215637.001op/s 255467389.612op/s ± 138662.397op/s 255610417.315op/s 255747228.291op/s 255797188.762op/s 256753522.045op/s 0.50% 0.692 5.404 0.08% 15247.839op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.089µs 65.749µs ± 0.075µs 65.748µs ± 0.041µs 65.790µs 65.849µs 65.909µs 65.935µs 0.28% -3.226 28.914 0.11% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15166441.285op/s 15209393.179op/s ± 17361.546op/s 15209479.263op/s ± 9388.424op/s 15218496.202op/s 15229254.025op/s 15240631.082op/s 15363633.096op/s 1.01% 3.296 29.669 0.11% 1227.647op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.355µs 53.420µs ± 0.036µs 53.418µs ± 0.023µs 53.440µs 53.495µs 53.514µs 53.534µs 0.22% 0.585 0.203 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18679821.500op/s 18719427.799op/s ± 12744.276op/s 18720191.146op/s ± 7953.645op/s 18728232.477op/s 18739075.051op/s 18741374.245op/s 18742380.300op/s 0.12% -0.582 0.197 0.07% 901.156op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.899µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.916µs 3.920µs 3.921µs 3.925µs 0.28% -0.198 2.955 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254749304.749op/s 255448445.753op/s ± 195263.159op/s 255455218.706op/s ± 117026.518op/s 255569444.607op/s 255721513.678op/s 255787086.818op/s 256445463.133op/s 0.39% 0.209 2.991 0.08% 13807.190op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.147µs 50.218µs ± 0.039µs 50.216µs ± 0.023µs 50.235µs 50.285µs 50.319µs 50.346µs 0.26% 0.541 0.343 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19862405.174op/s 19913375.527op/s ± 15268.369op/s 19913985.522op/s ± 9291.465op/s 19923786.537op/s 19935627.759op/s 19940303.795op/s 19941199.385op/s 0.14% -0.537 0.333 0.08% 1079.637op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.324µs 45.645µs ± 0.136µs 45.671µs ± 0.100µs 45.764µs 45.807µs 45.831µs 45.857µs 0.41% -0.669 -0.568 0.30% 0.010µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21807152.806op/s 21908204.340op/s ± 65290.848op/s 21895902.504op/s ± 47752.404op/s 21951414.935op/s 22038853.287op/s 22054054.511op/s 22063321.733op/s 0.76% 0.677 -0.554 0.30% 4616.760op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.581µs 6.626µs ± 0.013µs 6.630µs ± 0.008µs 6.635µs 6.641µs 6.643µs 6.647µs 0.26% -1.116 1.052 0.19% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150440229.330op/s 150927196.585op/s ± 291721.190op/s 150832122.152op/s ± 174400.492op/s 151096256.597op/s 151551257.519op/s 151726131.812op/s 151960797.131op/s 0.75% 1.126 1.085 0.19% 20627.803op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number/ throughput [255431775.164op/s; 255516745.434op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.539µs; 78.672µs] or [-0.085%; +0.085%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12711545.727op/s; 12732998.364op/s] or [-0.084%; +0.084%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.847µs; 71.931µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13902477.196op/s; 13918616.899op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255463231.050op/s; 255519336.217op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.801µs; 68.888µs] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/378282246310005 throughput [14516565.683op/s; 14534971.055op/s] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.708µs; 45.760µs] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21853540.668op/s; 21878220.667op/s] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.625µs; 6.629µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/x371413321323331 throughput [150842482.953op/s; 150935178.141op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.915µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ throughput [255428844.196op/s; 255488614.624op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.739µs; 65.759µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15206987.036op/s; 15211799.323op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.415µs; 53.426µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18717661.564op/s; 18721194.033op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255421384.157op/s; 255475507.349op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.212µs; 50.223µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19911259.478op/s; 19915491.576op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.627µs; 45.664µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21899155.656op/s; 21917253.023op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.624µs; 6.628µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150886766.834op/s; 150967626.337op/s] or [-0.027%; +0.027%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.047ms 14.104ms ± 0.034ms 14.099ms ± 0.016ms 14.115ms 14.173ms 14.233ms 14.278ms 1.27% 2.064 6.099 0.24% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.100ms; 14.109ms] or [-0.033%; +0.033%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 242.059ns 254.690ns ± 15.089ns 247.715ns ± 4.062ns 260.621ns 292.129ns 299.347ns 299.924ns 21.08% 1.556 1.462 5.91% 1.067ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.599ns; 256.782ns] or [-0.821%; +0.821%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 494.561µs 495.230µs ± 0.889µs 495.118µs ± 0.245µs 495.367µs 495.688µs 498.985µs 504.895µs 1.97% 7.599 72.544 0.18% 0.063µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1980610.048op/s 2019269.795op/s ± 3575.487op/s 2019721.685op/s ± 999.350op/s 2020703.284op/s 2021497.946op/s 2021871.517op/s 2021997.082op/s 0.11% -7.510 71.068 0.18% 252.825op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.670µs 371.323µs ± 0.283µs 371.312µs ± 0.204µs 371.521µs 371.794µs 372.001µs 372.212µs 0.24% 0.183 -0.009 0.08% 0.020µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2686644.399op/s 2693074.457op/s ± 2050.101op/s 2693153.559op/s ± 1480.863op/s 2694303.268op/s 2696346.833op/s 2697696.687op/s 2697819.681op/s 0.17% -0.179 -0.012 0.08% 144.964op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 166.744µs 167.615µs ± 0.443µs 167.580µs ± 0.106µs 167.679µs 167.839µs 168.029µs 171.846µs 2.55% 7.935 71.704 0.26% 0.031µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5819148.707op/s 5966081.847op/s ± 15453.451op/s 5967287.193op/s ± 3778.136op/s 5971153.635op/s 5974728.621op/s 5984752.542op/s 5997225.656op/s 0.50% -7.849 70.712 0.26% 1092.724op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.377µs 36.645µs ± 0.128µs 36.650µs ± 0.083µs 36.727µs 36.843µs 36.922µs 37.144µs 1.35% 0.177 0.333 0.35% 0.009µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26922491.547op/s 27289297.178op/s ± 95517.308op/s 27285437.338op/s ± 61644.940op/s 27352450.034op/s 27458412.598op/s 27475734.534op/s 27489814.468op/s 0.75% -0.153 0.287 0.35% 6754.094op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.399µs 45.597µs ± 0.113µs 45.591µs ± 0.063µs 45.654µs 45.702µs 45.998µs 46.481µs 1.95% 3.083 20.528 0.25% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21514187.651op/s 21931618.460op/s ± 54073.567op/s 21933939.848op/s ± 30171.376op/s 21963963.973op/s 22000246.538op/s 22019229.774op/s 22027116.359op/s 0.42% -2.987 19.648 0.25% 3823.579op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [495.107µs; 495.353µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2018774.267op/s; 2019765.323op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.284µs; 371.362µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2692790.333op/s; 2693358.581op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [167.554µs; 167.677µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5963940.148op/s; 5968223.547op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.627µs; 36.663µs] or [-0.049%; +0.049%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27276059.398op/s; 27302534.958op/s] or [-0.049%; +0.049%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.581µs; 45.612µs] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21924124.384op/s; 21939112.537op/s] or [-0.034%; +0.034%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.027µs 5.088µs ± 0.043µs 5.074µs ± 0.030µs 5.114µs 5.158µs 5.163µs 5.170µs 1.89% 0.491 -1.060 0.85% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.082µs; 5.094µs] or [-0.118%; +0.118%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.923µs 25.507µs ± 9.541µs 18.146µs ± 0.092µs 33.664µs 44.032µs 44.536µs 69.996µs 285.75% 1.030 0.896 37.31% 0.675µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.184µs; 26.829µs] or [-5.184%; +5.184%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.159µs 3.157µs ± 1.432µs 2.983µs ± 0.024µs 3.004µs 3.372µs 13.716µs 15.141µs 407.50% 7.526 57.203 45.25% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.958µs; 3.355µs] or [-6.287%; +6.287%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.946µs 33.950µs ± 1.253µs 33.198µs ± 0.144µs 35.372µs 36.067µs 36.152µs 36.457µs 9.82% 0.935 -1.037 3.68% 0.089µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.776µs; 34.124µs] or [-0.512%; +0.512%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.319µs 2.379µs ± 0.017µs 2.378µs ± 0.006µs 2.387µs 2.408µs 2.418µs 2.419µs 1.72% -0.786 2.699 0.71% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.376µs; 2.381µs] or [-0.099%; +0.099%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3681f4c 1759739053 estringana/add-routes-collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 90.027µs 90.293µs ± 0.142µs 90.267µs ± 0.044µs 90.319µs 90.509µs 90.572µs 91.837µs 1.74% 6.737 68.032 0.16% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [90.274µs; 90.313µs] or [-0.022%; +0.022%] None None None

Baseline

Omitted due to size.

@datadog-datadog-prod-us1
Copy link

datadog-datadog-prod-us1 bot commented Aug 14, 2025 •
edited by datadog-official bot
Loading

⚠️ Tests

⚠️ Warnings

🧪 4 Tests failed

test_crash_tracking_bin_sigpipe from bin_tests::crashtracker_bin_test (Datadog) (✨ Fix with BitsAI) 
thread 'test_crash_tracking_bin_sigpipe' panicked at bin_tests/tests/crashtracker_bin_test.rs:171:10

thread 'test_crash_tracking_bin_sigpipe' panicked at bin_tests/tests/crashtracker_bin_test.rs:171:10:
called \`Result::unwrap()\` on an \`Err\` value: reading crashtracker stderr

Caused by:
    No such file or directory (os error 2)

Stack backtrace:
   0: <E as anyhow::context::ext::StdError>::ext_context
...
test_crash_tracking_bin_sigpipe_sigstack from bin_tests::crashtracker_bin_test (Datadog) (✨ Fix with BitsAI) 
thread 'test_crash_tracking_bin_sigpipe_sigstack' panicked at bin_tests/tests/crashtracker_bin_test.rs:171:10

thread 'test_crash_tracking_bin_sigpipe_sigstack' panicked at bin_tests/tests/crashtracker_bin_test.rs:171:10:
called \`Result::unwrap()\` on an \`Err\` value: reading crashtracker stderr

Caused by:
    No such file or directory (os error 2)

Stack backtrace:
   0: <E as anyhow::context::ext::StdError>::ext_context
...
tracing_integration_tests::uds_snapshot_test from datadog-trace-utils::test_send_data (Datadog) (✨ Fix with BitsAI) 
thread 'tracing_integration_tests::uds_snapshot_test' panicked at /home/runner/work/libdatadog/libdatadog/datadog-trace-utils/src/test_utils/datadog_test_agent.rs:213:18

thread 'tracing_integration_tests::uds_snapshot_test' panicked at /home/runner/work/libdatadog/libdatadog/datadog-trace-utils/src/test_utils/datadog_test_agent.rs:213:18:
Unable to start DatadogTestAgent, is the Docker Daemon running?: WaitContainer(StartupTimeout)
stack backtrace:
   0:     0x564ae36a06fa - std::backtrace_rs::backtrace::libunwind::trace::h886f3b0575353f6e
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
   1:     0x564ae36a06fa - std::backtrace_rs::backtrace::trace_unsynchronized::h652d1041ec67eb09
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2:     0x564ae36a06fa - std::sys::backtrace::_print_fmt::hd0317245a04c3039
...
tracing_integration_tests::uds_snapshot_test from data-pipeline::test_trace_exporter (Datadog) (✨ Fix with BitsAI) 
thread 'tracing_integration_tests::uds_snapshot_test' panicked at /home/runner/work/libdatadog/libdatadog/datadog-trace-utils/src/test_utils/datadog_test_agent.rs:213:18

thread 'tracing_integration_tests::uds_snapshot_test' panicked at /home/runner/work/libdatadog/libdatadog/datadog-trace-utils/src/test_utils/datadog_test_agent.rs:213:18:
Unable to start DatadogTestAgent, is the Docker Daemon running?: WaitContainer(StartupTimeout)
stack backtrace:
   0:     0x56472ba10bea - std::backtrace_rs::backtrace::libunwind::trace::h886f3b0575353f6e
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
   1:     0x56472ba10bea - std::backtrace_rs::backtrace::trace_unsynchronized::h652d1041ec67eb09
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2:     0x56472ba10bea - std::sys::backtrace::_print_fmt::hd0317245a04c3039
...
View all

ℹ️ Info

❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 3681f4c | Docs | Was this helpful? Give us feedback!

@codecov-commenter
Copy link

codecov-commenter commented Aug 21, 2025 •
edited
Loading

Codecov Report

❌ Patch coverage is 3.44828% with 112 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.65%. Comparing base (5ea1f98) to head (9f34ed4).
⚠️ Report is 47 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1182      +/-   ##
==========================================
+ Coverage   71.39%   71.65%   +0.26%     
==========================================
  Files         348      355       +7     
  Lines       54689    56380    +1691     
==========================================
+ Hits        39043    40398    +1355     
- Misses      15646    15982     +336
Components Coverage Δ
datadog-crashtracker 49.33% <ø> (+5.44%) ⬆️
datadog-crashtracker-ffi 5.93% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.45% <ø> (+0.01%) ⬆️
data-pipeline-ffi 88.19% <ø> (-0.36%) ⬇️
ddcommon 84.29% <ø> (+0.40%) ⬆️
ddcommon-ffi 73.84% <ø> (+3.69%) ⬆️
ddtelemetry 59.72% <19.04%> (-0.35%) ⬇️
ddtelemetry-ffi 21.24% <ø> (-0.09%) ⬇️
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.39% <ø> (ø)
datadog-profiling 76.90% <ø> (-0.25%) ⬇️
datadog-profiling-ffi 62.12% <ø> (ø)
datadog-sidecar 37.35% <0.00%> (+0.29%) ⬆️
datdog-sidecar-ffi 13.78% <0.00%> (+3.10%) ⬆️
spawn-worker 55.35% <ø> (ø)
tinybytes 92.22% <ø> (ø)
datadog-trace-normalization 98.24% <ø> (+<0.01%) ⬆️
datadog-trace-obfuscation 94.17% <ø> (+<0.01%) ⬆️
datadog-trace-protobuf 59.65% <ø> (-17.45%) ⬇️
datadog-trace-utils 89.77% <ø> (-0.16%) ⬇️
datadog-tracer-flare 54.52% <ø> (-1.56%) ⬇️
datadog-log 76.31% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@estringana estringana changed the base branch from main to bob/fix-worker-clone September 19, 2025 13:40
@bwoebi @estringana
Fix cloning too much for telemetry workers
b91ee92 
Turns out telemetry workers were cloning their whole contents, so when the HashSets and HashMaps were updated, the changes weren't persisted.

Signed-off-by: Bob Weinand <[email protected]>
@estringana estringana force-pushed the estringana/add-routes-collection branch from 4869bfe to b91ee92 Compare September 22, 2025 12:50
@estringana estringana changed the base branch from bob/fix-worker-clone to main September 22, 2025 12:54
cataphract
cataphract reviewed Sep 29, 2025
View reviewed changes
cataphract
cataphract reviewed Sep 30, 2025
View reviewed changes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cataphract cataphract cataphract left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
sidecar telemetry
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@estringana @codecov-commenter @cataphract @bwoebi