Skip to content

Conversation

@scottgerring
Copy link
Member

Working on fixing the dedicated benchmark runner setup. This supercedes #2840 as it needs to be setup from a branch within the repo and not a fork.

@codecov
Copy link

codecov bot commented Apr 23, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 81.1%. Comparing base (1f0d9a9) to head (7bf7f0f).
Report is 2 commits behind head on main.

Additional details and impacted files
@@          Coverage Diff          @@
##            main   #2942   +/-   ##
=====================================
  Coverage   81.1%   81.1%           
=====================================
  Files        126     126           
  Lines      24954   24954           
=====================================
  Hits       20255   20255           
  Misses      4699    4699           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

# TODO - temporarily move main to the shared workers, until we've resolved the instance setup issue
#
# TODO - temporarily use self-hosted to get shared-worker environment going
runs-on: 'self-hosted'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR run appears to be against a special branch:

Job defined at: open-telemetry/opentelemetry-rust/.github/workflows/benchmark.yml@refs/pull/2942/merge

can you add dependabot/scottgerring/benchmark-fix to the workflow definition above?

on: 
  pull_request:
  push:
    branches:
      - main
      - dependabot/scottgerring/benchmark-fix

@scottgerring
Copy link
Member Author

The story so far:

  • The self-hosted workers run ubuntu.
  • In addition to unzip missing, we're also missing, at least, cc.
  • We can't sudo to install things, of course

Docker is also missing, so we can't wrap things up that way.

@github-actions
Copy link

Benchmark for 28d605b

Click to view benchmark
Test Base PR %
AddWithDynamicAttributes 97.6±5.11ns 97.5±3.11ns -0.10%
AddWithDynamicAttributes_WithStringAllocation 91.8±2.46ns 92.2±1.91ns +0.44%
AddWithInlineStaticAttributes 15.3±0.64ns 15.3±0.61ns 0.00%
AddWithStaticArray 1.6±0.03ns 1.6±0.03ns 0.00%
BatchSpanProcessor/with 1 concurrent task 508.8±4.10µs 513.4±12.48µs +0.90%
BatchSpanProcessor/with 16 concurrent task 1044.1±42.48µs 1050.0±36.06µs +0.57%
BatchSpanProcessor/with 2 concurrent task 553.1±6.55µs 559.0±7.46µs +1.07%
BatchSpanProcessor/with 32 concurrent task 1497.3±15.65µs 1509.3±26.63µs +0.80%
BatchSpanProcessor/with 4 concurrent task 659.8±38.89µs 622.7±23.51µs -5.62%
BatchSpanProcessor/with 8 concurrent task 777.1±29.94µs 796.3±50.16µs +2.47%
Counter_Add_Sorted 176.5±9.79ns 177.8±6.68ns +0.74%
Counter_Add_Sorted_With_Non_Static_Values 264.0±8.79ns 258.6±7.93ns -2.05%
Counter_Add_Unsorted 181.7±5.68ns 184.5±15.48ns +1.54%
Counter_Overflow 591.0±19.85ns 588.6±27.51ns -0.41%
CreateOTelAnyValueInt 3.4±0.09ns 3.4±0.07ns 0.00%
CreateOTelAnyValueString 3.7±0.10ns 3.7±0.09ns 0.00%
CreateOTelKeyValue 5.6±0.05ns 5.6±0.16ns 0.00%
CreateOTelKey_Arc 14.4±0.77ns 14.8±1.28ns +2.78%
CreateOTelKey_Owned 14.4±1.17ns 14.5±0.74ns +0.69%
CreateOTelKey_Static 1.9±0.00ns 1.9±0.00ns 0.00%
CreateOTelValueInt 3.1±0.04ns 3.1±0.03ns 0.00%
CreateOTelValueString 3.7±0.07ns 3.7±0.07ns 0.00%
CreateOtelKeyValueArray 29.3±0.36ns 29.3±0.42ns 0.00%
CreateOtelKeyValueArrayWithMixedValueTypes 27.0±0.41ns 27.0±0.44ns 0.00%
CreateOtelKeyValueArrayWithNonStaticValues 100.5±3.75ns 111.4±8.59ns +10.85%
CreateTupleKeyValue 1.2±0.02ns 1.2±0.02ns 0.00%
CreateTupleKeyValueArray 5.0±0.05ns 5.0±0.03ns 0.00%
Gauge_Add 189.0±7.50ns 210.1±8.16ns +11.16%
Histogram_Record 209.9±6.39ns 208.3±6.49ns -0.76%
Histogram_Record_With_Non_Static_Values 281.3±12.95ns 281.9±9.23ns +0.21%
LogExporterWithFuture 92.4±2.06ns 92.4±2.95ns 0.00%
LogExporterWithoutFuture 87.9±2.61ns 87.5±2.01ns -0.46%
LoggerProvider_Creation 916.1±23.13ns 939.5±23.20ns +2.55%
Logger_Creation 12.9±0.24ns 12.9±0.21ns 0.00%
Logging_Comparable_To_Appender 89.4±2.29ns 91.2±1.78ns +2.01%
NoAttributes 1.6±0.04ns 1.6±0.04ns 0.00%
ThreadLocal_Random_Generator_5 11.5±0.75ns 10.4±0.84ns -9.57%
Tracer_With_Name/new_each_time 28.7±1.05ns 27.9±0.90ns -2.79%
Tracer_With_Name/reuse_existing 0.4±0.01ns 0.4±0.02ns 0.00%
Tracer_With_Name_And_Scope_Attrs/new_each_time 67.6±1.86ns 67.5±1.64ns -0.15%
Tracer_With_Name_And_Scope_Attrs/reuse_existing 0.6±0.02ns 0.6±0.03ns 0.00%
context/has_active_span/in-cx/alt 8.7±0.04ns 8.7±0.02ns 0.00%
context/has_active_span/in-cx/spec 5.0±0.23ns 5.0±0.16ns 0.00%
context/has_active_span/no-cx/alt 8.7±0.05ns 8.7±0.07ns 0.00%
context/has_active_span/no-cx/spec 5.0±0.25ns 5.0±0.17ns 0.00%
context/has_active_span/no-sdk/alt 8.7±0.08ns 8.7±0.03ns 0.00%
context/has_active_span/no-sdk/spec 5.0±0.14ns 5.0±0.19ns 0.00%
context/is_recording/in-cx/alt 4.7±0.21ns 4.7±0.14ns 0.00%
context/is_recording/in-cx/spec 7.5±0.27ns 7.5±0.27ns 0.00%
context/is_recording/no-cx/alt 4.7±0.21ns 4.7±0.19ns 0.00%
context/is_recording/no-cx/spec 7.5±0.26ns 7.5±0.32ns 0.00%
context/is_recording/no-sdk/alt 4.7±0.17ns 4.7±0.16ns 0.00%
context/is_recording/no-sdk/spec 7.5±0.22ns 7.5±0.21ns 0.00%
context/is_sampled/in-cx/alt 9.0±0.05ns 9.0±0.04ns 0.00%
context/is_sampled/in-cx/spec 5.4±0.28ns 5.4±0.31ns 0.00%
context/is_sampled/no-cx/alt 9.0±0.07ns 9.0±0.06ns 0.00%
context/is_sampled/no-cx/spec 5.3±0.28ns 5.3±0.19ns 0.00%
context/is_sampled/no-sdk/alt 9.0±0.05ns 9.0±0.07ns 0.00%
context/is_sampled/no-sdk/spec 5.3±0.11ns 5.3±0.20ns 0.00%
context_attach/nested_cx/empty_cx 46.5±1.08ns 46.9±0.90ns +0.86%
context_attach/nested_cx/single_value_cx 47.1±1.24ns 47.6±1.34ns +1.06%
context_attach/nested_cx/span_cx 47.2±1.42ns 47.6±1.47ns +0.85%
context_attach/out_of_order_cx_drop/empty_cx 41.0±1.19ns 40.5±0.79ns -1.22%
context_attach/out_of_order_cx_drop/single_value_cx 41.3±1.36ns 41.4±1.77ns +0.24%
context_attach/out_of_order_cx_drop/span_cx 41.6±1.08ns 41.5±1.19ns -0.24%
context_attach/single_cx/empty_cx 24.2±0.71ns 24.3±0.44ns +0.41%
context_attach/single_cx/single_value_cx 23.8±0.55ns 23.8±0.68ns 0.00%
context_attach/single_cx/span_cx 24.0±0.72ns 23.9±0.74ns -0.42%
exporter_disabled_concurrent_processor 3.7±0.10ns 3.8±0.17ns +2.70%
exporter_disabled_simple_processor 10.6±1.11ns 10.9±1.22ns +2.83%
full-log-with-4-attributes/no-context 76.1±1.16ns 75.7±4.47ns -0.53%
full-log-with-4-attributes/with-context 88.6±1.25ns 77.5±1.63ns -12.53%
full-log-with-9-attributes/no-context 138.7±4.57ns 138.1±3.14ns -0.43%
full-log-with-9-attributes/with-context 148.8±2.82ns 139.3±2.74ns -6.38%
full-log-with-attributes/no-context 242.0±5.30ns 269.7±4.47ns +11.45%
full-log-with-attributes/with-context 240.3±3.66ns 271.8±5.54ns +13.11%
full-log/no-context 27.0±0.81ns 27.2±0.93ns +0.74%
full-log/with-context 30.3±0.73ns 31.0±0.53ns +2.31%
log_clone_and_send_to_channel_processor 465.0±6.59ns 466.7±10.28ns +0.37%
log_cloning_processor 175.6±6.09ns 181.7±3.95ns +3.47%
log_no_subscriber 0.3±0.01ns 0.3±0.02ns 0.00%
log_noop_processor 87.1±3.53ns 88.3±2.94ns +1.38%
long-log/no-context 51.8±2.00ns 52.2±0.69ns +0.77%
long-log/with-context 52.1±1.03ns 53.2±0.80ns +2.11%
noop_layer_disabled 11.3±0.55ns 11.3±0.43ns 0.00%
noop_layer_enabled 22.0±1.00ns 22.3±0.74ns +1.36%
ot_layer_disabled 17.0±0.61ns 17.0±0.62ns 0.00%
ot_layer_enabled 147.0±6.98ns 146.2±8.07ns -0.54%
otel_2_attributes 144.8±5.08ns 145.2±4.82ns +0.28%
set_baggage_dynamic 71.1±3.04ns 70.9±2.22ns -0.28%
set_baggage_dynamic_with_metadata 100.9±3.31ns 101.5±5.53ns +0.59%
set_baggage_static_key 55.0±1.03ns 53.8±0.78ns -2.18%
set_baggage_static_key_value 30.9±0.73ns 30.7±1.27ns -0.65%
simple-log-with-a-lot-of-bytes/no-context 89.0±3.16ns 88.6±2.82ns -0.45%
simple-log-with-a-lot-of-bytes/with-context 89.1±3.16ns 90.4±3.46ns +1.46%
simple-log-with-bool/no-context 66.2±0.88ns 66.2±1.29ns 0.00%
simple-log-with-bool/with-context 67.2±1.04ns 68.0±1.14ns +1.19%
simple-log-with-bytes/no-context 89.3±2.31ns 87.7±2.00ns -1.79%
simple-log-with-bytes/with-context 89.0±2.42ns 88.6±2.49ns -0.45%
simple-log-with-double/no-context 64.8±1.25ns 64.7±0.89ns -0.15%
simple-log-with-double/with-context 65.9±1.33ns 66.1±0.85ns +0.30%
simple-log-with-inner-map-any-value/no-context 219.4±5.29ns 220.9±5.50ns +0.68%
simple-log-with-inner-map-any-value/with-context 217.5±4.88ns 220.5±6.09ns +1.38%
simple-log-with-inner-vec-any-value/no-context 184.2±3.32ns 180.9±4.77ns -1.79%
simple-log-with-inner-vec-any-value/with-context 184.7±4.67ns 186.0±4.39ns +0.70%
simple-log-with-int/no-context 64.4±1.48ns 64.7±1.11ns +0.47%
simple-log-with-int/with-context 66.0±1.45ns 65.8±1.00ns -0.30%
simple-log-with-map-any-value/no-context 137.9±5.25ns 136.5±5.05ns -1.02%
simple-log-with-map-any-value/with-context 138.3±3.58ns 137.9±3.62ns -0.29%
simple-log-with-string/no-context 63.8±1.12ns 64.0±0.95ns +0.31%
simple-log-with-string/with-context 64.9±1.43ns 65.5±0.92ns +0.92%
simple-log-with-vec-any-value/no-context 124.0±2.94ns 123.3±3.13ns -0.56%
simple-log-with-vec-any-value/with-context 124.2±2.50ns 122.8±2.89ns -1.13%
simple-log/no-context 51.6±1.19ns 52.2±0.96ns +1.16%
simple-log/with-context 52.1±1.05ns 53.3±1.01ns +2.30%
span_builder/simplest 135.7±2.99ns 135.0±4.26ns -0.52%
span_builder/with_attributes/1 163.1±3.84ns 164.6±7.51ns +0.92%
span_builder/with_attributes/4 188.0±6.37ns 184.4±8.76ns -1.91%
start-end-span-4-attrs/always-sample 309.9±11.65ns 308.3±7.46ns -0.52%
start-end-span-4-attrs/never-sample 168.2±3.36ns 168.5±3.31ns +0.18%
start-end-span-8-attrs/always-sample 411.1±25.17ns 410.7±14.28ns -0.10%
start-end-span-8-attrs/never-sample 197.5±4.70ns 197.4±1.99ns -0.05%
start-end-span-all-attr-types-2x/always-sample 429.3±15.25ns 409.5±14.86ns -4.61%
start-end-span-all-attr-types-2x/never-sample 219.2±2.82ns 219.1±2.08ns -0.05%
start-end-span-all-attr-types/always-sample 322.9±12.92ns 323.4±12.51ns +0.15%
start-end-span-all-attr-types/never-sample 179.1±3.44ns 178.8±2.39ns -0.17%
start-end-span/always-sample 244.0±8.32ns 244.7±7.45ns +0.29%
start-end-span/never-sample 127.7±3.92ns 127.5±2.03ns -0.16%
telemetry_suppression/enter_telemetry_suppressed_scope 27.6±1.23ns 27.4±0.37ns -0.72%
telemetry_suppression/is_current_telemetry_suppressed_false 1.4±0.05ns 1.4±0.07ns 0.00%
telemetry_suppression/is_current_telemetry_suppressed_true 1.4±0.05ns 1.4±0.03ns 0.00%
telemetry_suppression/normal_attach 30.8±0.47ns 30.7±0.43ns -0.32%

@scottgerring scottgerring marked this pull request as ready for review June 20, 2025 13:53
@scottgerring scottgerring requested a review from a team as a code owner June 20, 2025 13:53
@scottgerring
Copy link
Member Author

@cijothomas @trask this now works for our new bare-metal runner -->

forced to run on bare-metal on this branch, but triggers now only on pushes to main:
https://github.com/open-telemetry/opentelemetry-rust/actions/runs/15776440591/job/44471887631

as well as the github pooled workers for PRs that are tagged with performance:
https://github.com/open-telemetry/opentelemetry-rust/actions/runs/15780067707/job/44483262890

@scottgerring scottgerring changed the title ci: Benchmark fix [WIP] ci: Run benchmarks on main on the new oracle dedicated workers Jun 20, 2025
@github-actions
Copy link

Benchmark for 4aa757f

Click to view benchmark
Test Base PR %
AddWithDynamicAttributes 98.8±3.32ns 98.3±4.63ns -0.51%
AddWithDynamicAttributes_WithStringAllocation 83.2±2.75ns 92.3±1.68ns +10.94%
AddWithInlineStaticAttributes 15.3±0.51ns 15.4±0.62ns +0.65%
AddWithStaticArray 1.6±0.02ns 1.6±0.03ns 0.00%
BatchSpanProcessor/with 1 concurrent task 524.9±9.50µs 517.4±11.56µs -1.43%
BatchSpanProcessor/with 16 concurrent task 1062.9±34.40µs 1035.6±25.84µs -2.57%
BatchSpanProcessor/with 2 concurrent task 557.3±13.94µs 565.6±13.01µs +1.49%
BatchSpanProcessor/with 32 concurrent task 1506.1±13.53µs 1505.8±24.52µs -0.02%
BatchSpanProcessor/with 4 concurrent task 607.1±11.87µs 614.1±13.78µs +1.15%
BatchSpanProcessor/with 8 concurrent task 783.2±40.48µs 780.1±32.53µs -0.40%
Counter_Add_Sorted 178.8±10.26ns 178.5±5.80ns -0.17%
Counter_Add_Sorted_With_Non_Static_Values 265.4±11.08ns 260.2±10.94ns -1.96%
Counter_Add_Unsorted 183.5±7.34ns 184.4±8.97ns +0.49%
Counter_Overflow 584.8±15.17ns 570.2±19.24ns -2.50%
CreateOTelAnyValueInt 3.4±0.05ns 3.4±0.08ns 0.00%
CreateOTelAnyValueString 3.7±0.05ns 3.7±0.17ns 0.00%
CreateOTelKeyValue 5.6±0.03ns 5.6±0.05ns 0.00%
CreateOTelKey_Arc 14.4±0.36ns 14.5±1.05ns +0.69%
CreateOTelKey_Owned 14.4±0.34ns 14.0±0.46ns -2.78%
CreateOTelKey_Static 1.9±0.01ns 1.9±0.01ns 0.00%
CreateOTelValueInt 3.1±0.03ns 3.1±0.04ns 0.00%
CreateOTelValueString 3.7±0.08ns 3.7±0.07ns 0.00%
CreateOtelKeyValueArray 29.3±0.53ns 29.3±0.53ns 0.00%
CreateOtelKeyValueArrayWithMixedValueTypes 27.0±0.29ns 27.0±0.33ns 0.00%
CreateOtelKeyValueArrayWithNonStaticValues 96.0±2.63ns 100.9±3.41ns +5.10%
CreateTupleKeyValue 1.2±0.01ns 1.2±0.01ns 0.00%
CreateTupleKeyValueArray 5.0±0.06ns 5.0±0.04ns 0.00%
Gauge_Add 188.9±5.80ns 190.5±7.29ns +0.85%
Histogram_Record 208.3±9.01ns 208.1±11.05ns -0.10%
Histogram_Record_With_Non_Static_Values 282.1±8.99ns 294.7±8.87ns +4.47%
LogExporterWithFuture 92.3±2.63ns 92.3±2.14ns 0.00%
LogExporterWithoutFuture 87.2±1.17ns 87.5±2.13ns +0.34%
LoggerProvider_Creation 933.8±21.81ns 921.4±25.53ns -1.33%
Logger_Creation 13.0±0.32ns 13.0±0.27ns 0.00%
Logging_Comparable_To_Appender 89.4±1.70ns 89.3±1.95ns -0.11%
NoAttributes 1.6±0.03ns 1.6±0.04ns 0.00%
ThreadLocal_Random_Generator_5 11.6±0.85ns 10.5±0.81ns -9.48%
Tracer_With_Name/new_each_time 28.0±1.20ns 28.6±1.33ns +2.14%
Tracer_With_Name/reuse_existing 0.4±0.01ns 0.4±0.01ns 0.00%
Tracer_With_Name_And_Scope_Attrs/new_each_time 67.7±1.04ns 67.8±1.67ns +0.15%
Tracer_With_Name_And_Scope_Attrs/reuse_existing 0.6±0.02ns 0.6±0.03ns 0.00%
context/has_active_span/in-cx/alt 8.7±0.07ns 8.7±0.02ns 0.00%
context/has_active_span/in-cx/spec 5.0±0.26ns 5.0±0.19ns 0.00%
context/has_active_span/no-cx/alt 8.7±0.07ns 8.7±0.03ns 0.00%
context/has_active_span/no-cx/spec 5.0±0.37ns 5.0±0.16ns 0.00%
context/has_active_span/no-sdk/alt 8.7±0.05ns 8.7±0.02ns 0.00%
context/has_active_span/no-sdk/spec 5.0±0.15ns 5.0±0.16ns 0.00%
context/is_recording/in-cx/alt 4.7±0.24ns 4.7±0.19ns 0.00%
context/is_recording/in-cx/spec 7.5±0.33ns 7.5±0.34ns 0.00%
context/is_recording/no-cx/alt 4.7±0.23ns 4.7±0.24ns 0.00%
context/is_recording/no-cx/spec 7.6±0.42ns 7.5±0.24ns -1.32%
context/is_recording/no-sdk/alt 4.7±0.23ns 4.7±0.21ns 0.00%
context/is_recording/no-sdk/spec 7.5±0.31ns 7.5±0.25ns 0.00%
context/is_sampled/in-cx/alt 9.0±0.03ns 9.0±0.03ns 0.00%
context/is_sampled/in-cx/spec 5.4±0.20ns 5.3±0.16ns -1.85%
context/is_sampled/no-cx/alt 9.0±0.06ns 9.0±0.03ns 0.00%
context/is_sampled/no-cx/spec 5.3±0.37ns 5.3±0.19ns 0.00%
context/is_sampled/no-sdk/alt 9.0±0.05ns 9.0±0.08ns 0.00%
context/is_sampled/no-sdk/spec 5.3±0.19ns 5.3±0.17ns 0.00%
context_attach/nested_cx/empty_cx 46.9±0.69ns 46.8±0.81ns -0.21%
context_attach/nested_cx/single_value_cx 47.5±0.58ns 47.5±1.02ns 0.00%
context_attach/nested_cx/span_cx 47.6±0.59ns 47.6±0.67ns 0.00%
context_attach/out_of_order_cx_drop/empty_cx 40.7±0.63ns 40.6±1.16ns -0.25%
context_attach/out_of_order_cx_drop/single_value_cx 41.5±1.61ns 41.5±1.35ns 0.00%
context_attach/out_of_order_cx_drop/span_cx 41.6±0.70ns 41.7±1.38ns +0.24%
context_attach/single_cx/empty_cx 24.3±0.72ns 24.2±0.41ns -0.41%
context_attach/single_cx/single_value_cx 23.7±0.45ns 23.8±0.69ns +0.42%
context_attach/single_cx/span_cx 23.9±0.97ns 23.9±0.73ns 0.00%
exporter_disabled_concurrent_processor 3.7±0.10ns 3.8±0.16ns +2.70%
exporter_disabled_simple_processor 11.0±1.07ns 10.7±1.04ns -2.73%
full-log-with-4-attributes/no-context 76.3±1.69ns 76.2±1.77ns -0.13%
full-log-with-4-attributes/with-context 76.5±1.92ns 76.5±1.08ns 0.00%
full-log-with-9-attributes/no-context 138.8±3.31ns 138.4±2.90ns -0.29%
full-log-with-9-attributes/with-context 139.8±3.11ns 139.6±3.82ns -0.14%
full-log-with-attributes/no-context 243.2±5.33ns 242.4±5.65ns -0.33%
full-log-with-attributes/with-context 240.8±5.49ns 241.2±5.55ns +0.17%
full-log/no-context 27.1±0.82ns 27.2±0.96ns +0.37%
full-log/with-context 30.3±0.47ns 30.3±0.55ns 0.00%
log_clone_and_send_to_channel_processor 472.7±11.06ns 473.4±10.60ns +0.15%
log_cloning_processor 175.2±4.55ns 174.9±4.25ns -0.17%
log_no_subscriber 0.3±0.03ns 0.3±0.02ns 0.00%
log_noop_processor 86.8±2.05ns 86.9±1.31ns +0.12%
long-log/no-context 51.6±0.99ns 51.6±0.82ns 0.00%
long-log/with-context 52.2±0.93ns 52.1±0.74ns -0.19%
noop_layer_disabled 11.3±0.33ns 11.4±0.57ns +0.88%
noop_layer_enabled 22.2±1.03ns 22.1±1.10ns -0.45%
ot_layer_disabled 17.3±1.05ns 17.3±0.92ns 0.00%
ot_layer_enabled 146.8±6.18ns 148.3±5.21ns +1.02%
otel_2_attributes 145.0±6.30ns 146.3±7.68ns +0.90%
set_baggage_dynamic 71.3±2.41ns 71.3±1.56ns 0.00%
set_baggage_dynamic_with_metadata 101.6±2.87ns 102.7±6.11ns +1.08%
set_baggage_static_key 53.5±0.80ns 54.0±0.83ns +0.93%
set_baggage_static_key_value 30.6±1.17ns 30.7±0.74ns +0.33%
simple-log-with-a-lot-of-bytes/no-context 90.0±2.69ns 89.9±3.04ns -0.11%
simple-log-with-a-lot-of-bytes/with-context 91.3±2.69ns 92.4±3.30ns +1.20%
simple-log-with-bool/no-context 66.2±0.68ns 66.2±1.33ns 0.00%
simple-log-with-bool/with-context 67.2±0.97ns 67.2±1.12ns 0.00%
simple-log-with-bytes/no-context 89.3±2.58ns 89.3±2.23ns 0.00%
simple-log-with-bytes/with-context 90.0±2.04ns 89.7±3.45ns -0.33%
simple-log-with-double/no-context 64.6±1.10ns 64.7±0.86ns +0.15%
simple-log-with-double/with-context 65.9±1.25ns 66.0±1.15ns +0.15%
simple-log-with-inner-map-any-value/no-context 220.9±6.08ns 224.5±7.72ns +1.63%
simple-log-with-inner-map-any-value/with-context 219.7±4.73ns 224.6±7.10ns +2.23%
simple-log-with-inner-vec-any-value/no-context 184.6±4.53ns 184.9±7.47ns +0.16%
simple-log-with-inner-vec-any-value/with-context 184.8±4.76ns 184.6±6.63ns -0.11%
simple-log-with-int/no-context 64.4±1.00ns 64.4±0.88ns 0.00%
simple-log-with-int/with-context 65.9±1.07ns 66.0±1.16ns +0.15%
simple-log-with-map-any-value/no-context 137.4±4.12ns 137.1±3.06ns -0.22%
simple-log-with-map-any-value/with-context 140.1±3.32ns 141.2±4.16ns +0.79%
simple-log-with-string/no-context 63.7±0.96ns 63.8±1.25ns +0.16%
simple-log-with-string/with-context 64.9±1.13ns 65.3±2.27ns +0.62%
simple-log-with-vec-any-value/no-context 124.2±3.26ns 125.0±3.23ns +0.64%
simple-log-with-vec-any-value/with-context 124.0±2.26ns 125.4±3.39ns +1.13%
simple-log/no-context 51.7±1.33ns 51.7±0.96ns 0.00%
simple-log/with-context 52.1±0.88ns 52.1±0.99ns 0.00%
span_builder/simplest 142.2±1.60ns 138.4±3.19ns -2.67%
span_builder/with_attributes/1 178.0±3.07ns 158.9±6.33ns -10.73%
span_builder/with_attributes/4 186.7±4.92ns 185.1±7.96ns -0.86%
start-end-span-4-attrs/always-sample 307.4±9.03ns 300.5±8.10ns -2.24%
start-end-span-4-attrs/never-sample 161.8±7.21ns 161.1±2.77ns -0.43%
start-end-span-8-attrs/always-sample 418.2±10.01ns 411.6±14.62ns -1.58%
start-end-span-8-attrs/never-sample 201.4±3.01ns 201.6±2.90ns +0.10%
start-end-span-all-attr-types-2x/always-sample 434.6±16.37ns 429.7±10.62ns -1.13%
start-end-span-all-attr-types-2x/never-sample 223.0±3.79ns 223.2±3.09ns +0.09%
start-end-span-all-attr-types/always-sample 320.5±7.00ns 314.1±10.58ns -2.00%
start-end-span-all-attr-types/never-sample 171.2±3.42ns 171.1±1.87ns -0.06%
start-end-span/always-sample 243.7±4.89ns 243.0±6.81ns -0.29%
start-end-span/never-sample 123.7±3.03ns 124.4±3.59ns +0.57%
telemetry_suppression/enter_telemetry_suppressed_scope 27.4±0.32ns 27.4±0.56ns 0.00%
telemetry_suppression/is_current_telemetry_suppressed_false 1.4±0.07ns 1.4±0.04ns 0.00%
telemetry_suppression/is_current_telemetry_suppressed_true 1.4±0.04ns 1.4±0.05ns 0.00%
telemetry_suppression/normal_attach 30.7±0.53ns 30.7±0.56ns 0.00%

@scottgerring scottgerring requested a review from cijothomas June 20, 2025 14:04
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
fetch-depth: 10 # Fetch current commit and its parent
fetch-depth: 10 # Fetch a bit of history so we can do perf diffs
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the perf diff is against main ? or with the previous commit in the PR?

@cijothomas cijothomas merged commit 0c2f808 into main Jun 20, 2025
28 checks passed
@cijothomas cijothomas deleted the dependabot/scottgerring/benchmark-fix branch June 20, 2025 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants