Skip to content

Conversation

brettlangdon
Copy link
Member

Description

Testing

Risks

Additional Notes

@brettlangdon brettlangdon added the changelog/no-changelog A changelog entry is not required for this PR. label Oct 21, 2025
Copy link
Contributor

CODEOWNERS have been resolved as:

.github/workflows/system-tests.yml                                      @DataDog/python-guild @DataDog/apm-core-python
.gitlab-ci.yml                                                          @DataDog/apm-core-python

Copy link
Contributor

github-actions bot commented Oct 21, 2025

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 277 ± 6 ms.

The average import time from base is: 281 ± 5 ms.

The import time difference between this PR and base is: -3.6 ± 0.3 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.171 ms (0.78%)
ddtrace.bootstrap.sitecustomize 1.488 ms (0.54%)
ddtrace.bootstrap.preload 1.488 ms (0.54%)
ddtrace.internal.remoteconfig.client 0.691 ms (0.25%)
ddtrace 0.684 ms (0.25%)
ddtrace.internal._unpatched 0.031 ms (0.01%)
json 0.031 ms (0.01%)
json.decoder 0.031 ms (0.01%)
re 0.031 ms (0.01%)
enum 0.031 ms (0.01%)
types 0.031 ms (0.01%)

@pr-commenter
Copy link

pr-commenter bot commented Oct 21, 2025

Benchmarks

Benchmark execution time: 2025-10-21 18:54:45

Comparing candidate commit 9cc57da in PR branch brettlangdon/update.system.tests.3.14 with baseline commit 007c699 in branch 3.14.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 565 metrics, 9 unstable metrics.

@pr-commenter
Copy link

pr-commenter bot commented Oct 21, 2025

Performance SLOs

Comparing candidate brettlangdon/update.system.tests.3.14 (1eaa64a) with baseline 3.14 (007c699)

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.332µs (SLO: <10.000µs 📉 -96.7%) vs baseline: +0.4%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.6%


✅ add_inplace_aspect

Time: ✅ 0.335µs (SLO: <10.000µs 📉 -96.6%) vs baseline: +1.7%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.1%


✅ add_inplace_noaspect

Time: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: ~same

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%


✅ add_noaspect

Time: ✅ 0.276µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -0.6%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%


✅ bytearray_aspect

Time: ✅ 1.326µs (SLO: <10.000µs 📉 -86.7%) vs baseline: +0.2%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.1%


✅ bytearray_extend_aspect

Time: ✅ 1.418µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.6%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.0%


✅ bytearray_extend_noaspect

Time: ✅ 0.609µs (SLO: <10.000µs 📉 -93.9%) vs baseline: -0.4%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%


✅ bytearray_noaspect

Time: ✅ 0.482µs (SLO: <10.000µs 📉 -95.2%) vs baseline: ~same

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.9%


✅ bytes_aspect

Time: ✅ 1.502µs (SLO: <10.000µs 📉 -85.0%) vs baseline: 📈 +15.5%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%


✅ bytes_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.1%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.8%


✅ bytesio_aspect

Time: ✅ 1.322µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.4%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.6%


✅ bytesio_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -1.4%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.7%


✅ capitalize_aspect

Time: ✅ 0.733µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.7%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.1%


✅ capitalize_noaspect

Time: ✅ 0.434µs (SLO: <10.000µs 📉 -95.7%) vs baseline: +0.2%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7%


✅ casefold_aspect

Time: ✅ 0.741µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.3%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7%


✅ casefold_noaspect

Time: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.2%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.8%


✅ decode_aspect

Time: ✅ 0.727µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +1.2%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.8%


✅ decode_noaspect

Time: ✅ 0.420µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +1.2%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.2%


✅ encode_aspect

Time: ✅ 0.703µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.8%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.9%


✅ encode_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.8%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.0%


✅ format_aspect

Time: ✅ 3.303µs (SLO: <10.000µs 📉 -67.0%) vs baseline: ~same

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8%


✅ format_map_aspect

Time: ✅ 3.164µs (SLO: <10.000µs 📉 -68.4%) vs baseline: -0.6%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.7%


✅ format_map_noaspect

Time: ✅ 0.777µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +0.8%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.7%


✅ format_noaspect

Time: ✅ 0.592µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -1.0%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.7%


✅ index_aspect

Time: ✅ 0.346µs (SLO: <10.000µs 📉 -96.5%) vs baseline: -0.5%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7%


✅ index_noaspect

Time: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.2%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.0%


✅ join_aspect

Time: ✅ 1.233µs (SLO: <10.000µs 📉 -87.7%) vs baseline: +0.6%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.7%


✅ join_noaspect

Time: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.6%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ ljust_aspect

Time: ✅ 10.444µs (SLO: <20.000µs 📉 -47.8%) vs baseline: +0.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ ljust_noaspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.2%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.9%


✅ lower_aspect

Time: ✅ 2.229µs (SLO: <10.000µs 📉 -77.7%) vs baseline: -0.8%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%


✅ lower_noaspect

Time: ✅ 0.365µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -2.1%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%


✅ lstrip_aspect

Time: ✅ 10.453µs (SLO: <20.000µs 📉 -47.7%) vs baseline: ~same

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ lstrip_noaspect

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: ~same

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.5%


✅ modulo_aspect

Time: ✅ 0.934µs (SLO: <10.000µs 📉 -90.7%) vs baseline: ~same

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.432µs (SLO: <10.000µs 📉 -85.7%) vs baseline: -0.7%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.7%


✅ modulo_aspect_for_bytes

Time: ✅ 0.914µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.5%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.132µs (SLO: <10.000µs 📉 -88.7%) vs baseline: +0.6%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%


✅ modulo_noaspect

Time: ✅ 0.627µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.2%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8%


✅ replace_aspect

Time: ✅ 4.517µs (SLO: <10.000µs 📉 -54.8%) vs baseline: +0.4%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8%


✅ replace_noaspect

Time: ✅ 0.460µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.0%


✅ repr_aspect

Time: ✅ 0.905µs (SLO: <10.000µs 📉 -91.0%) vs baseline: -0.1%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%


✅ repr_noaspect

Time: ✅ 0.419µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +2.4%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.0%


✅ rstrip_aspect

Time: ✅ 10.360µs (SLO: <20.000µs 📉 -48.2%) vs baseline: +0.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ rstrip_noaspect

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +2.0%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.0%


✅ slice_aspect

Time: ✅ 0.485µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.6%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.7%


✅ slice_noaspect

Time: ✅ 0.445µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.2%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%


✅ stringio_aspect

Time: ✅ 1.523µs (SLO: <10.000µs 📉 -84.8%) vs baseline: -1.0%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.2%


✅ stringio_noaspect

Time: ✅ 0.716µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.8%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%


✅ strip_aspect

Time: ✅ 10.494µs (SLO: <20.000µs 📉 -47.5%) vs baseline: +0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ strip_noaspect

Time: ✅ 0.379µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.9%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%


✅ swapcase_aspect

Time: ✅ 2.398µs (SLO: <10.000µs 📉 -76.0%) vs baseline: +0.2%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.1%


✅ swapcase_noaspect

Time: ✅ 0.532µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -0.9%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.8%


✅ title_aspect

Time: ✅ 2.325µs (SLO: <10.000µs 📉 -76.7%) vs baseline: -1.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.2%


✅ title_noaspect

Time: ✅ 0.501µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.3%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.9%


✅ translate_aspect

Time: ✅ 3.244µs (SLO: <10.000µs 📉 -67.6%) vs baseline: +0.3%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%


✅ translate_noaspect

Time: ✅ 1.044µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.4%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.7%


✅ upper_aspect

Time: ✅ 2.246µs (SLO: <10.000µs 📉 -77.5%) vs baseline: -0.2%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%


✅ upper_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.4%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.7%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.973µs (SLO: <10.000µs 📉 -50.3%) vs baseline: 📈 +19.2%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ ospathbasename_noaspect

Time: ✅ 1.078µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -0.2%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.7%


✅ ospathjoin_aspect

Time: ✅ 5.956µs (SLO: <10.000µs 📉 -40.4%) vs baseline: -0.4%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ ospathjoin_noaspect

Time: ✅ 2.286µs (SLO: <10.000µs 📉 -77.1%) vs baseline: -0.5%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.7%


✅ ospathnormcase_aspect

Time: ✅ 3.882µs (SLO: <10.000µs 📉 -61.2%) vs baseline: 📈 +14.0%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.9%


✅ ospathnormcase_noaspect

Time: ✅ 0.569µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.2%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.8%


✅ ospathsplit_aspect

Time: ✅ 4.757µs (SLO: <10.000µs 📉 -52.4%) vs baseline: -1.3%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ ospathsplit_noaspect

Time: ✅ 1.591µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.7%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7%


✅ ospathsplitdrive_aspect

Time: ✅ 3.597µs (SLO: <10.000µs 📉 -64.0%) vs baseline: -0.6%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.701µs (SLO: <10.000µs 📉 -93.0%) vs baseline: ~same

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7%


✅ ospathsplitext_aspect

Time: ✅ 4.455µs (SLO: <10.000µs 📉 -55.4%) vs baseline: -0.6%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ ospathsplitext_noaspect

Time: ✅ 1.385µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.5%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.7%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.706µs (SLO: <20.000µs 📉 -81.5%) vs baseline: 📈 +14.9%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%


✅ 1-count-metrics-100-times

Time: ✅ 230.856µs (SLO: <250.000µs -7.7%) vs baseline: +5.0%

Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%


✅ 1-distribution-metric-1-times

Time: ✅ 3.030µs (SLO: <20.000µs 📉 -84.9%) vs baseline: +1.3%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%


✅ 1-distribution-metrics-100-times

Time: ✅ 198.566µs (SLO: <220.000µs -9.7%) vs baseline: +0.5%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.8%


✅ 1-gauge-metric-1-times

Time: ✅ 2.509µs (SLO: <20.000µs 📉 -87.5%) vs baseline: 📈 +18.4%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%


✅ 1-gauge-metrics-100-times

Time: ✅ 124.574µs (SLO: <150.000µs 📉 -17.0%) vs baseline: -0.7%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.8%


✅ 1-rate-metric-1-times

Time: ✅ 3.244µs (SLO: <20.000µs 📉 -83.8%) vs baseline: +0.9%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.9%


✅ 1-rate-metrics-100-times

Time: ✅ 223.242µs (SLO: <250.000µs 📉 -10.7%) vs baseline: +1.0%

Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%


✅ 100-count-metrics-100-times

Time: ✅ 21.852ms (SLO: <23.500ms -7.0%) vs baseline: -1.4%

Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +5.0%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.114ms (SLO: <2.250ms -6.1%) vs baseline: +2.3%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +3.6%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.280ms (SLO: <1.550ms 📉 -17.4%) vs baseline: -1.2%

Memory: ✅ 31.536MB (SLO: <34.000MB -7.2%) vs baseline: +5.0%


✅ 100-rate-metrics-100-times

Time: ✅ 2.357ms (SLO: <2.550ms -7.6%) vs baseline: +4.4%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%


✅ flush-1-metric

Time: ✅ 4.260µs (SLO: <20.000µs 📉 -78.7%) vs baseline: -0.6%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.9%


✅ flush-100-metrics

Time: ✅ 183.655µs (SLO: <250.000µs 📉 -26.5%) vs baseline: -0.4%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +5.0%


✅ flush-1000-metrics

Time: ✅ 2.233ms (SLO: <2.500ms 📉 -10.7%) vs baseline: -0.5%

Memory: ✅ 32.657MB (SLO: <34.500MB -5.3%) vs baseline: +4.8%

🟡 Near SLO Breach (5 suites)
🟡 djangosimple - 26/26

✅ appsec

Time: ✅ 20.542ms (SLO: <22.300ms -7.9%) vs baseline: -0.1%

Memory: ✅ 64.310MB (SLO: <66.000MB -2.6%) vs baseline: +4.7%


✅ exception-replay-enabled

Time: ✅ 1.362ms (SLO: <1.450ms -6.1%) vs baseline: ~same

Memory: ✅ 63.336MB (SLO: <66.000MB -4.0%) vs baseline: +4.8%


✅ iast

Time: ✅ 20.496ms (SLO: <22.250ms -7.9%) vs baseline: -0.2%

Memory: ✅ 64.369MB (SLO: <66.000MB -2.5%) vs baseline: +4.9%


✅ profiler

Time: ✅ 15.160ms (SLO: <16.550ms -8.4%) vs baseline: -0.4%

Memory: ✅ 53.025MB (SLO: <53.500MB 🟡 -0.9%) vs baseline: +5.0%


✅ span-code-origin

Time: ✅ 26.107ms (SLO: <28.200ms -7.4%) vs baseline: -0.2%

Memory: ✅ 66.389MB (SLO: <68.500MB -3.1%) vs baseline: +2.9%


✅ tracer

Time: ✅ 20.528ms (SLO: <21.750ms -5.6%) vs baseline: +0.3%

Memory: ✅ 64.271MB (SLO: <66.000MB -2.6%) vs baseline: +4.7%


✅ tracer-and-profiler

Time: ✅ 22.103ms (SLO: <23.500ms -5.9%) vs baseline: -0.2%

Memory: ✅ 65.695MB (SLO: <67.000MB 🟡 -1.9%) vs baseline: +4.9%


✅ tracer-dont-create-db-spans

Time: ✅ 19.387ms (SLO: <21.500ms -9.8%) vs baseline: -0.2%

Memory: ✅ 64.389MB (SLO: <66.000MB -2.4%) vs baseline: +4.7%


✅ tracer-native

Time: ✅ 20.475ms (SLO: <21.750ms -5.9%) vs baseline: -0.3%

Memory: ✅ 65.746MB (SLO: <66.000MB 🟡 -0.4%) vs baseline: +4.9%


✅ tracer-no-caches

Time: ✅ 18.540ms (SLO: <19.650ms -5.6%) vs baseline: ~same

Memory: ✅ 64.389MB (SLO: <66.000MB -2.4%) vs baseline: +4.9%


✅ tracer-no-databases

Time: ✅ 18.892ms (SLO: <20.100ms -6.0%) vs baseline: ~same

Memory: ✅ 64.212MB (SLO: <66.000MB -2.7%) vs baseline: +5.0%


✅ tracer-no-middleware

Time: ✅ 20.180ms (SLO: <21.500ms -6.1%) vs baseline: -0.1%

Memory: ✅ 64.310MB (SLO: <66.000MB -2.6%) vs baseline: +4.8%


✅ tracer-no-templates

Time: ✅ 20.344ms (SLO: <22.000ms -7.5%) vs baseline: -0.2%

Memory: ✅ 64.409MB (SLO: <66.000MB -2.4%) vs baseline: +5.0%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.080ms (SLO: <19.850ms -8.9%) vs baseline: -0.2%

Memory: ✅ 64.289MB (SLO: <65.500MB 🟡 -1.8%) vs baseline: +4.8%


✅ errortracking-enabled-user

Time: ✅ 18.076ms (SLO: <19.400ms -6.8%) vs baseline: -0.3%

Memory: ✅ 64.217MB (SLO: <65.500MB 🟡 -2.0%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 18.085ms (SLO: <19.450ms -7.0%) vs baseline: +0.4%

Memory: ✅ 64.268MB (SLO: <65.500MB 🟡 -1.9%) vs baseline: +4.8%


🟡 flasksimple - 17/17

✅ appsec-get

Time: ✅ 4.572ms (SLO: <4.750ms -3.7%) vs baseline: -0.5%

Memory: ✅ 60.889MB (SLO: <64.500MB -5.6%) vs baseline: +4.7%


✅ appsec-post

Time: ✅ 6.591ms (SLO: <6.750ms -2.4%) vs baseline: -0.4%

Memory: ✅ 61.007MB (SLO: <64.500MB -5.4%) vs baseline: +4.9%


✅ appsec-telemetry

Time: ✅ 4.579ms (SLO: <4.750ms -3.6%) vs baseline: -0.2%

Memory: ✅ 60.673MB (SLO: <64.500MB -5.9%) vs baseline: +4.4%


✅ debugger

Time: ✅ 1.859ms (SLO: <2.000ms -7.1%) vs baseline: -0.3%

Memory: ✅ 44.787MB (SLO: <45.000MB 🟡 -0.5%) vs baseline: +4.8%


✅ iast-get

Time: ✅ 1.854ms (SLO: <2.000ms -7.3%) vs baseline: ~same

Memory: ✅ 41.701MB (SLO: <49.000MB 📉 -14.9%) vs baseline: +4.9%


✅ profiler

Time: ✅ 1.911ms (SLO: <2.100ms -9.0%) vs baseline: -0.6%

Memory: ✅ 44.433MB (SLO: <46.500MB -4.4%) vs baseline: +4.9%


✅ tracer

Time: ✅ 3.364ms (SLO: <3.650ms -7.8%) vs baseline: -0.7%

Memory: ✅ 51.393MB (SLO: <53.500MB -3.9%) vs baseline: +4.7%


✅ tracer-native

Time: ✅ 3.368ms (SLO: <3.650ms -7.7%) vs baseline: -0.8%

Memory: ✅ 52.730MB (SLO: <53.500MB 🟡 -1.4%) vs baseline: +5.1%


🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.922ms (SLO: <4.200ms -6.6%) vs baseline: -1.0%

Memory: ✅ 60.906MB (SLO: <66.000MB -7.7%) vs baseline: +4.9%


✅ iast-enabled

Time: ✅ 2.512ms (SLO: <2.800ms 📉 -10.3%) vs baseline: -0.8%

Memory: ✅ 58.076MB (SLO: <59.000MB 🟡 -1.6%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 2.081ms (SLO: <2.250ms -7.5%) vs baseline: -0.5%

Memory: ✅ 51.078MB (SLO: <53.500MB -4.5%) vs baseline: +4.8%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 45.242ms (SLO: <47.150ms -4.0%) vs baseline: +0.1%

Memory: ✅ 44.615MB (SLO: <46.500MB -4.1%) vs baseline: +4.9%


✅ add-metrics

Time: ✅ 321.094ms (SLO: <344.800ms -6.9%) vs baseline: -0.1%

Memory: ✅ 552.047MB (SLO: <562.000MB 🟡 -1.8%) vs baseline: +4.5%


✅ add-tags

Time: ✅ 293.420ms (SLO: <314.000ms -6.6%) vs baseline: +0.4%

Memory: ✅ 553.452MB (SLO: <563.500MB 🟡 -1.8%) vs baseline: +4.6%


✅ get-context

Time: ✅ 82.437ms (SLO: <92.350ms 📉 -10.7%) vs baseline: -0.3%

Memory: ✅ 39.725MB (SLO: <46.500MB 📉 -14.6%) vs baseline: +4.7%


✅ is-recording

Time: ✅ 43.085ms (SLO: <44.500ms -3.2%) vs baseline: -0.4%

Memory: ✅ 44.110MB (SLO: <46.500MB -5.1%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 61.793ms (SLO: <67.650ms -8.7%) vs baseline: +0.4%

Memory: ✅ 40.173MB (SLO: <46.500MB 📉 -13.6%) vs baseline: +4.8%


✅ set-status

Time: ✅ 49.138ms (SLO: <50.400ms -2.5%) vs baseline: +0.8%

Memory: ✅ 44.030MB (SLO: <46.500MB -5.3%) vs baseline: +4.8%


✅ start

Time: ✅ 42.467ms (SLO: <43.450ms -2.3%) vs baseline: +0.2%

Memory: ✅ 44.086MB (SLO: <46.500MB -5.2%) vs baseline: +4.7%


✅ start-finish

Time: ✅ 83.052ms (SLO: <88.000ms -5.6%) vs baseline: +0.4%

Memory: ✅ 33.994MB (SLO: <46.500MB 📉 -26.9%) vs baseline: +4.7%


✅ start-finish-telemetry

Time: ✅ 84.150ms (SLO: <89.000ms -5.4%) vs baseline: +0.3%

Memory: ✅ 33.954MB (SLO: <46.500MB 📉 -27.0%) vs baseline: +4.9%


✅ update-name

Time: ✅ 44.398ms (SLO: <45.150ms 🟡 -1.7%) vs baseline: +0.5%

Memory: ✅ 44.359MB (SLO: <46.500MB -4.6%) vs baseline: +4.9%

⚠️ Unstable Tests (1 suite)
⚠️ coreapiscenario - 12/12 (2 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.469µs (SLO: <20.000µs 📉 -32.7%) vs baseline: +0.4%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.9%


✅ context_with_data_no_listeners

Time: ✅ 3.397µs (SLO: <10.000µs 📉 -66.0%) vs baseline: -0.4%

Memory: ✅ 31.457MB (SLO: <33.500MB -6.1%) vs baseline: +4.8%


⚠️ context_with_data_only_all_listeners

Time: ⚠️ 13.416µs (SLO: <20.000µs 📉 -32.9%) vs baseline: ~same

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.9%


✅ get_item_exists

Time: ✅ 0.585µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.7%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.9%


✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: ~same

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%


✅ set_item

Time: ✅ 24.358µs (SLO: <30.000µs 📉 -18.8%) vs baseline: +0.4%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ All Tests Passing (15 suites)
errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.110ms (SLO: <2.300ms -8.2%) vs baseline: +1.2%

Memory: ✅ 51.248MB (SLO: <53.500MB -4.2%) vs baseline: +5.1%


✅ errortracking-enabled-user

Time: ✅ 2.091ms (SLO: <2.250ms -7.1%) vs baseline: +0.2%

Memory: ✅ 51.163MB (SLO: <53.500MB -4.4%) vs baseline: +5.0%


✅ tracer-enabled

Time: ✅ 2.093ms (SLO: <2.300ms -9.0%) vs baseline: -0.3%

Memory: ✅ 51.038MB (SLO: <53.500MB -4.6%) vs baseline: +4.8%


httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 80.992µs (SLO: <100.000µs 📉 -19.0%) vs baseline: -0.3%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.7%


✅ b3_headers

Time: ✅ 14.882µs (SLO: <20.000µs 📉 -25.6%) vs baseline: +4.0%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +4.8%


✅ b3_single_headers

Time: ✅ 14.273µs (SLO: <20.000µs 📉 -28.6%) vs baseline: +7.6%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.7%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.514µs (SLO: <80.000µs 📉 -20.6%) vs baseline: -0.1%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 65.959µs (SLO: <80.000µs 📉 -17.6%) vs baseline: -0.2%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.7%


✅ empty_headers

Time: ✅ 1.616µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.7%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.7%


✅ full_t_id_datadog_headers

Time: ✅ 24.240µs (SLO: <30.000µs 📉 -19.2%) vs baseline: +5.6%

Memory: ✅ 31.634MB (SLO: <33.500MB -5.6%) vs baseline: +5.0%


✅ invalid_priority_header

Time: ✅ 6.538µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.5%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +5.0%


✅ invalid_span_id_header

Time: ✅ 6.553µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.6%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +4.9%


✅ invalid_tags_header

Time: ✅ 6.621µs (SLO: <10.000µs 📉 -33.8%) vs baseline: +1.3%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +4.9%


✅ invalid_trace_id_header

Time: ✅ 6.490µs (SLO: <10.000µs 📉 -35.1%) vs baseline: ~same

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.5%


✅ large_header_no_matches

Time: ✅ 27.707µs (SLO: <30.000µs -7.6%) vs baseline: +0.5%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +5.0%


✅ large_valid_headers_all

Time: ✅ 28.772µs (SLO: <40.000µs 📉 -28.1%) vs baseline: +0.2%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +5.2%


✅ medium_header_no_matches

Time: ✅ 9.804µs (SLO: <20.000µs 📉 -51.0%) vs baseline: -0.1%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.7%


✅ medium_valid_headers_all

Time: ✅ 11.264µs (SLO: <20.000µs 📉 -43.7%) vs baseline: +0.9%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%


✅ none_propagation_style

Time: ✅ 1.695µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -0.4%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +4.9%


✅ tracecontext_headers

Time: ✅ 34.819µs (SLO: <40.000µs 📉 -13.0%) vs baseline: +1.2%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.7%


✅ valid_headers_all

Time: ✅ 6.552µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.7%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +4.8%


✅ valid_headers_basic

Time: ✅ 6.103µs (SLO: <10.000µs 📉 -39.0%) vs baseline: -0.3%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.8%


✅ wsgi_empty_headers

Time: ✅ 1.604µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%


✅ wsgi_invalid_priority_header

Time: ✅ 6.632µs (SLO: <10.000µs 📉 -33.7%) vs baseline: +0.7%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.615µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +1.2%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +4.7%


✅ wsgi_invalid_tags_header

Time: ✅ 6.609µs (SLO: <10.000µs 📉 -33.9%) vs baseline: +0.1%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.7%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.549µs (SLO: <10.000µs 📉 -34.5%) vs baseline: -0.3%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.7%


✅ wsgi_large_header_no_matches

Time: ✅ 28.739µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +0.2%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.798µs (SLO: <40.000µs 📉 -25.5%) vs baseline: ~same

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +4.9%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.106µs (SLO: <20.000µs 📉 -49.5%) vs baseline: ~same

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +4.9%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.494µs (SLO: <20.000µs 📉 -42.5%) vs baseline: +0.6%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.6%


✅ wsgi_valid_headers_all

Time: ✅ 6.559µs (SLO: <10.000µs 📉 -34.4%) vs baseline: ~same

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%


✅ wsgi_valid_headers_basic

Time: ✅ 6.114µs (SLO: <10.000µs 📉 -38.9%) vs baseline: +0.3%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +4.9%


httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.997µs (SLO: <30.000µs 📉 -26.7%) vs baseline: -0.4%

Memory: ✅ 31.595MB (SLO: <33.500MB -5.7%) vs baseline: +5.1%


✅ with_all

Time: ✅ 29.910µs (SLO: <40.000µs 📉 -25.2%) vs baseline: +1.8%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%


✅ with_dd_origin

Time: ✅ 25.924µs (SLO: <30.000µs 📉 -13.6%) vs baseline: +0.6%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.8%


✅ with_priority_and_origin

Time: ✅ 25.380µs (SLO: <40.000µs 📉 -36.6%) vs baseline: +0.6%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +5.0%


✅ with_sampling_priority

Time: ✅ 21.949µs (SLO: <30.000µs 📉 -26.8%) vs baseline: -0.5%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.6%


✅ with_tags

Time: ✅ 27.419µs (SLO: <40.000µs 📉 -31.5%) vs baseline: +0.4%

Memory: ✅ 31.575MB (SLO: <33.500MB -5.7%) vs baseline: +5.0%


✅ with_tags_invalid

Time: ✅ 29.882µs (SLO: <40.000µs 📉 -25.3%) vs baseline: +3.4%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%


✅ with_tags_max_size

Time: ✅ 28.108µs (SLO: <40.000µs 📉 -29.7%) vs baseline: +0.4%

Memory: ✅ 31.595MB (SLO: <33.500MB -5.7%) vs baseline: +5.1%


iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 31.580µs (SLO: <40.000µs 📉 -21.1%) vs baseline: -1.0%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.5%


✅ re_expand_noaspect

Time: ✅ 28.465µs (SLO: <40.000µs 📉 -28.8%) vs baseline: +0.1%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ re_findall_aspect

Time: ✅ 3.668µs (SLO: <10.000µs 📉 -63.3%) vs baseline: -0.3%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.9%


✅ re_findall_noaspect

Time: ✅ 1.405µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.4%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ re_finditer_aspect

Time: ✅ 4.420µs (SLO: <10.000µs 📉 -55.8%) vs baseline: -0.8%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ re_finditer_noaspect

Time: ✅ 1.403µs (SLO: <10.000µs 📉 -86.0%) vs baseline: ~same

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ re_fullmatch_aspect

Time: ✅ 2.699µs (SLO: <10.000µs 📉 -73.0%) vs baseline: -0.2%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.6%


✅ re_fullmatch_noaspect

Time: ✅ 1.289µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -1.3%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.0%


✅ re_group_aspect

Time: ✅ 2.936µs (SLO: <10.000µs 📉 -70.6%) vs baseline: -0.3%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%


✅ re_group_noaspect

Time: ✅ 1.596µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.2%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.9%


✅ re_groups_aspect

Time: ✅ 3.073µs (SLO: <10.000µs 📉 -69.3%) vs baseline: ~same

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.7%


✅ re_groups_noaspect

Time: ✅ 1.686µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -0.5%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.8%


✅ re_match_aspect

Time: ✅ 2.715µs (SLO: <10.000µs 📉 -72.8%) vs baseline: -0.7%

Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ re_match_noaspect

Time: ✅ 1.286µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -0.8%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.9%


✅ re_search_aspect

Time: ✅ 2.531µs (SLO: <10.000µs 📉 -74.7%) vs baseline: -0.4%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.6%


✅ re_search_noaspect

Time: ✅ 1.203µs (SLO: <10.000µs 📉 -88.0%) vs baseline: +0.3%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.2%


✅ re_sub_aspect

Time: ✅ 3.389µs (SLO: <10.000µs 📉 -66.1%) vs baseline: +0.2%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.0%


✅ re_sub_noaspect

Time: ✅ 1.528µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +0.9%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.7%


✅ re_subn_aspect

Time: ✅ 3.608µs (SLO: <10.000µs 📉 -63.9%) vs baseline: -0.4%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.8%


✅ re_subn_noaspect

Time: ✅ 1.599µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.5%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.9%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.379µs (SLO: <10.000µs 📉 -86.2%) vs baseline: ~same

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%


✅ rsplit_noaspect

Time: ✅ 0.577µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.9%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9%


✅ split_aspect

Time: ✅ 1.348µs (SLO: <10.000µs 📉 -86.5%) vs baseline: ~same

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +5.0%


✅ split_noaspect

Time: ✅ 0.567µs (SLO: <10.000µs 📉 -94.3%) vs baseline: ~same

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.1%


✅ splitlines_aspect

Time: ✅ 1.343µs (SLO: <10.000µs 📉 -86.6%) vs baseline: +0.4%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.1%


✅ splitlines_noaspect

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.6%


iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.130µs (SLO: <60.000µs 📉 -18.1%) vs baseline: +0.1%

Memory: ✅ 37.120MB (SLO: <39.000MB -4.8%) vs baseline: +4.9%


✅ propagation_enabled

Time: ✅ 145.865µs (SLO: <160.000µs -8.8%) vs baseline: ~same

Memory: ✅ 37.120MB (SLO: <39.000MB -4.8%) vs baseline: +4.9%


✅ propagation_enabled_100

Time: ✅ 1.594ms (SLO: <1.800ms 📉 -11.5%) vs baseline: +1.7%

Memory: ✅ 37.100MB (SLO: <39.000MB -4.9%) vs baseline: +4.7%


✅ propagation_enabled_1000

Time: ✅ 29.113ms (SLO: <30.550ms -4.7%) vs baseline: +0.6%

Memory: ✅ 37.080MB (SLO: <39.000MB -4.9%) vs baseline: +4.9%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.496ms (SLO: <42.000ms -3.6%) vs baseline: ~same

Memory: ✅ 34.190MB (SLO: <39.000MB 📉 -12.3%) vs baseline: +4.7%


✅ add-link

Time: ✅ 36.424ms (SLO: <38.550ms -5.5%) vs baseline: -0.2%

Memory: ✅ 34.269MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.9%


✅ add-metrics

Time: ✅ 219.782ms (SLO: <232.000ms -5.3%) vs baseline: +1.1%

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.8%


✅ add-tags

Time: ✅ 211.822ms (SLO: <221.600ms -4.4%) vs baseline: +0.7%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +5.1%


✅ get-context

Time: ✅ 29.125ms (SLO: <31.300ms -7.0%) vs baseline: ~same

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.9%


✅ is-recording

Time: ✅ 29.184ms (SLO: <31.000ms -5.9%) vs baseline: +0.2%

Memory: ✅ 34.249MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.7%


✅ record-exception

Time: ✅ 63.515ms (SLO: <65.850ms -3.5%) vs baseline: +0.5%

Memory: ✅ 34.190MB (SLO: <39.000MB 📉 -12.3%) vs baseline: +4.7%


✅ set-status

Time: ✅ 31.971ms (SLO: <34.150ms -6.4%) vs baseline: ~same

Memory: ✅ 34.210MB (SLO: <39.000MB 📉 -12.3%) vs baseline: +4.7%


✅ start

Time: ✅ 28.853ms (SLO: <30.150ms -4.3%) vs baseline: +0.2%

Memory: ✅ 34.210MB (SLO: <39.000MB 📉 -12.3%) vs baseline: +4.9%


✅ start-finish

Time: ✅ 34.456ms (SLO: <35.350ms -2.5%) vs baseline: +1.4%

Memory: ✅ 34.229MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.7%


✅ start-finish-telemetry

Time: ✅ 33.935ms (SLO: <35.450ms -4.3%) vs baseline: ~same

Memory: ✅ 34.249MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.7%


✅ update-name

Time: ✅ 31.038ms (SLO: <33.400ms -7.1%) vs baseline: -0.4%

Memory: ✅ 34.229MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.8%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 338.779ms (SLO: <354.300ms -4.4%) vs baseline: -0.9%

Memory: ✅ 37.121MB (SLO: <40.000MB -7.2%) vs baseline: +3.4%


✅ cache_on

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +1.1%

Memory: ✅ 37.235MB (SLO: <39.000MB -4.5%) vs baseline: +5.5%


packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.544µs (SLO: <170.000µs -8.5%) vs baseline: +0.3%

Memory: ✅ 36.109MB (SLO: <38.500MB -6.2%) vs baseline: +4.9%


✅ import_many_cached

Time: ✅ 121.450µs (SLO: <130.000µs -6.6%) vs baseline: +0.4%

Memory: ✅ 36.120MB (SLO: <38.500MB -6.2%) vs baseline: +4.6%


✅ import_many_stdlib

Time: ✅ 1.609ms (SLO: <1.750ms -8.1%) vs baseline: +0.2%

Memory: ✅ 36.325MB (SLO: <38.500MB -5.7%) vs baseline: +4.3%


✅ import_many_stdlib_cached

Time: ✅ 0.972ms (SLO: <1.100ms 📉 -11.6%) vs baseline: +1.1%

Memory: ✅ 36.589MB (SLO: <38.500MB -5.0%) vs baseline: +5.8%


✅ import_many_unknown

Time: ✅ 833.211µs (SLO: <890.000µs -6.4%) vs baseline: +0.5%

Memory: ✅ 36.265MB (SLO: <38.500MB -5.8%) vs baseline: +4.7%


✅ import_many_unknown_cached

Time: ✅ 794.010µs (SLO: <870.000µs -8.7%) vs baseline: ~same

Memory: ✅ 36.268MB (SLO: <38.500MB -5.8%) vs baseline: +4.7%


✅ import_one

Time: ✅ 19.666µs (SLO: <30.000µs 📉 -34.4%) vs baseline: -0.5%

Memory: ✅ 36.126MB (SLO: <39.000MB -7.4%) vs baseline: +4.8%


✅ import_one_cache

Time: ✅ 6.308µs (SLO: <10.000µs 📉 -36.9%) vs baseline: +0.1%

Memory: ✅ 36.109MB (SLO: <38.500MB -6.2%) vs baseline: +4.8%


✅ import_one_stdlib

Time: ✅ 18.641µs (SLO: <20.000µs -6.8%) vs baseline: -0.1%

Memory: ✅ 36.143MB (SLO: <38.500MB -6.1%) vs baseline: +4.9%


✅ import_one_stdlib_cache

Time: ✅ 6.333µs (SLO: <10.000µs 📉 -36.7%) vs baseline: +1.1%

Memory: ✅ 36.266MB (SLO: <38.500MB -5.8%) vs baseline: +5.3%


✅ import_one_unknown

Time: ✅ 45.735µs (SLO: <50.000µs -8.5%) vs baseline: +1.1%

Memory: ✅ 36.090MB (SLO: <38.500MB -6.3%) vs baseline: +4.7%


✅ import_one_unknown_cache

Time: ✅ 6.351µs (SLO: <10.000µs 📉 -36.5%) vs baseline: +1.1%

Memory: ✅ 36.312MB (SLO: <38.500MB -5.7%) vs baseline: +5.3%


ratelimiter - 12/12

✅ defaults

Time: ✅ 2.338µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.8%

Memory: ✅ 31.025MB (SLO: <34.000MB -8.8%) vs baseline: +4.9%


✅ high_rate_limit

Time: ✅ 2.387µs (SLO: <10.000µs 📉 -76.1%) vs baseline: -1.2%

Memory: ✅ 31.044MB (SLO: <34.000MB -8.7%) vs baseline: +5.0%


✅ long_window

Time: ✅ 2.341µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.3%

Memory: ✅ 31.025MB (SLO: <34.000MB -8.8%) vs baseline: +4.8%


✅ low_rate_limit

Time: ✅ 2.367µs (SLO: <10.000µs 📉 -76.3%) vs baseline: -0.3%

Memory: ✅ 30.985MB (SLO: <34.000MB -8.9%) vs baseline: +4.7%


✅ no_rate_limit

Time: ✅ 0.834µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +0.4%

Memory: ✅ 31.025MB (SLO: <34.000MB -8.8%) vs baseline: +4.9%


✅ short_window

Time: ✅ 2.495µs (SLO: <10.000µs 📉 -75.0%) vs baseline: +0.2%

Memory: ✅ 31.044MB (SLO: <34.000MB -8.7%) vs baseline: +5.1%


recursivecomputation - 8/8

✅ deep

Time: ✅ 309.415ms (SLO: <320.950ms -3.6%) vs baseline: +0.2%

Memory: ✅ 32.578MB (SLO: <34.500MB -5.6%) vs baseline: +4.8%


✅ deep-profiled

Time: ✅ 326.574ms (SLO: <359.150ms -9.1%) vs baseline: -0.6%

Memory: ✅ 35.271MB (SLO: <39.000MB -9.6%) vs baseline: +4.9%


✅ medium

Time: ✅ 7.066ms (SLO: <7.400ms -4.5%) vs baseline: +0.2%

Memory: ✅ 31.438MB (SLO: <34.000MB -7.5%) vs baseline: +4.7%


✅ shallow

Time: ✅ 0.952ms (SLO: <1.050ms -9.3%) vs baseline: ~same

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%


samplingrules - 8/8

✅ average_match

Time: ✅ 148.275µs (SLO: <290.000µs 📉 -48.9%) vs baseline: -0.3%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.8%


✅ high_match

Time: ✅ 195.542µs (SLO: <480.000µs 📉 -59.3%) vs baseline: +0.3%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%


✅ low_match

Time: ✅ 100.539µs (SLO: <120.000µs 📉 -16.2%) vs baseline: +1.1%

Memory: ✅ 632.045MB (SLO: <700.000MB -9.7%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.887ms (SLO: <8.500ms 📉 -66.0%) vs baseline: -0.3%

Memory: ✅ 69.776MB (SLO: <75.000MB -7.0%) vs baseline: +4.8%


sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.593µs (SLO: <20.000µs 📉 -47.0%) vs baseline: -0.5%

Memory: ✅ 32.342MB (SLO: <34.000MB -4.9%) vs baseline: +5.1%


✅ all-enabled

Time: ✅ 40.146µs (SLO: <50.000µs 📉 -19.7%) vs baseline: +0.3%

Memory: ✅ 32.342MB (SLO: <34.000MB -4.9%) vs baseline: +4.6%


✅ collectipvariant_exists

Time: ✅ 40.842µs (SLO: <50.000µs 📉 -18.3%) vs baseline: ~same

Memory: ✅ 32.283MB (SLO: <34.000MB -5.0%) vs baseline: +4.5%


✅ no-collectipvariant

Time: ✅ 40.030µs (SLO: <50.000µs 📉 -19.9%) vs baseline: -0.2%

Memory: ✅ 32.322MB (SLO: <34.000MB -4.9%) vs baseline: +4.7%


✅ no-useragentvariant

Time: ✅ 38.834µs (SLO: <50.000µs 📉 -22.3%) vs baseline: +0.1%

Memory: ✅ 32.303MB (SLO: <34.000MB -5.0%) vs baseline: +4.7%


✅ obfuscation-no-query

Time: ✅ 40.655µs (SLO: <50.000µs 📉 -18.7%) vs baseline: +0.1%

Memory: ✅ 32.401MB (SLO: <34.000MB -4.7%) vs baseline: +4.8%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 76.825µs (SLO: <90.000µs 📉 -14.6%) vs baseline: +1.3%

Memory: ✅ 32.342MB (SLO: <34.000MB -4.9%) vs baseline: +4.9%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.339µs (SLO: <90.000µs 📉 -15.2%) vs baseline: ~same

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.9%


✅ obfuscation-send-querystring-disabled

Time: ✅ 155.293µs (SLO: <170.000µs -8.7%) vs baseline: +0.8%

Memory: ✅ 32.362MB (SLO: <34.500MB -6.2%) vs baseline: +4.8%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.186µs (SLO: <160.000µs -7.4%) vs baseline: ~same

Memory: ✅ 32.401MB (SLO: <34.500MB -6.1%) vs baseline: +5.0%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.938µs (SLO: <170.000µs -8.9%) vs baseline: +0.4%

Memory: ✅ 32.303MB (SLO: <34.500MB -6.4%) vs baseline: +4.8%


✅ useragentvariant_exists_1

Time: ✅ 39.835µs (SLO: <50.000µs 📉 -20.3%) vs baseline: +0.7%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.9%


✅ useragentvariant_exists_2

Time: ✅ 40.553µs (SLO: <50.000µs 📉 -18.9%) vs baseline: +0.1%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +5.0%


✅ useragentvariant_exists_3

Time: ✅ 40.010µs (SLO: <50.000µs 📉 -20.0%) vs baseline: ~same

Memory: ✅ 32.322MB (SLO: <34.000MB -4.9%) vs baseline: +4.5%


✅ useragentvariant_not_exists_1

Time: ✅ 40.095µs (SLO: <50.000µs 📉 -19.8%) vs baseline: +1.5%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +5.0%


✅ useragentvariant_not_exists_2

Time: ✅ 39.620µs (SLO: <50.000µs 📉 -20.8%) vs baseline: +0.7%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.7%


span - 26/26

✅ add-event

Time: ✅ 24.169ms (SLO: <26.200ms -7.8%) vs baseline: -0.2%

Memory: ✅ 51.070MB (SLO: <53.000MB -3.6%) vs baseline: +4.7%


✅ add-metrics

Time: ✅ 91.202ms (SLO: <98.350ms -7.3%) vs baseline: -0.6%

Memory: ✅ 606.522MB (SLO: <961.000MB 📉 -36.9%) vs baseline: +4.9%


✅ add-tags

Time: ✅ 149.371ms (SLO: <168.550ms 📉 -11.4%) vs baseline: -0.5%

Memory: ✅ 608.162MB (SLO: <962.500MB 📉 -36.8%) vs baseline: +5.1%


✅ get-context

Time: ✅ 22.297ms (SLO: <23.700ms -5.9%) vs baseline: -0.6%

Memory: ✅ 49.960MB (SLO: <53.000MB -5.7%) vs baseline: +4.8%


✅ is-recording

Time: ✅ 22.571ms (SLO: <23.900ms -5.6%) vs baseline: -0.2%

Memory: ✅ 49.868MB (SLO: <53.000MB -5.9%) vs baseline: +4.7%


✅ record-exception

Time: ✅ 42.755ms (SLO: <44.500ms -3.9%) vs baseline: +0.8%

Memory: ✅ 42.802MB (SLO: <53.000MB 📉 -19.2%) vs baseline: +4.9%


✅ set-status

Time: ✅ 24.430ms (SLO: <26.000ms -6.0%) vs baseline: -0.1%

Memory: ✅ 50.017MB (SLO: <53.000MB -5.6%) vs baseline: +4.8%


✅ start

Time: ✅ 22.081ms (SLO: <23.500ms -6.0%) vs baseline: ~same

Memory: ✅ 49.911MB (SLO: <53.000MB -5.8%) vs baseline: +4.8%


✅ start-finish

Time: ✅ 51.663ms (SLO: <55.500ms -6.9%) vs baseline: ~same

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +4.9%


✅ start-finish-telemetry

Time: ✅ 52.921ms (SLO: <58.300ms -9.2%) vs baseline: ~same

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.8%


✅ start-finish-traceid128

Time: ✅ 54.965ms (SLO: <60.050ms -8.5%) vs baseline: ~same

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +5.0%


✅ start-traceid128

Time: ✅ 22.797ms (SLO: <24.600ms -7.3%) vs baseline: +0.9%

Memory: ✅ 49.954MB (SLO: <53.000MB -5.7%) vs baseline: +4.6%


✅ update-name

Time: ✅ 23.234ms (SLO: <24.100ms -3.6%) vs baseline: +0.2%

Memory: ✅ 50.601MB (SLO: <53.000MB -4.5%) vs baseline: +5.0%


tracer - 6/6

✅ large

Time: ✅ 30.910ms (SLO: <32.950ms -6.2%) vs baseline: +1.3%

Memory: ✅ 33.050MB (SLO: <34.500MB -4.2%) vs baseline: +4.7%


✅ medium

Time: ✅ 2.988ms (SLO: <3.200ms -6.6%) vs baseline: +0.7%

Memory: ✅ 31.438MB (SLO: <34.000MB -7.5%) vs baseline: +4.7%


✅ small

Time: ✅ 339.149µs (SLO: <370.000µs -8.3%) vs baseline: +0.5%

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +5.0%

ℹ️ Scenarios Missing SLO Configuration (14 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-context_with_data_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_only_all_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • coreapiscenario-core_dispatch_with_results_only_all_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant