-
Notifications
You must be signed in to change notification settings - Fork 463
ci: update system-tests version (3.14) #14977
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: 3.14
Are you sure you want to change the base?
Conversation
|
Bootstrap import analysisComparison of import times between this PR and base. SummaryThe average import time from this PR is: 277 ± 6 ms. The average import time from base is: 281 ± 5 ms. The import time difference between this PR and base is: -3.6 ± 0.3 ms. Import time breakdownThe following import paths have shrunk:
|
BenchmarksBenchmark execution time: 2025-10-21 18:54:45 Comparing candidate commit 9cc57da in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 565 metrics, 9 unstable metrics. |
Performance SLOsComparing candidate brettlangdon/update.system.tests.3.14 (1eaa64a) with baseline 3.14 (007c699) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 0.332µs (SLO: <10.000µs 📉 -96.7%) vs baseline: +0.4% Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.6% ✅ add_inplace_aspectTime: ✅ 0.335µs (SLO: <10.000µs 📉 -96.6%) vs baseline: +1.7% Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.1% ✅ add_inplace_noaspectTime: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: ~same Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.9% ✅ add_noaspectTime: ✅ 0.276µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -0.6% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0% ✅ bytearray_aspectTime: ✅ 1.326µs (SLO: <10.000µs 📉 -86.7%) vs baseline: +0.2% Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.1% ✅ bytearray_extend_aspectTime: ✅ 1.418µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.6% Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.0% ✅ bytearray_extend_noaspectTime: ✅ 0.609µs (SLO: <10.000µs 📉 -93.9%) vs baseline: -0.4% Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9% ✅ bytearray_noaspectTime: ✅ 0.482µs (SLO: <10.000µs 📉 -95.2%) vs baseline: ~same Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.9% ✅ bytes_aspectTime: ✅ 1.502µs (SLO: <10.000µs 📉 -85.0%) vs baseline: 📈 +15.5% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0% ✅ bytes_noaspectTime: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.1% Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.8% ✅ bytesio_aspectTime: ✅ 1.322µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.4% Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.6% ✅ bytesio_noaspectTime: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -1.4% Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.7% ✅ capitalize_aspectTime: ✅ 0.733µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.7% Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.1% ✅ capitalize_noaspectTime: ✅ 0.434µs (SLO: <10.000µs 📉 -95.7%) vs baseline: +0.2% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7% ✅ casefold_aspectTime: ✅ 0.741µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.3% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7% ✅ casefold_noaspectTime: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.2% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.8% ✅ decode_aspectTime: ✅ 0.727µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +1.2% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.8% ✅ decode_noaspectTime: ✅ 0.420µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +1.2% Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.2% ✅ encode_aspectTime: ✅ 0.703µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.8% Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.9% ✅ encode_noaspectTime: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.8% Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.0% ✅ format_aspectTime: ✅ 3.303µs (SLO: <10.000µs 📉 -67.0%) vs baseline: ~same Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8% ✅ format_map_aspectTime: ✅ 3.164µs (SLO: <10.000µs 📉 -68.4%) vs baseline: -0.6% Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.7% ✅ format_map_noaspectTime: ✅ 0.777µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +0.8% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.7% ✅ format_noaspectTime: ✅ 0.592µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -1.0% Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.7% ✅ index_aspectTime: ✅ 0.346µs (SLO: <10.000µs 📉 -96.5%) vs baseline: -0.5% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7% ✅ index_noaspectTime: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.2% Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.0% ✅ join_aspectTime: ✅ 1.233µs (SLO: <10.000µs 📉 -87.7%) vs baseline: +0.6% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.7% ✅ join_noaspectTime: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.6% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9% ✅ ljust_aspectTime: ✅ 10.444µs (SLO: <20.000µs 📉 -47.8%) vs baseline: +0.5% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9% ✅ ljust_noaspectTime: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.2% Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.9% ✅ lower_aspectTime: ✅ 2.229µs (SLO: <10.000µs 📉 -77.7%) vs baseline: -0.8% Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.9% ✅ lower_noaspectTime: ✅ 0.365µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -2.1% Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9% ✅ lstrip_aspectTime: ✅ 10.453µs (SLO: <20.000µs 📉 -47.7%) vs baseline: ~same Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6% ✅ lstrip_noaspectTime: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: ~same Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.5% ✅ modulo_aspectTime: ✅ 0.934µs (SLO: <10.000µs 📉 -90.7%) vs baseline: ~same Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 1.432µs (SLO: <10.000µs 📉 -85.7%) vs baseline: -0.7% Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.7% ✅ modulo_aspect_for_bytesTime: ✅ 0.914µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.5% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 1.132µs (SLO: <10.000µs 📉 -88.7%) vs baseline: +0.6% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0% ✅ modulo_noaspectTime: ✅ 0.627µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.2% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8% ✅ replace_aspectTime: ✅ 4.517µs (SLO: <10.000µs 📉 -54.8%) vs baseline: +0.4% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8% ✅ replace_noaspectTime: ✅ 0.460µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.2% Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.0% ✅ repr_aspectTime: ✅ 0.905µs (SLO: <10.000µs 📉 -91.0%) vs baseline: -0.1% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0% ✅ repr_noaspectTime: ✅ 0.419µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +2.4% Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.0% ✅ rstrip_aspectTime: ✅ 10.360µs (SLO: <20.000µs 📉 -48.2%) vs baseline: +0.2% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9% ✅ rstrip_noaspectTime: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +2.0% Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.0% ✅ slice_aspectTime: ✅ 0.485µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.6% Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.7% ✅ slice_noaspectTime: ✅ 0.445µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.2% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0% ✅ stringio_aspectTime: ✅ 1.523µs (SLO: <10.000µs 📉 -84.8%) vs baseline: -1.0% Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.2% ✅ stringio_noaspectTime: ✅ 0.716µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.8% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0% ✅ strip_aspectTime: ✅ 10.494µs (SLO: <20.000µs 📉 -47.5%) vs baseline: +0.5% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ strip_noaspectTime: ✅ 0.379µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.9% Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.9% ✅ swapcase_aspectTime: ✅ 2.398µs (SLO: <10.000µs 📉 -76.0%) vs baseline: +0.2% Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +5.1% ✅ swapcase_noaspectTime: ✅ 0.532µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -0.9% Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.8% ✅ title_aspectTime: ✅ 2.325µs (SLO: <10.000µs 📉 -76.7%) vs baseline: -1.2% Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +5.2% ✅ title_noaspectTime: ✅ 0.501µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.3% Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.9% ✅ translate_aspectTime: ✅ 3.244µs (SLO: <10.000µs 📉 -67.6%) vs baseline: +0.3% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +5.0% ✅ translate_noaspectTime: ✅ 1.044µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.4% Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.7% ✅ upper_aspectTime: ✅ 2.246µs (SLO: <10.000µs 📉 -77.5%) vs baseline: -0.2% Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.9% ✅ upper_noaspectTime: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.4% Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.7% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 4.973µs (SLO: <10.000µs 📉 -50.3%) vs baseline: 📈 +19.2% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9% ✅ ospathbasename_noaspectTime: ✅ 1.078µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -0.2% Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.7% ✅ ospathjoin_aspectTime: ✅ 5.956µs (SLO: <10.000µs 📉 -40.4%) vs baseline: -0.4% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9% ✅ ospathjoin_noaspectTime: ✅ 2.286µs (SLO: <10.000µs 📉 -77.1%) vs baseline: -0.5% Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.7% ✅ ospathnormcase_aspectTime: ✅ 3.882µs (SLO: <10.000µs 📉 -61.2%) vs baseline: 📈 +14.0% Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.9% ✅ ospathnormcase_noaspectTime: ✅ 0.569µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.2% Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.8% ✅ ospathsplit_aspectTime: ✅ 4.757µs (SLO: <10.000µs 📉 -52.4%) vs baseline: -1.3% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.9% ✅ ospathsplit_noaspectTime: ✅ 1.591µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.7% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7% ✅ ospathsplitdrive_aspectTime: ✅ 3.597µs (SLO: <10.000µs 📉 -64.0%) vs baseline: -0.6% Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8% ✅ ospathsplitdrive_noaspectTime: ✅ 0.701µs (SLO: <10.000µs 📉 -93.0%) vs baseline: ~same Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.7% ✅ ospathsplitext_aspectTime: ✅ 4.455µs (SLO: <10.000µs 📉 -55.4%) vs baseline: -0.6% Memory: ✅ 37.493MB (SLO: <39.000MB -3.9%) vs baseline: +4.9% ✅ ospathsplitext_noaspectTime: ✅ 1.385µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.5% Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.7% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.706µs (SLO: <20.000µs 📉 -81.5%) vs baseline: 📈 +14.9% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 1-count-metrics-100-timesTime: ✅ 230.856µs (SLO: <250.000µs -7.7%) vs baseline: +5.0% Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 1-distribution-metric-1-timesTime: ✅ 3.030µs (SLO: <20.000µs 📉 -84.9%) vs baseline: +1.3% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 1-distribution-metrics-100-timesTime: ✅ 198.566µs (SLO: <220.000µs -9.7%) vs baseline: +0.5% Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.8% ✅ 1-gauge-metric-1-timesTime: ✅ 2.509µs (SLO: <20.000µs 📉 -87.5%) vs baseline: 📈 +18.4% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 1-gauge-metrics-100-timesTime: ✅ 124.574µs (SLO: <150.000µs 📉 -17.0%) vs baseline: -0.7% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.8% ✅ 1-rate-metric-1-timesTime: ✅ 3.244µs (SLO: <20.000µs 📉 -83.8%) vs baseline: +0.9% Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.9% ✅ 1-rate-metrics-100-timesTime: ✅ 223.242µs (SLO: <250.000µs 📉 -10.7%) vs baseline: +1.0% Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 100-count-metrics-100-timesTime: ✅ 21.852ms (SLO: <23.500ms -7.0%) vs baseline: -1.4% Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +5.0% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.114ms (SLO: <2.250ms -6.1%) vs baseline: +2.3% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +3.6% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.280ms (SLO: <1.550ms 📉 -17.4%) vs baseline: -1.2% Memory: ✅ 31.536MB (SLO: <34.000MB -7.2%) vs baseline: +5.0% ✅ 100-rate-metrics-100-timesTime: ✅ 2.357ms (SLO: <2.550ms -7.6%) vs baseline: +4.4% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ flush-1-metricTime: ✅ 4.260µs (SLO: <20.000µs 📉 -78.7%) vs baseline: -0.6% Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.9% ✅ flush-100-metricsTime: ✅ 183.655µs (SLO: <250.000µs 📉 -26.5%) vs baseline: -0.4% Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +5.0% ✅ flush-1000-metricsTime: ✅ 2.233ms (SLO: <2.500ms 📉 -10.7%) vs baseline: -0.5% Memory: ✅ 32.657MB (SLO: <34.500MB -5.3%) vs baseline: +4.8% 🟡 Near SLO Breach (5 suites)🟡 djangosimple - 26/26✅ appsecTime: ✅ 20.542ms (SLO: <22.300ms -7.9%) vs baseline: -0.1% Memory: ✅ 64.310MB (SLO: <66.000MB -2.6%) vs baseline: +4.7% ✅ exception-replay-enabledTime: ✅ 1.362ms (SLO: <1.450ms -6.1%) vs baseline: ~same Memory: ✅ 63.336MB (SLO: <66.000MB -4.0%) vs baseline: +4.8% ✅ iastTime: ✅ 20.496ms (SLO: <22.250ms -7.9%) vs baseline: -0.2% Memory: ✅ 64.369MB (SLO: <66.000MB -2.5%) vs baseline: +4.9% ✅ profilerTime: ✅ 15.160ms (SLO: <16.550ms -8.4%) vs baseline: -0.4% Memory: ✅ 53.025MB (SLO: <53.500MB 🟡 -0.9%) vs baseline: +5.0% ✅ span-code-originTime: ✅ 26.107ms (SLO: <28.200ms -7.4%) vs baseline: -0.2% Memory: ✅ 66.389MB (SLO: <68.500MB -3.1%) vs baseline: +2.9% ✅ tracerTime: ✅ 20.528ms (SLO: <21.750ms -5.6%) vs baseline: +0.3% Memory: ✅ 64.271MB (SLO: <66.000MB -2.6%) vs baseline: +4.7% ✅ tracer-and-profilerTime: ✅ 22.103ms (SLO: <23.500ms -5.9%) vs baseline: -0.2% Memory: ✅ 65.695MB (SLO: <67.000MB 🟡 -1.9%) vs baseline: +4.9% ✅ tracer-dont-create-db-spansTime: ✅ 19.387ms (SLO: <21.500ms -9.8%) vs baseline: -0.2% Memory: ✅ 64.389MB (SLO: <66.000MB -2.4%) vs baseline: +4.7% ✅ tracer-nativeTime: ✅ 20.475ms (SLO: <21.750ms -5.9%) vs baseline: -0.3% Memory: ✅ 65.746MB (SLO: <66.000MB 🟡 -0.4%) vs baseline: +4.9% ✅ tracer-no-cachesTime: ✅ 18.540ms (SLO: <19.650ms -5.6%) vs baseline: ~same Memory: ✅ 64.389MB (SLO: <66.000MB -2.4%) vs baseline: +4.9% ✅ tracer-no-databasesTime: ✅ 18.892ms (SLO: <20.100ms -6.0%) vs baseline: ~same Memory: ✅ 64.212MB (SLO: <66.000MB -2.7%) vs baseline: +5.0% ✅ tracer-no-middlewareTime: ✅ 20.180ms (SLO: <21.500ms -6.1%) vs baseline: -0.1% Memory: ✅ 64.310MB (SLO: <66.000MB -2.6%) vs baseline: +4.8% ✅ tracer-no-templatesTime: ✅ 20.344ms (SLO: <22.000ms -7.5%) vs baseline: -0.2% Memory: ✅ 64.409MB (SLO: <66.000MB -2.4%) vs baseline: +5.0% 🟡 errortrackingdjangosimple - 6/6✅ errortracking-enabled-allTime: ✅ 18.080ms (SLO: <19.850ms -8.9%) vs baseline: -0.2% Memory: ✅ 64.289MB (SLO: <65.500MB 🟡 -1.8%) vs baseline: +4.8% ✅ errortracking-enabled-userTime: ✅ 18.076ms (SLO: <19.400ms -6.8%) vs baseline: -0.3% Memory: ✅ 64.217MB (SLO: <65.500MB 🟡 -2.0%) vs baseline: +4.8% ✅ tracer-enabledTime: ✅ 18.085ms (SLO: <19.450ms -7.0%) vs baseline: +0.4% Memory: ✅ 64.268MB (SLO: <65.500MB 🟡 -1.9%) vs baseline: +4.8% 🟡 flasksimple - 17/17✅ appsec-getTime: ✅ 4.572ms (SLO: <4.750ms -3.7%) vs baseline: -0.5% Memory: ✅ 60.889MB (SLO: <64.500MB -5.6%) vs baseline: +4.7% ✅ appsec-postTime: ✅ 6.591ms (SLO: <6.750ms -2.4%) vs baseline: -0.4% Memory: ✅ 61.007MB (SLO: <64.500MB -5.4%) vs baseline: +4.9% ✅ appsec-telemetryTime: ✅ 4.579ms (SLO: <4.750ms -3.6%) vs baseline: -0.2% Memory: ✅ 60.673MB (SLO: <64.500MB -5.9%) vs baseline: +4.4% ✅ debuggerTime: ✅ 1.859ms (SLO: <2.000ms -7.1%) vs baseline: -0.3% Memory: ✅ 44.787MB (SLO: <45.000MB 🟡 -0.5%) vs baseline: +4.8% ✅ iast-getTime: ✅ 1.854ms (SLO: <2.000ms -7.3%) vs baseline: ~same Memory: ✅ 41.701MB (SLO: <49.000MB 📉 -14.9%) vs baseline: +4.9% ✅ profilerTime: ✅ 1.911ms (SLO: <2.100ms -9.0%) vs baseline: -0.6% Memory: ✅ 44.433MB (SLO: <46.500MB -4.4%) vs baseline: +4.9% ✅ tracerTime: ✅ 3.364ms (SLO: <3.650ms -7.8%) vs baseline: -0.7% Memory: ✅ 51.393MB (SLO: <53.500MB -3.9%) vs baseline: +4.7% ✅ tracer-nativeTime: ✅ 3.368ms (SLO: <3.650ms -7.7%) vs baseline: -0.8% Memory: ✅ 52.730MB (SLO: <53.500MB 🟡 -1.4%) vs baseline: +5.1% 🟡 flasksqli - 6/6✅ appsec-enabledTime: ✅ 3.922ms (SLO: <4.200ms -6.6%) vs baseline: -1.0% Memory: ✅ 60.906MB (SLO: <66.000MB -7.7%) vs baseline: +4.9% ✅ iast-enabledTime: ✅ 2.512ms (SLO: <2.800ms 📉 -10.3%) vs baseline: -0.8% Memory: ✅ 58.076MB (SLO: <59.000MB 🟡 -1.6%) vs baseline: +4.8% ✅ tracer-enabledTime: ✅ 2.081ms (SLO: <2.250ms -7.5%) vs baseline: -0.5% Memory: ✅ 51.078MB (SLO: <53.500MB -4.5%) vs baseline: +4.8% 🟡 otelspan - 22/22✅ add-eventTime: ✅ 45.242ms (SLO: <47.150ms -4.0%) vs baseline: +0.1% Memory: ✅ 44.615MB (SLO: <46.500MB -4.1%) vs baseline: +4.9% ✅ add-metricsTime: ✅ 321.094ms (SLO: <344.800ms -6.9%) vs baseline: -0.1% Memory: ✅ 552.047MB (SLO: <562.000MB 🟡 -1.8%) vs baseline: +4.5% ✅ add-tagsTime: ✅ 293.420ms (SLO: <314.000ms -6.6%) vs baseline: +0.4% Memory: ✅ 553.452MB (SLO: <563.500MB 🟡 -1.8%) vs baseline: +4.6% ✅ get-contextTime: ✅ 82.437ms (SLO: <92.350ms 📉 -10.7%) vs baseline: -0.3% Memory: ✅ 39.725MB (SLO: <46.500MB 📉 -14.6%) vs baseline: +4.7% ✅ is-recordingTime: ✅ 43.085ms (SLO: <44.500ms -3.2%) vs baseline: -0.4% Memory: ✅ 44.110MB (SLO: <46.500MB -5.1%) vs baseline: +4.9% ✅ record-exceptionTime: ✅ 61.793ms (SLO: <67.650ms -8.7%) vs baseline: +0.4% Memory: ✅ 40.173MB (SLO: <46.500MB 📉 -13.6%) vs baseline: +4.8% ✅ set-statusTime: ✅ 49.138ms (SLO: <50.400ms -2.5%) vs baseline: +0.8% Memory: ✅ 44.030MB (SLO: <46.500MB -5.3%) vs baseline: +4.8% ✅ startTime: ✅ 42.467ms (SLO: <43.450ms -2.3%) vs baseline: +0.2% Memory: ✅ 44.086MB (SLO: <46.500MB -5.2%) vs baseline: +4.7% ✅ start-finishTime: ✅ 83.052ms (SLO: <88.000ms -5.6%) vs baseline: +0.4% Memory: ✅ 33.994MB (SLO: <46.500MB 📉 -26.9%) vs baseline: +4.7% ✅ start-finish-telemetryTime: ✅ 84.150ms (SLO: <89.000ms -5.4%) vs baseline: +0.3% Memory: ✅ 33.954MB (SLO: <46.500MB 📉 -27.0%) vs baseline: +4.9% ✅ update-nameTime: ✅ 44.398ms (SLO: <45.150ms 🟡 -1.7%) vs baseline: +0.5% Memory: ✅ 44.359MB (SLO: <46.500MB -4.6%) vs baseline: +4.9%
|
Description
Testing
Risks
Additional Notes