Skip to content

Cache python class imports#7191

Merged
AdamGS merged 3 commits intodevelopfrom
adamg/cache-python-class-imports
Mar 27, 2026
Merged

Cache python class imports#7191
AdamGS merged 3 commits intodevelopfrom
adamg/cache-python-class-imports

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Mar 27, 2026

Summary

Was reading the arrow-rs changelog and I ran into this PR, seems like PyOnceLock was built for this and they have some very promising benchmarks there.

I've also wrapped all static strings that are passed into pyo3 with the intern macro, which prevents allocating a new PyString on every call.

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS requested review from blaginin and danking March 27, 2026 13:44
@AdamGS AdamGS added changelog/performance A performance improvement lang/python Relates to the Vortex Python API labels Mar 27, 2026
AdamGS added 2 commits March 27, 2026 14:01
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Copy link
Copy Markdown
Contributor

@danking danking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fantastic

@danking danking added the action/benchmark Trigger full benchmarks to run on this PR label Mar 27, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 27, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done edb409b 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.080x ➖


datafusion / vortex-file-compressed (1.080x ➖, 0↑ 3↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 132737957 126133907 1.05
polarsignals_q01/datafusion:vortex-file-compressed 391027315 376005589 1.04
polarsignals_q02/datafusion:vortex-file-compressed 25287095 23384155 1.08
polarsignals_q03/datafusion:vortex-file-compressed 401383052 380677028 1.05
polarsignals_q04/datafusion:vortex-file-compressed 12446553 11640150 1.07
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17394200 15789459 1.10
polarsignals_q06/datafusion:vortex-file-compressed 19897303 18808222 1.06
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15054061 13480025 1.12
polarsignals_q08/datafusion:vortex-file-compressed 481619079 456996837 1.05
polarsignals_q09/datafusion:vortex-file-compressed 🚨 11931725 10099321 1.18

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.1%
Vortex (geomean): 0.977x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.9%


datafusion / vortex-file-compressed (1.016x ➖, 4↑ 6↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 56007853 50332100 1.11
tpch_q02/datafusion:vortex-file-compressed 39503069 36300772 1.09
tpch_q03/datafusion:vortex-file-compressed 🚨 32806310 28403886 1.15
tpch_q04/datafusion:vortex-file-compressed 20661211 21248840 0.97
tpch_q05/datafusion:vortex-file-compressed 🚨 62730752 54561041 1.15
tpch_q06/datafusion:vortex-file-compressed 🚀 11150675 14294929 0.78
tpch_q07/datafusion:vortex-file-compressed 🚨 75415803 66244892 1.14
tpch_q08/datafusion:vortex-file-compressed 54108925 51305270 1.05
tpch_q09/datafusion:vortex-file-compressed 60917586 58161715 1.05
tpch_q10/datafusion:vortex-file-compressed 51165807 47920744 1.07
tpch_q11/datafusion:vortex-file-compressed 20066882 20602794 0.97
tpch_q12/datafusion:vortex-file-compressed 27507172 28493931 0.97
tpch_q13/datafusion:vortex-file-compressed 🚀 30673864 34968588 0.88
tpch_q14/datafusion:vortex-file-compressed 🚀 18523764 23541110 0.79
tpch_q15/datafusion:vortex-file-compressed 🚀 28717282 34354771 0.84
tpch_q16/datafusion:vortex-file-compressed 29256288 26922055 1.09
tpch_q17/datafusion:vortex-file-compressed 72647991 67672454 1.07
tpch_q18/datafusion:vortex-file-compressed 🚨 92233649 79765286 1.16
tpch_q19/datafusion:vortex-file-compressed 30169939 27881564 1.08
tpch_q20/datafusion:vortex-file-compressed 36491236 33374579 1.09
tpch_q21/datafusion:vortex-file-compressed 🚨 84089793 76428680 1.10
tpch_q22/datafusion:vortex-file-compressed 20087137 22010751 0.91
datafusion / vortex-compact (0.905x ➖, 10↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 61092953 79813137 0.77
tpch_q02/datafusion:vortex-compact 42133951 39867209 1.06
tpch_q03/datafusion:vortex-compact 🚀 35322550 44586111 0.79
tpch_q04/datafusion:vortex-compact 🚀 26134417 33195648 0.79
tpch_q05/datafusion:vortex-compact 🚀 63289702 84287818 0.75
tpch_q06/datafusion:vortex-compact 🚀 15649883 18026185 0.87
tpch_q07/datafusion:vortex-compact 🚀 78464822 104262322 0.75
tpch_q08/datafusion:vortex-compact 54703361 56656135 0.97
tpch_q09/datafusion:vortex-compact 🚀 68804959 93659114 0.73
tpch_q10/datafusion:vortex-compact 59530968 60870048 0.98
tpch_q11/datafusion:vortex-compact 🚀 22070002 29728300 0.74
tpch_q12/datafusion:vortex-compact 🚀 36280527 47642753 0.76
tpch_q13/datafusion:vortex-compact 39322191 37308014 1.05
tpch_q14/datafusion:vortex-compact 22353968 22362578 1.00
tpch_q15/datafusion:vortex-compact 36821789 36593226 1.01
tpch_q16/datafusion:vortex-compact 32883810 32959427 1.00
tpch_q17/datafusion:vortex-compact 76871556 75050158 1.02
tpch_q18/datafusion:vortex-compact 95749274 91975700 1.04
tpch_q19/datafusion:vortex-compact 42011537 40670743 1.03
tpch_q20/datafusion:vortex-compact 43353081 40723750 1.06
tpch_q21/datafusion:vortex-compact 🚨 101064720 90049030 1.12
tpch_q22/datafusion:vortex-compact 🚀 18787415 22773827 0.82
datafusion / parquet (1.033x ➖, 0↑ 3↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 99781479 99652123 1.00
tpch_q02/datafusion:parquet 🚨 79782002 72145811 1.11
tpch_q03/datafusion:parquet 🚨 82466604 71314794 1.16
tpch_q04/datafusion:parquet 51561576 51285375 1.01
tpch_q05/datafusion:parquet 113119291 104575523 1.08
tpch_q06/datafusion:parquet 37132536 37723793 0.98
tpch_q07/datafusion:parquet 123841245 119522028 1.04
tpch_q08/datafusion:parquet 113352354 107369876 1.06
tpch_q09/datafusion:parquet 149077179 140727270 1.06
tpch_q10/datafusion:parquet 132746126 131091403 1.01
tpch_q11/datafusion:parquet 51741460 55522051 0.93
tpch_q12/datafusion:parquet 88087704 96505283 0.91
tpch_q13/datafusion:parquet 241152661 222011925 1.09
tpch_q14/datafusion:parquet 53182462 53859288 0.99
tpch_q15/datafusion:parquet 68880003 68286749 1.01
tpch_q16/datafusion:parquet 57269621 54085763 1.06
tpch_q17/datafusion:parquet 🚨 164908767 138491097 1.19
tpch_q18/datafusion:parquet 186191123 175082234 1.06
tpch_q19/datafusion:parquet 85105497 92157889 0.92
tpch_q20/datafusion:parquet 84403983 79550385 1.06
tpch_q21/datafusion:parquet 161272498 155976153 1.03
tpch_q22/datafusion:parquet 38255952 37872789 1.01
datafusion / arrow (1.067x ➖, 1↑ 10↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 61247540 66047890 0.93
tpch_q02/datafusion:arrow 23594224 23840877 0.99
tpch_q03/datafusion:arrow 🚨 39776715 33823521 1.18
tpch_q04/datafusion:arrow 32090938 30736981 1.04
tpch_q05/datafusion:arrow 87577183 84453241 1.04
tpch_q06/datafusion:arrow 🚨 24005345 21342300 1.12
tpch_q07/datafusion:arrow 🚨 130596404 115617423 1.13
tpch_q08/datafusion:arrow 53103003 50418725 1.05
tpch_q09/datafusion:arrow 🚨 88210676 77478971 1.14
tpch_q10/datafusion:arrow 🚨 63124607 52974540 1.19
tpch_q11/datafusion:arrow 12747143 12238008 1.04
tpch_q12/datafusion:arrow 🚨 64554814 57806404 1.12
tpch_q13/datafusion:arrow 52763870 50994935 1.03
tpch_q14/datafusion:arrow 🚨 29464081 24792231 1.19
tpch_q15/datafusion:arrow 🚀 54522275 63825304 0.85
tpch_q16/datafusion:arrow 🚨 23797721 20996685 1.13
tpch_q17/datafusion:arrow 82288087 89350849 0.92
tpch_q18/datafusion:arrow 166526515 174347448 0.96
tpch_q19/datafusion:arrow 🚨 49717492 40065813 1.24
tpch_q20/datafusion:arrow 🚨 47926245 39042775 1.23
tpch_q21/datafusion:arrow 186544372 176986934 1.05
tpch_q22/datafusion:arrow 22062957 22059494 1.00
duckdb / vortex-file-compressed (0.980x ➖, 3↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 34172115 33257181 1.03
tpch_q02/duckdb:vortex-file-compressed 30028887 31102055 0.97
tpch_q03/duckdb:vortex-file-compressed 33463935 34876143 0.96
tpch_q04/duckdb:vortex-file-compressed 32104949 31275737 1.03
tpch_q05/duckdb:vortex-file-compressed 37490270 36693387 1.02
tpch_q06/duckdb:vortex-file-compressed 11630675 11829728 0.98
tpch_q07/duckdb:vortex-file-compressed 40575087 41180695 0.99
tpch_q08/duckdb:vortex-file-compressed 48366032 47017034 1.03
tpch_q09/duckdb:vortex-file-compressed 96462020 91456607 1.05
tpch_q10/duckdb:vortex-file-compressed 🚀 41981097 48206431 0.87
tpch_q11/duckdb:vortex-file-compressed 17639922 18127920 0.97
tpch_q12/duckdb:vortex-file-compressed 🚀 26302770 29487861 0.89
tpch_q13/duckdb:vortex-file-compressed 43762431 40741265 1.07
tpch_q14/duckdb:vortex-file-compressed 26446580 25102911 1.05
tpch_q15/duckdb:vortex-file-compressed 18254250 19247617 0.95
tpch_q16/duckdb:vortex-file-compressed 33869597 33933582 1.00
tpch_q17/duckdb:vortex-file-compressed 27999739 30754341 0.91
tpch_q18/duckdb:vortex-file-compressed 🚀 51026181 56958982 0.90
tpch_q19/duckdb:vortex-file-compressed 38407258 40273026 0.95
tpch_q20/duckdb:vortex-file-compressed 39009716 41211750 0.95
tpch_q21/duckdb:vortex-file-compressed 114474593 114142173 1.00
tpch_q22/duckdb:vortex-file-compressed 19973482 19633238 1.02
duckdb / vortex-compact (1.011x ➖, 0↑ 3↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40376778 41361264 0.98
tpch_q02/duckdb:vortex-compact 38243545 40350624 0.95
tpch_q03/duckdb:vortex-compact 36002209 34356452 1.05
tpch_q04/duckdb:vortex-compact 38573414 37761376 1.02
tpch_q05/duckdb:vortex-compact 42835526 44762451 0.96
tpch_q06/duckdb:vortex-compact 15811490 17524694 0.90
tpch_q07/duckdb:vortex-compact 47361490 46100363 1.03
tpch_q08/duckdb:vortex-compact 48223946 50526422 0.95
tpch_q09/duckdb:vortex-compact 100977049 104162226 0.97
tpch_q10/duckdb:vortex-compact 46978582 43801298 1.07
tpch_q11/duckdb:vortex-compact 23939082 22628475 1.06
tpch_q12/duckdb:vortex-compact 40431446 39666082 1.02
tpch_q13/duckdb:vortex-compact 51982834 49018573 1.06
tpch_q14/duckdb:vortex-compact 33342673 33557009 0.99
tpch_q15/duckdb:vortex-compact 🚨 22197840 20135602 1.10
tpch_q16/duckdb:vortex-compact 38289907 40793472 0.94
tpch_q17/duckdb:vortex-compact 33446871 34669451 0.96
tpch_q18/duckdb:vortex-compact 53884006 52633593 1.02
tpch_q19/duckdb:vortex-compact 45041514 42316176 1.06
tpch_q20/duckdb:vortex-compact 48412138 50593131 0.96
tpch_q21/duckdb:vortex-compact 🚨 136381254 123499648 1.10
tpch_q22/duckdb:vortex-compact 🚨 24450456 22107611 1.11
duckdb / parquet (0.976x ➖, 6↑ 2↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81926088 82626382 0.99
tpch_q02/duckdb:parquet 42111678 43188105 0.98
tpch_q03/duckdb:parquet 73380477 70723020 1.04
tpch_q04/duckdb:parquet 🚀 50396024 57645434 0.87
tpch_q05/duckdb:parquet 73171125 67570476 1.08
tpch_q06/duckdb:parquet 21562753 20539205 1.05
tpch_q07/duckdb:parquet 🚨 87616509 68889451 1.27
tpch_q08/duckdb:parquet 87787211 84047044 1.04
tpch_q09/duckdb:parquet 167780967 160790677 1.04
tpch_q10/duckdb:parquet 🚨 146084755 131073223 1.11
tpch_q11/duckdb:parquet 24129231 24397087 0.99
tpch_q12/duckdb:parquet 🚀 48030065 58799228 0.82
tpch_q13/duckdb:parquet 304161558 322831405 0.94
tpch_q14/duckdb:parquet 🚀 52700284 59907866 0.88
tpch_q15/duckdb:parquet 🚀 25484065 31438818 0.81
tpch_q16/duckdb:parquet 59317090 63829520 0.93
tpch_q17/duckdb:parquet 🚀 57831127 65239632 0.89
tpch_q18/duckdb:parquet 139226865 128314558 1.09
tpch_q19/duckdb:parquet 75926954 79339012 0.96
tpch_q20/duckdb:parquet 🚀 65849503 83014325 0.79
tpch_q21/duckdb:parquet 192245942 189894748 1.01
tpch_q22/duckdb:parquet 56043069 54759064 1.02
duckdb / duckdb (0.988x ➖, 5↑ 2↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16766786 16765041 1.00
tpch_q02/duckdb:duckdb 14101486 13290660 1.06
tpch_q03/duckdb:duckdb 21341702 21404036 1.00
tpch_q04/duckdb:duckdb 21364303 19431722 1.10
tpch_q05/duckdb:duckdb 20640158 21061285 0.98
tpch_q06/duckdb:duckdb 5642215 5759986 0.98
tpch_q07/duckdb:duckdb 24068143 22407476 1.07
tpch_q08/duckdb:duckdb 🚨 23623313 21261721 1.11
tpch_q09/duckdb:duckdb 64725314 64852921 1.00
tpch_q10/duckdb:duckdb 48858436 48999379 1.00
tpch_q11/duckdb:duckdb 🚨 6649266 6039311 1.10
tpch_q12/duckdb:duckdb 15271651 14377756 1.06
tpch_q13/duckdb:duckdb 40144479 38492563 1.04
tpch_q14/duckdb:duckdb 19307867 18747231 1.03
tpch_q15/duckdb:duckdb 12818282 12809963 1.00
tpch_q16/duckdb:duckdb 26059726 24685639 1.06
tpch_q17/duckdb:duckdb 15151364 16340805 0.93
tpch_q18/duckdb:duckdb 🚀 40201521 45767861 0.88
tpch_q19/duckdb:duckdb 🚀 31997375 37717694 0.85
tpch_q20/duckdb:duckdb 🚀 23143767 26416465 0.88
tpch_q21/duckdb:duckdb 🚀 64027770 77429668 0.83
tpch_q22/duckdb:duckdb 🚀 25752409 29441604 0.87
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -7.3% -0.4% -6.9% +38.6% ➖ noise
1 datafusion:vortex-compact -23.5% -0.4% -23.2% +28.0% ✅ faster
1 datafusion:vortex-file-compressed +11.3% -0.4% +11.7% +38.3% ➖ noise
1 duckdb:duckdb +0.0% -0.4% +0.4% +26.8% ➖ noise
1 duckdb:vortex-compact -2.4% -0.4% -2.0% +26.0% ➖ noise
1 duckdb:vortex-file-compressed +2.8% -0.4% +3.1% +26.2% ➖ noise
2 datafusion:arrow -1.0% +3.8% -4.7% +19.9% ➖ noise
2 datafusion:vortex-compact +5.7% +3.8% +1.8% +21.3% ➖ noise
2 datafusion:vortex-file-compressed +8.8% +3.8% +4.8% +19.9% ➖ noise
2 duckdb:duckdb +6.1% +3.8% +2.2% +19.9% ➖ noise
2 duckdb:vortex-compact -5.2% +3.8% -8.7% +19.9% ➖ noise
2 duckdb:vortex-file-compressed -3.5% +3.8% -7.0% +19.9% ➖ noise
3 datafusion:arrow +17.6% +9.5% +7.4% +26.8% ➖ noise
3 datafusion:vortex-compact -20.8% +9.5% -27.7% +23.7% ✅ faster
3 datafusion:vortex-file-compressed +15.5% +9.5% +5.4% +19.9% ➖ noise
3 duckdb:duckdb -0.3% +9.5% -9.0% +19.9% ➖ noise
3 duckdb:vortex-compact +4.8% +9.5% -4.3% +19.9% ➖ noise
3 duckdb:vortex-file-compressed -4.0% +9.5% -12.4% +19.9% ➖ noise
4 datafusion:arrow +4.4% -6.2% +11.4% +27.1% ➖ noise
4 datafusion:vortex-compact -21.3% -6.2% -16.0% +19.9% ➖ noise
4 datafusion:vortex-file-compressed -2.8% -6.2% +3.7% +24.7% ➖ noise
4 duckdb:duckdb +9.9% -6.2% +17.3% +21.0% ➖ noise
4 duckdb:vortex-compact +2.2% -6.2% +9.0% +19.9% ➖ noise
4 duckdb:vortex-file-compressed +2.7% -6.2% +9.5% +19.9% ➖ noise
5 datafusion:arrow +3.7% +8.2% -4.2% +19.9% ➖ noise
5 datafusion:vortex-compact -24.9% +8.2% -30.6% +30.9% ✅ faster
5 datafusion:vortex-file-compressed +15.0% +8.2% +6.2% +19.9% ➖ noise
5 duckdb:duckdb -2.0% +8.2% -9.5% +19.9% ➖ noise
5 duckdb:vortex-compact -4.3% +8.2% -11.6% +19.9% ➖ noise
5 duckdb:vortex-file-compressed +2.2% +8.2% -5.6% +19.9% ➖ noise
6 datafusion:arrow +12.5% +1.7% +10.6% +30.9% ➖ noise
6 datafusion:vortex-compact -13.2% +1.7% -14.6% +25.9% ➖ noise
6 datafusion:vortex-file-compressed -22.0% +1.7% -23.3% +30.1% ✅ faster
6 duckdb:duckdb -2.0% +1.7% -3.6% +26.7% ➖ noise
6 duckdb:vortex-compact -9.8% +1.7% -11.2% +25.4% ➖ noise
6 duckdb:vortex-file-compressed -1.7% +1.7% -3.3% +32.5% ➖ noise
7 datafusion:arrow +13.0% +14.8% -1.6% +19.9% ➖ noise
7 datafusion:vortex-compact -24.7% +14.8% -34.4% +19.9% ✅ faster
7 datafusion:vortex-file-compressed +13.8% +14.8% -0.8% +20.3% ➖ noise
7 duckdb:duckdb +7.4% +14.8% -6.4% +20.1% ➖ noise
7 duckdb:vortex-compact +2.7% +14.8% -10.5% +19.9% ➖ noise
7 duckdb:vortex-file-compressed -1.5% +14.8% -14.2% +19.9% ➖ noise
8 datafusion:arrow +5.3% +5.0% +0.3% +19.9% ➖ noise
8 datafusion:vortex-compact -3.4% +5.0% -8.1% +23.1% ➖ noise
8 datafusion:vortex-file-compressed +5.5% +5.0% +0.4% +19.9% ➖ noise
8 duckdb:duckdb +11.1% +5.0% +5.8% +20.3% ➖ noise
8 duckdb:vortex-compact -4.6% +5.0% -9.1% +19.9% ➖ noise
8 duckdb:vortex-file-compressed +2.9% +5.0% -2.0% +19.9% ➖ noise
9 datafusion:arrow +13.9% +5.1% +8.3% +19.9% ➖ noise
9 datafusion:vortex-compact -26.5% +5.1% -30.1% +19.9% ✅ faster
9 datafusion:vortex-file-compressed +4.7% +5.1% -0.4% +19.9% ➖ noise
9 duckdb:duckdb -0.2% +5.1% -5.1% +19.9% ➖ noise
9 duckdb:vortex-compact -3.1% +5.1% -7.8% +19.9% ➖ noise
9 duckdb:vortex-file-compressed +5.5% +5.1% +0.3% +19.9% ➖ noise
10 datafusion:arrow +19.2% +6.2% +12.2% +19.9% ➖ noise
10 datafusion:vortex-compact -2.2% +6.2% -7.9% +20.0% ➖ noise
10 datafusion:vortex-file-compressed +6.8% +6.2% +0.5% +22.5% ➖ noise
10 duckdb:duckdb -0.3% +6.2% -6.1% +19.9% ➖ noise
10 duckdb:vortex-compact +7.3% +6.2% +1.0% +19.9% ➖ noise
10 duckdb:vortex-file-compressed -12.9% +6.2% -18.0% +19.9% ✅ faster
11 datafusion:arrow +4.2% -4.0% +8.5% +19.9% ➖ noise
11 datafusion:vortex-compact -25.8% -4.0% -22.7% +19.9% ✅ faster
11 datafusion:vortex-file-compressed -2.6% -4.0% +1.5% +19.9% ➖ noise
11 duckdb:duckdb +10.1% -4.0% +14.7% +19.9% ➖ noise
11 duckdb:vortex-compact +5.8% -4.0% +10.2% +19.9% ➖ noise
11 duckdb:vortex-file-compressed -2.7% -4.0% +1.4% +19.9% ➖ noise
12 datafusion:arrow +11.7% -13.7% +29.3% +20.4% 🚨 regression
12 datafusion:vortex-compact -23.8% -13.7% -11.8% +19.9% ➖ noise
12 datafusion:vortex-file-compressed -3.5% -13.7% +11.8% +29.1% ➖ noise
12 duckdb:duckdb +6.2% -13.7% +23.0% +19.9% 🚨 regression
12 duckdb:vortex-compact +1.9% -13.7% +18.0% +19.9% ➖ noise
12 duckdb:vortex-file-compressed -10.8% -13.7% +3.3% +20.1% ➖ noise
13 datafusion:arrow +3.5% +1.2% +2.3% +19.9% ➖ noise
13 datafusion:vortex-compact +5.4% +1.2% +4.2% +19.9% ➖ noise
13 datafusion:vortex-file-compressed -12.3% +1.2% -13.3% +19.9% ➖ noise
13 duckdb:duckdb +4.3% +1.2% +3.1% +19.9% ➖ noise
13 duckdb:vortex-compact +6.0% +1.2% +4.8% +19.9% ➖ noise
13 duckdb:vortex-file-compressed +7.4% +1.2% +6.2% +19.9% ➖ noise
14 datafusion:arrow +18.8% -6.8% +27.5% +41.5% ➖ noise
14 datafusion:vortex-compact -0.0% -6.8% +7.3% +19.9% ➖ noise
14 datafusion:vortex-file-compressed -21.3% -6.8% -15.6% +26.7% ➖ noise
14 duckdb:duckdb +3.0% -6.8% +10.5% +20.7% ➖ noise
14 duckdb:vortex-compact -0.6% -6.8% +6.6% +19.9% ➖ noise
14 duckdb:vortex-file-compressed +5.4% -6.8% +13.0% +22.7% ➖ noise
15 datafusion:arrow -14.6% -9.6% -5.5% +30.9% ➖ noise
15 datafusion:vortex-compact +0.6% -9.6% +11.3% +19.9% ➖ noise
15 datafusion:vortex-file-compressed -16.4% -9.6% -7.6% +25.6% ➖ noise
15 duckdb:duckdb +0.1% -9.6% +10.7% +19.9% ➖ noise
15 duckdb:vortex-compact +10.2% -9.6% +21.9% +26.5% ➖ noise
15 duckdb:vortex-file-compressed -5.2% -9.6% +4.9% +21.2% ➖ noise
16 datafusion:arrow +13.3% -0.8% +14.3% +26.0% ➖ noise
16 datafusion:vortex-compact -0.2% -0.8% +0.6% +19.9% ➖ noise
16 datafusion:vortex-file-compressed +8.7% -0.8% +9.5% +19.9% ➖ noise
16 duckdb:duckdb +5.6% -0.8% +6.4% +19.9% ➖ noise
16 duckdb:vortex-compact -6.1% -0.8% -5.4% +19.9% ➖ noise
16 duckdb:vortex-file-compressed -0.2% -0.8% +0.6% +19.9% ➖ noise
17 datafusion:arrow -7.9% +2.7% -10.4% +19.9% ➖ noise
17 datafusion:vortex-compact +2.4% +2.7% -0.3% +19.9% ➖ noise
17 datafusion:vortex-file-compressed +7.4% +2.7% +4.5% +19.9% ➖ noise
17 duckdb:duckdb -7.3% +2.7% -9.8% +20.6% ➖ noise
17 duckdb:vortex-compact -3.5% +2.7% -6.1% +20.3% ➖ noise
17 duckdb:vortex-file-compressed -9.0% +2.7% -11.4% +24.2% ➖ noise
18 datafusion:arrow -4.5% +7.4% -11.1% +19.9% ➖ noise
18 datafusion:vortex-compact +4.1% +7.4% -3.1% +19.9% ➖ noise
18 datafusion:vortex-file-compressed +15.6% +7.4% +7.6% +19.9% ➖ noise
18 duckdb:duckdb -12.2% +7.4% -18.2% +19.9% ✅ faster
18 duckdb:vortex-compact +2.4% +7.4% -4.7% +19.9% ➖ noise
18 duckdb:vortex-file-compressed -10.4% +7.4% -16.6% +23.3% ➖ noise
19 datafusion:arrow +24.1% -6.0% +32.0% +22.2% 🚨 regression
19 datafusion:vortex-compact +3.3% -6.0% +9.9% +20.2% ➖ noise
19 datafusion:vortex-file-compressed +8.2% -6.0% +15.1% +19.9% ➖ noise
19 duckdb:duckdb -15.2% -6.0% -9.8% +19.9% ➖ noise
19 duckdb:vortex-compact +6.4% -6.0% +13.2% +19.9% ➖ noise
19 duckdb:vortex-file-compressed -4.6% -6.0% +1.4% +21.8% ➖ noise
20 datafusion:arrow +22.8% -8.3% +33.8% +19.9% 🚨 regression
20 datafusion:vortex-compact +6.5% -8.3% +16.0% +19.9% ➖ noise
20 datafusion:vortex-file-compressed +9.3% -8.3% +19.2% +19.9% ➖ noise
20 duckdb:duckdb -12.4% -8.3% -4.5% +19.9% ➖ noise
20 duckdb:vortex-compact -4.3% -8.3% +4.3% +19.9% ➖ noise
20 duckdb:vortex-file-compressed -5.3% -8.3% +3.2% +19.9% ➖ noise
21 datafusion:arrow +5.4% +2.3% +3.0% +19.9% ➖ noise
21 datafusion:vortex-compact +12.2% +2.3% +9.7% +19.9% ➖ noise
21 datafusion:vortex-file-compressed +10.0% +2.3% +7.5% +19.9% ➖ noise
21 duckdb:duckdb -17.3% +2.3% -19.2% +19.9% ✅ faster
21 duckdb:vortex-compact +10.4% +2.3% +7.9% +19.9% ➖ noise
21 duckdb:vortex-file-compressed +0.3% +2.3% -2.0% +19.9% ➖ noise
22 datafusion:arrow +0.0% +1.7% -1.6% +19.9% ➖ noise
22 datafusion:vortex-compact -17.5% +1.7% -18.9% +21.9% ✅ faster
22 datafusion:vortex-file-compressed -8.7% +1.7% -10.2% +20.9% ➖ noise
22 duckdb:duckdb -12.5% +1.7% -14.0% +19.9% ➖ noise
22 duckdb:vortex-compact +10.6% +1.7% +8.8% +19.9% ➖ noise
22 duckdb:vortex-file-compressed +1.7% +1.7% +0.1% +19.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Vortex (geomean): 1.014x ➖
Parquet (geomean): 1.026x ➖
Shifts: Parquet (control) +2.6% · Median polish +1.2%


datafusion / vortex-file-compressed (1.051x ➖, 0↑ 3↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5581241 5405948 1.03
fineweb_q01/datafusion:vortex-file-compressed 🚨 27176420 22567357 1.20
fineweb_q02/datafusion:vortex-file-compressed 25434832 27316677 0.93
fineweb_q03/datafusion:vortex-file-compressed 🚨 82156823 72763723 1.13
fineweb_q04/datafusion:vortex-file-compressed 🚨 276527661 250420241 1.10
fineweb_q05/datafusion:vortex-file-compressed 232662803 235012902 0.99
fineweb_q06/datafusion:vortex-file-compressed 70483851 66540038 1.06
fineweb_q07/datafusion:vortex-file-compressed 71601877 68399618 1.05
fineweb_q08/datafusion:vortex-file-compressed 25602407 26012105 0.98
datafusion / vortex-compact (1.007x ➖, 1↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 5273042 4693747 1.12
fineweb_q01/datafusion:vortex-compact 163045380 163764142 1.00
fineweb_q02/datafusion:vortex-compact 167231642 165150272 1.01
fineweb_q03/datafusion:vortex-compact 1476341969 1440322704 1.03
fineweb_q04/datafusion:vortex-compact 1590078478 1603351621 0.99
fineweb_q05/datafusion:vortex-compact 1250676646 1233106684 1.01
fineweb_q06/datafusion:vortex-compact 708343829 692138773 1.02
fineweb_q07/datafusion:vortex-compact 736324751 729843173 1.01
fineweb_q08/datafusion:vortex-compact 🚀 21807197 24634683 0.89
datafusion / parquet (1.025x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6757126 6177206 1.09
fineweb_q01/datafusion:parquet 276859626 273095821 1.01
fineweb_q02/datafusion:parquet 271890829 270326155 1.01
fineweb_q03/datafusion:parquet 267830712 269092781 1.00
fineweb_q04/datafusion:parquet 292775022 280678205 1.04
fineweb_q05/datafusion:parquet 283535417 278698810 1.02
fineweb_q06/datafusion:parquet 274913840 274590546 1.00
fineweb_q07/datafusion:parquet 276102464 266044567 1.04
fineweb_q08/datafusion:parquet 268218221 262634952 1.02
duckdb / vortex-file-compressed (0.998x ➖, 1↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3401910 3534658 0.96
fineweb_q01/duckdb:vortex-file-compressed 27678299 27716013 1.00
fineweb_q02/duckdb:vortex-file-compressed 27849132 26745507 1.04
fineweb_q03/duckdb:vortex-file-compressed 131490419 127530610 1.03
fineweb_q04/duckdb:vortex-file-compressed 229921637 228938808 1.00
fineweb_q05/duckdb:vortex-file-compressed 218650551 208753419 1.05
fineweb_q06/duckdb:vortex-file-compressed 🚀 63847752 72243429 0.88
fineweb_q07/duckdb:vortex-file-compressed 70865241 65864377 1.08
fineweb_q08/duckdb:vortex-file-compressed 24473434 25807895 0.95
duckdb / vortex-compact (1.003x ➖, 1↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3938346 4106738 0.96
fineweb_q01/duckdb:vortex-compact 106950331 104261030 1.03
fineweb_q02/duckdb:vortex-compact 🚀 111856474 124512163 0.90
fineweb_q03/duckdb:vortex-compact 869322217 858060325 1.01
fineweb_q04/duckdb:vortex-compact 927294916 910092125 1.02
fineweb_q05/duckdb:vortex-compact 812890594 816894387 1.00
fineweb_q06/duckdb:vortex-compact 473813740 467416160 1.01
fineweb_q07/duckdb:vortex-compact 482973938 475522017 1.02
fineweb_q08/duckdb:vortex-compact 24781470 22593540 1.10
duckdb / parquet (1.026x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 38312413 35129720 1.09
fineweb_q01/duckdb:parquet 93561898 93304422 1.00
fineweb_q02/duckdb:parquet 97079381 95805579 1.01
fineweb_q03/duckdb:parquet 316255621 306609690 1.03
fineweb_q04/duckdb:parquet 441068991 438722398 1.01
fineweb_q05/duckdb:parquet 412223872 408890073 1.01
fineweb_q06/duckdb:parquet 201378571 199656345 1.01
fineweb_q07/duckdb:parquet 212177892 209345634 1.01
fineweb_q08/duckdb:parquet 60766954 57093858 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +12.3% +9.2% +2.9% +41.8% ➖ noise
0 datafusion:vortex-file-compressed +3.2% +9.2% -5.5% +69.6% ➖ noise
0 duckdb:vortex-compact -4.1% +9.2% -12.2% +37.7% ➖ noise
0 duckdb:vortex-file-compressed -3.8% +9.2% -11.9% +49.0% ➖ noise
1 datafusion:vortex-compact -0.4% +0.8% -1.3% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +20.4% +0.8% +19.4% +22.3% ➖ noise
1 duckdb:vortex-compact +2.6% +0.8% +1.7% +21.4% ➖ noise
1 duckdb:vortex-file-compressed -0.1% +0.8% -1.0% +44.7% ➖ noise
2 datafusion:vortex-compact +1.3% +1.0% +0.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -6.9% +1.0% -7.8% +11.4% ➖ noise
2 duckdb:vortex-compact -10.2% +1.0% -11.0% +17.1% ➖ noise
2 duckdb:vortex-file-compressed +4.1% +1.0% +3.1% +10.0% ➖ noise
3 datafusion:vortex-compact +2.5% +1.3% +1.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +12.9% +1.3% +11.4% +33.1% ➖ noise
3 duckdb:vortex-compact +1.3% +1.3% -0.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.1% +1.3% +1.8% +30.0% ➖ noise
4 datafusion:vortex-compact -0.8% +2.4% -3.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +10.4% +2.4% +7.8% +11.0% ➖ noise
4 duckdb:vortex-compact +1.9% +2.4% -0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.4% +2.4% -1.9% +10.0% ➖ noise
5 datafusion:vortex-compact +1.4% +1.3% +0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.0% +1.3% -2.2% +10.0% ➖ noise
5 duckdb:vortex-compact -0.5% +1.3% -1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.7% +1.3% +3.4% +10.0% ➖ noise
6 datafusion:vortex-compact +2.3% +0.5% +1.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.9% +0.5% +5.4% +19.3% ➖ noise
6 duckdb:vortex-compact +1.4% +0.5% +0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -11.6% +0.5% -12.1% +15.4% ➖ noise
7 datafusion:vortex-compact +0.9% +2.6% -1.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.7% +2.6% +2.1% +10.0% ➖ noise
7 duckdb:vortex-compact +1.6% +2.6% -1.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +7.6% +2.6% +4.9% +12.9% ➖ noise
8 datafusion:vortex-compact -11.5% +4.3% -15.1% +27.8% ➖ noise
8 datafusion:vortex-file-compressed -1.6% +4.3% -5.6% +35.2% ➖ noise
8 duckdb:vortex-compact +9.7% +4.3% +5.2% +17.0% ➖ noise
8 duckdb:vortex-file-compressed -5.2% +4.3% -9.0% +11.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.7%
Vortex (geomean): 1.055x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +6.3%


datafusion / vortex-file-compressed (1.022x ➖, 6↑ 16↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28788519 29644042 0.97
tpcds_q02/datafusion:vortex-file-compressed 51769690 54224628 0.95
tpcds_q03/datafusion:vortex-file-compressed 19448355 20688899 0.94
tpcds_q04/datafusion:vortex-file-compressed 294747362 297224108 0.99
tpcds_q05/datafusion:vortex-file-compressed 🚨 62982144 54132590 1.16
tpcds_q06/datafusion:vortex-file-compressed 🚨 57900979 51583848 1.12
tpcds_q07/datafusion:vortex-file-compressed 49634827 53171934 0.93
tpcds_q08/datafusion:vortex-file-compressed 37123157 38822673 0.96
tpcds_q09/datafusion:vortex-file-compressed 56792072 57027248 1.00
tpcds_q10/datafusion:vortex-file-compressed 49489561 46287595 1.07
tpcds_q11/datafusion:vortex-file-compressed 🚨 187861272 169755812 1.11
tpcds_q12/datafusion:vortex-file-compressed 🚨 25247873 22852250 1.10
tpcds_q13/datafusion:vortex-file-compressed 65842966 64082631 1.03
tpcds_q14/datafusion:vortex-file-compressed 222975918 205852119 1.08
tpcds_q15/datafusion:vortex-file-compressed 🚨 40024476 34665874 1.15
tpcds_q16/datafusion:vortex-file-compressed 🚨 31381979 27642655 1.14
tpcds_q17/datafusion:vortex-file-compressed 75608032 72146526 1.05
tpcds_q18/datafusion:vortex-file-compressed 86136775 86488575 1.00
tpcds_q19/datafusion:vortex-file-compressed 35354317 33620956 1.05
tpcds_q20/datafusion:vortex-file-compressed 28516267 27230050 1.05
tpcds_q21/datafusion:vortex-file-compressed 154704329 148969382 1.04
tpcds_q22/datafusion:vortex-file-compressed 66034691 63577719 1.04
tpcds_q23/datafusion:vortex-file-compressed 169971575 154982814 1.10
tpcds_q24/datafusion:vortex-file-compressed 126986621 118561556 1.07
tpcds_q25/datafusion:vortex-file-compressed 77012942 72523289 1.06
tpcds_q26/datafusion:vortex-file-compressed 40143121 41518750 0.97
tpcds_q27/datafusion:vortex-file-compressed 139317995 131529662 1.06
tpcds_q28/datafusion:vortex-file-compressed 55746996 53119351 1.05
tpcds_q29/datafusion:vortex-file-compressed 75968734 74520876 1.02
tpcds_q30/datafusion:vortex-file-compressed 34533944 35751895 0.97
tpcds_q31/datafusion:vortex-file-compressed 105814371 99257702 1.07
tpcds_q32/datafusion:vortex-file-compressed 23261125 21555203 1.08
tpcds_q33/datafusion:vortex-file-compressed 42164108 43192480 0.98
tpcds_q34/datafusion:vortex-file-compressed 35919641 32701767 1.10
tpcds_q35/datafusion:vortex-file-compressed 62177393 61152144 1.02
tpcds_q36/datafusion:vortex-file-compressed 86652694 80873291 1.07
tpcds_q37/datafusion:vortex-file-compressed 🚨 41622216 36614562 1.14
tpcds_q38/datafusion:vortex-file-compressed 56894323 56632410 1.00
tpcds_q39/datafusion:vortex-file-compressed 164008753 153403590 1.07
tpcds_q40/datafusion:vortex-file-compressed 59817995 56361096 1.06
tpcds_q41/datafusion:vortex-file-compressed 20628281 20917782 0.99
tpcds_q42/datafusion:vortex-file-compressed 20719798 20901615 0.99
tpcds_q43/datafusion:vortex-file-compressed 35858462 32835848 1.09
tpcds_q44/datafusion:vortex-file-compressed 47448608 46483938 1.02
tpcds_q45/datafusion:vortex-file-compressed 37719965 36151091 1.04
tpcds_q46/datafusion:vortex-file-compressed 55102868 52390612 1.05
tpcds_q47/datafusion:vortex-file-compressed 232473471 222816062 1.04
tpcds_q48/datafusion:vortex-file-compressed 53830958 50909921 1.06
tpcds_q49/datafusion:vortex-file-compressed 76033490 74803093 1.02
tpcds_q50/datafusion:vortex-file-compressed 51275824 54348058 0.94
tpcds_q51/datafusion:vortex-file-compressed 98583226 94703079 1.04
tpcds_q52/datafusion:vortex-file-compressed 20590686 21868603 0.94
tpcds_q53/datafusion:vortex-file-compressed 28868742 27193226 1.06
tpcds_q54/datafusion:vortex-file-compressed 48573783 45007877 1.08
tpcds_q55/datafusion:vortex-file-compressed 19731878 18628525 1.06
tpcds_q56/datafusion:vortex-file-compressed 43370788 40639402 1.07
tpcds_q57/datafusion:vortex-file-compressed 140311654 129079716 1.09
tpcds_q58/datafusion:vortex-file-compressed 🚨 79664930 70878065 1.12
tpcds_q59/datafusion:vortex-file-compressed 🚨 80954466 72931755 1.11
tpcds_q60/datafusion:vortex-file-compressed 44913674 41624670 1.08
tpcds_q61/datafusion:vortex-file-compressed 🚨 57105493 51161440 1.12
tpcds_q62/datafusion:vortex-file-compressed 🚨 35351346 30743294 1.15
tpcds_q63/datafusion:vortex-file-compressed 27894197 25523790 1.09
tpcds_q64/datafusion:vortex-file-compressed 🚨 520897282 470020163 1.11
tpcds_q65/datafusion:vortex-file-compressed 🚨 54938007 49741089 1.10
tpcds_q66/datafusion:vortex-file-compressed 103637919 95701371 1.08
tpcds_q67/datafusion:vortex-file-compressed 128604270 128943029 1.00
tpcds_q68/datafusion:vortex-file-compressed 🚨 51593811 46221855 1.12
tpcds_q69/datafusion:vortex-file-compressed 47816112 43964781 1.09
tpcds_q70/datafusion:vortex-file-compressed 123625104 121773759 1.02
tpcds_q71/datafusion:vortex-file-compressed 🚨 35611237 31601959 1.13
tpcds_q72/datafusion:vortex-file-compressed 🚨 3095528553 2619961798 1.18
tpcds_q73/datafusion:vortex-file-compressed 36696178 37195013 0.99
tpcds_q74/datafusion:vortex-file-compressed 130084418 122475755 1.06
tpcds_q75/datafusion:vortex-file-compressed 129799791 127027435 1.02
tpcds_q76/datafusion:vortex-file-compressed 38401089 38778516 0.99
tpcds_q77/datafusion:vortex-file-compressed 57954959 56159810 1.03
tpcds_q78/datafusion:vortex-file-compressed 141748228 137302837 1.03
tpcds_q79/datafusion:vortex-file-compressed 43615294 44084988 0.99
tpcds_q80/datafusion:vortex-file-compressed 121242251 121937088 0.99
tpcds_q81/datafusion:vortex-file-compressed 37190519 37193497 1.00
tpcds_q82/datafusion:vortex-file-compressed 36777710 35383750 1.04
tpcds_q83/datafusion:vortex-file-compressed 50485512 51282052 0.98
tpcds_q84/datafusion:vortex-file-compressed 15453571 15537830 0.99
tpcds_q85/datafusion:vortex-file-compressed 101658371 103890577 0.98
tpcds_q86/datafusion:vortex-file-compressed 17971593 19102980 0.94
tpcds_q87/datafusion:vortex-file-compressed 52491140 53874887 0.97
tpcds_q88/datafusion:vortex-file-compressed 77997574 79200950 0.98
tpcds_q89/datafusion:vortex-file-compressed 36971042 38879776 0.95
tpcds_q90/datafusion:vortex-file-compressed 🚀 17789505 20026420 0.89
tpcds_q91/datafusion:vortex-file-compressed 26311698 28347443 0.93
tpcds_q92/datafusion:vortex-file-compressed 18675397 20623133 0.91
tpcds_q93/datafusion:vortex-file-compressed 33853136 37039208 0.91
tpcds_q94/datafusion:vortex-file-compressed 24876681 25625987 0.97
tpcds_q95/datafusion:vortex-file-compressed 🚀 61083228 71467045 0.85
tpcds_q96/datafusion:vortex-file-compressed 🚀 17053354 20531537 0.83
tpcds_q97/datafusion:vortex-file-compressed 🚀 31251114 40466478 0.77
tpcds_q98/datafusion:vortex-file-compressed 🚀 33833706 41815059 0.81
tpcds_q99/datafusion:vortex-file-compressed 🚀 50507481 63042553 0.80
datafusion / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 39219521 41073472 0.95
tpcds_q02/datafusion:vortex-compact 58108202 60120960 0.97
tpcds_q03/datafusion:vortex-compact 25333281 26303874 0.96
tpcds_q04/datafusion:vortex-compact 327500716 342651405 0.96
tpcds_q05/datafusion:vortex-compact 64234872 66772640 0.96
tpcds_q06/datafusion:vortex-compact 56114881 58577963 0.96
tpcds_q07/datafusion:vortex-compact 67454746 67569486 1.00
tpcds_q08/datafusion:vortex-compact 46494519 45689773 1.02
tpcds_q09/datafusion:vortex-compact 103641153 102807908 1.01
tpcds_q10/datafusion:vortex-compact 62586025 62000550 1.01
tpcds_q11/datafusion:vortex-compact 189806046 189221784 1.00
tpcds_q12/datafusion:vortex-compact 24804704 26110134 0.95
tpcds_q13/datafusion:vortex-compact 135195345 126500520 1.07
tpcds_q14/datafusion:vortex-compact 251853712 256091426 0.98
tpcds_q15/datafusion:vortex-compact 36962168 37676881 0.98
tpcds_q16/datafusion:vortex-compact 39266462 39288528 1.00
tpcds_q17/datafusion:vortex-compact 92363421 92406087 1.00
tpcds_q18/datafusion:vortex-compact 91807429 91910518 1.00
tpcds_q19/datafusion:vortex-compact 42806000 43682712 0.98
tpcds_q20/datafusion:vortex-compact 29934974 29037339 1.03
tpcds_q21/datafusion:vortex-compact 139828710 142666291 0.98
tpcds_q22/datafusion:vortex-compact 67314447 68096358 0.99
tpcds_q23/datafusion:vortex-compact 183556624 183026003 1.00
tpcds_q24/datafusion:vortex-compact 140737461 136810409 1.03
tpcds_q25/datafusion:vortex-compact 93466756 94551786 0.99
tpcds_q26/datafusion:vortex-compact 47480204 46270480 1.03
tpcds_q27/datafusion:vortex-compact 157791199 156604196 1.01
tpcds_q28/datafusion:vortex-compact 100453649 100470988 1.00
tpcds_q29/datafusion:vortex-compact 94297233 92606833 1.02
tpcds_q30/datafusion:vortex-compact 36176583 37252161 0.97
tpcds_q31/datafusion:vortex-compact 125482998 125670967 1.00
tpcds_q32/datafusion:vortex-compact 26272568 27137101 0.97
tpcds_q33/datafusion:vortex-compact 52131788 52384982 1.00
tpcds_q34/datafusion:vortex-compact 49374870 48372637 1.02
tpcds_q35/datafusion:vortex-compact 69995634 68277083 1.03
tpcds_q36/datafusion:vortex-compact 98052386 102524603 0.96
tpcds_q37/datafusion:vortex-compact 46524634 46220527 1.01
tpcds_q38/datafusion:vortex-compact 65662419 65244714 1.01
tpcds_q39/datafusion:vortex-compact 142515839 148189641 0.96
tpcds_q40/datafusion:vortex-compact 58341443 56375364 1.03
tpcds_q41/datafusion:vortex-compact 20018429 19732361 1.01
tpcds_q42/datafusion:vortex-compact 24178805 25944522 0.93
tpcds_q43/datafusion:vortex-compact 39344614 39545706 0.99
tpcds_q44/datafusion:vortex-compact 75314353 74960748 1.00
tpcds_q45/datafusion:vortex-compact 36294471 36889285 0.98
tpcds_q46/datafusion:vortex-compact 68731328 70757930 0.97
tpcds_q47/datafusion:vortex-compact 223915129 226083658 0.99
tpcds_q48/datafusion:vortex-compact 96806638 95656616 1.01
tpcds_q49/datafusion:vortex-compact 95024415 95983170 0.99
tpcds_q50/datafusion:vortex-compact 62798352 63656016 0.99
tpcds_q51/datafusion:vortex-compact 95624072 95058403 1.01
tpcds_q52/datafusion:vortex-compact 23678890 25319904 0.94
tpcds_q53/datafusion:vortex-compact 36043474 35903285 1.00
tpcds_q54/datafusion:vortex-compact 57667499 59336931 0.97
tpcds_q55/datafusion:vortex-compact 24490429 23597911 1.04
tpcds_q56/datafusion:vortex-compact 53018797 53976525 0.98
tpcds_q57/datafusion:vortex-compact 139544624 137991790 1.01
tpcds_q58/datafusion:vortex-compact 75525572 77540096 0.97
tpcds_q59/datafusion:vortex-compact 87576968 85803010 1.02
tpcds_q60/datafusion:vortex-compact 54764012 53879454 1.02
tpcds_q61/datafusion:vortex-compact 74037274 73239904 1.01
tpcds_q62/datafusion:vortex-compact 33467299 31566947 1.06
tpcds_q63/datafusion:vortex-compact 36015791 35384914 1.02
tpcds_q64/datafusion:vortex-compact 534926360 539184776 0.99
tpcds_q65/datafusion:vortex-compact 67698246 69247244 0.98
tpcds_q66/datafusion:vortex-compact 96768252 97333331 0.99
tpcds_q67/datafusion:vortex-compact 130045159 122861666 1.06
tpcds_q68/datafusion:vortex-compact 69112119 68468493 1.01
tpcds_q69/datafusion:vortex-compact 59255074 59285577 1.00
tpcds_q70/datafusion:vortex-compact 125292037 129619556 0.97
tpcds_q71/datafusion:vortex-compact 43620761 45430515 0.96
tpcds_q72/datafusion:vortex-compact 2561082385 2561999035 1.00
tpcds_q73/datafusion:vortex-compact 50767438 51353623 0.99
tpcds_q74/datafusion:vortex-compact 130552811 133295857 0.98
tpcds_q75/datafusion:vortex-compact 161247102 163047487 0.99
tpcds_q76/datafusion:vortex-compact 53010667 53547885 0.99
tpcds_q77/datafusion:vortex-compact 68292357 69494888 0.98
tpcds_q78/datafusion:vortex-compact 147315793 146512460 1.01
tpcds_q79/datafusion:vortex-compact 59920712 57984209 1.03
tpcds_q80/datafusion:vortex-compact 133321617 129245502 1.03
tpcds_q81/datafusion:vortex-compact 43073184 42512493 1.01
tpcds_q82/datafusion:vortex-compact 49307072 47374611 1.04
tpcds_q83/datafusion:vortex-compact 57947977 57847108 1.00
tpcds_q84/datafusion:vortex-compact 19577156 19000936 1.03
tpcds_q85/datafusion:vortex-compact 126132031 125156166 1.01
tpcds_q86/datafusion:vortex-compact 20270590 20163315 1.01
tpcds_q87/datafusion:vortex-compact 66123042 66496762 0.99
tpcds_q88/datafusion:vortex-compact 138306873 139528154 0.99
tpcds_q89/datafusion:vortex-compact 45751919 45807762 1.00
tpcds_q90/datafusion:vortex-compact 23728553 24094435 0.98
tpcds_q91/datafusion:vortex-compact 40639629 39858863 1.02
tpcds_q92/datafusion:vortex-compact 20825249 20253519 1.03
tpcds_q93/datafusion:vortex-compact 46418063 47770908 0.97
tpcds_q94/datafusion:vortex-compact 30964914 30945017 1.00
tpcds_q95/datafusion:vortex-compact 72569762 70261320 1.03
tpcds_q96/datafusion:vortex-compact 27089106 26660514 1.02
tpcds_q97/datafusion:vortex-compact 41795823 41133177 1.02
tpcds_q98/datafusion:vortex-compact 38839299 38271640 1.01
tpcds_q99/datafusion:vortex-compact 49767790 49630214 1.00
datafusion / parquet (0.943x ➖, 18↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36212645 37556460 0.96
tpcds_q02/datafusion:parquet 46634510 46277124 1.01
tpcds_q03/datafusion:parquet 15313917 15404706 0.99
tpcds_q04/datafusion:parquet 319058240 329348204 0.97
tpcds_q05/datafusion:parquet 52936367 56778341 0.93
tpcds_q06/datafusion:parquet 63884509 66295008 0.96
tpcds_q07/datafusion:parquet 92486749 88456082 1.05
tpcds_q08/datafusion:parquet 34464032 33470546 1.03
tpcds_q09/datafusion:parquet 58887456 57021623 1.03
tpcds_q10/datafusion:parquet 82827952 83186088 1.00
tpcds_q11/datafusion:parquet 192183322 189206351 1.02
tpcds_q12/datafusion:parquet 🚨 25503218 22980821 1.11
tpcds_q13/datafusion:parquet 85877785 85655825 1.00
tpcds_q14/datafusion:parquet 192097551 207573425 0.93
tpcds_q15/datafusion:parquet 26314390 28331611 0.93
tpcds_q16/datafusion:parquet 🚀 27914113 31416932 0.89
tpcds_q17/datafusion:parquet 69687079 74665834 0.93
tpcds_q18/datafusion:parquet 132750475 135624274 0.98
tpcds_q19/datafusion:parquet 27998640 30055640 0.93
tpcds_q20/datafusion:parquet 21452430 23149230 0.93
tpcds_q21/datafusion:parquet 23050830 23824753 0.97
tpcds_q22/datafusion:parquet 🚀 130936398 180023839 0.73
tpcds_q23/datafusion:parquet 166484747 175261558 0.95
tpcds_q24/datafusion:parquet 🚀 104957129 123758598 0.85
tpcds_q25/datafusion:parquet 🚀 69657296 81038876 0.86
tpcds_q26/datafusion:parquet 74645830 82486731 0.90
tpcds_q27/datafusion:parquet 161342056 172566808 0.93
tpcds_q28/datafusion:parquet 48093051 51297160 0.94
tpcds_q29/datafusion:parquet 74833673 74512619 1.00
tpcds_q30/datafusion:parquet 42278711 45249017 0.93
tpcds_q31/datafusion:parquet 76531073 77188538 0.99
tpcds_q32/datafusion:parquet 22090174 23549670 0.94
tpcds_q33/datafusion:parquet 36975003 36474837 1.01
tpcds_q34/datafusion:parquet 28037106 28621650 0.98
tpcds_q35/datafusion:parquet 83830150 92690923 0.90
tpcds_q36/datafusion:parquet 62662079 66990620 0.94
tpcds_q37/datafusion:parquet 🚀 24399995 27323182 0.89
tpcds_q38/datafusion:parquet 🚀 49816730 57417390 0.87
tpcds_q39/datafusion:parquet 85634580 87613653 0.98
tpcds_q40/datafusion:parquet 26717404 29293337 0.91
tpcds_q41/datafusion:parquet 15900472 17215324 0.92
tpcds_q42/datafusion:parquet 13751311 14271219 0.96
tpcds_q43/datafusion:parquet 20364272 20082383 1.01
tpcds_q44/datafusion:parquet 41410355 42972548 0.96
tpcds_q45/datafusion:parquet 32537575 35126188 0.93
tpcds_q46/datafusion:parquet 38828489 41614308 0.93
tpcds_q47/datafusion:parquet 134622539 142942337 0.94
tpcds_q48/datafusion:parquet 78496789 80220473 0.98
tpcds_q49/datafusion:parquet 65203825 67850213 0.96
tpcds_q50/datafusion:parquet 48900297 49023463 1.00
tpcds_q51/datafusion:parquet 90584844 90525374 1.00
tpcds_q52/datafusion:parquet 14205861 15493126 0.92
tpcds_q53/datafusion:parquet 🚀 21663334 24266940 0.89
tpcds_q54/datafusion:parquet 42801610 43689126 0.98
tpcds_q55/datafusion:parquet 13991692 14990789 0.93
tpcds_q56/datafusion:parquet 35097187 36199261 0.97
tpcds_q57/datafusion:parquet 105164878 109402285 0.96
tpcds_q58/datafusion:parquet 56211215 61707496 0.91
tpcds_q59/datafusion:parquet 🚀 57184780 64800025 0.88
tpcds_q60/datafusion:parquet 34938069 36815750 0.95
tpcds_q61/datafusion:parquet 50391255 55760725 0.90
tpcds_q62/datafusion:parquet 🚀 25153824 30851767 0.82
tpcds_q63/datafusion:parquet 21861966 22040759 0.99
tpcds_q64/datafusion:parquet 545868873 588183742 0.93
tpcds_q65/datafusion:parquet 🚀 44160480 50496393 0.87
tpcds_q66/datafusion:parquet 🚀 77020480 92422982 0.83
tpcds_q67/datafusion:parquet 156413794 172277995 0.91
tpcds_q68/datafusion:parquet 39763026 42929064 0.93
tpcds_q69/datafusion:parquet 🚀 79323548 106733869 0.74
tpcds_q70/datafusion:parquet 🚀 96427437 114020794 0.85
tpcds_q71/datafusion:parquet 26410481 29074147 0.91
tpcds_q72/datafusion:parquet 🚀 645092059 743403065 0.87
tpcds_q73/datafusion:parquet 🚀 25864558 30002697 0.86
tpcds_q74/datafusion:parquet 🚀 105357344 127306958 0.83
tpcds_q75/datafusion:parquet 🚀 116471873 144963754 0.80
tpcds_q76/datafusion:parquet 37409889 39869476 0.94
tpcds_q77/datafusion:parquet 🚀 52503825 59733131 0.88
tpcds_q78/datafusion:parquet 120248238 125278009 0.96
tpcds_q79/datafusion:parquet 31143163 31219443 1.00
tpcds_q80/datafusion:parquet 93349540 94891677 0.98
tpcds_q81/datafusion:parquet 41265418 41550366 0.99
tpcds_q82/datafusion:parquet 24311825 23652366 1.03
tpcds_q83/datafusion:parquet 47828133 48282043 0.99
tpcds_q84/datafusion:parquet 46764318 48514920 0.96
tpcds_q85/datafusion:parquet 170483827 175697489 0.97
tpcds_q86/datafusion:parquet 17806329 18273785 0.97
tpcds_q87/datafusion:parquet 51298658 50478797 1.02
tpcds_q88/datafusion:parquet 69182260 70316451 0.98
tpcds_q89/datafusion:parquet 23889282 24296908 0.98
tpcds_q90/datafusion:parquet 19549394 19132659 1.02
tpcds_q91/datafusion:parquet 69057886 74785934 0.92
tpcds_q92/datafusion:parquet 21185328 21846145 0.97
tpcds_q93/datafusion:parquet 34318856 36022605 0.95
tpcds_q94/datafusion:parquet 24953591 24959968 1.00
tpcds_q95/datafusion:parquet 68491511 68672796 1.00
tpcds_q96/datafusion:parquet 14653925 14773934 0.99
tpcds_q97/datafusion:parquet 34046419 33500916 1.02
tpcds_q98/datafusion:parquet 25345097 26414315 0.96
tpcds_q99/datafusion:parquet 28140491 28540576 0.99
duckdb / vortex-file-compressed (1.111x ❌, 0↑ 59↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 28227359 26499600 1.07
tpcds_q02/duckdb:vortex-file-compressed 90678285 85799017 1.06
tpcds_q03/duckdb:vortex-file-compressed 🚨 26336623 23804253 1.11
tpcds_q04/duckdb:vortex-file-compressed 116353940 106804862 1.09
tpcds_q05/duckdb:vortex-file-compressed 🚨 112892206 85828573 1.32
tpcds_q06/duckdb:vortex-file-compressed 🚨 40473398 36737378 1.10
tpcds_q07/duckdb:vortex-file-compressed 🚨 27231945 24443062 1.11
tpcds_q08/duckdb:vortex-file-compressed 🚨 26317002 22814828 1.15
tpcds_q09/duckdb:vortex-file-compressed 44388326 40421675 1.10
tpcds_q10/duckdb:vortex-file-compressed 39569410 37319101 1.06
tpcds_q11/duckdb:vortex-file-compressed 68795657 62870891 1.09
tpcds_q12/duckdb:vortex-file-compressed 15394823 14623491 1.05
tpcds_q13/duckdb:vortex-file-compressed 🚨 38416845 32977096 1.16
tpcds_q14/duckdb:vortex-file-compressed 218072015 201290712 1.08
tpcds_q15/duckdb:vortex-file-compressed 🚨 45351026 40436779 1.12
tpcds_q16/duckdb:vortex-file-compressed 32755695 29954352 1.09
tpcds_q17/duckdb:vortex-file-compressed 🚨 45754647 38337363 1.19
tpcds_q18/duckdb:vortex-file-compressed 48687056 45738139 1.06
tpcds_q19/duckdb:vortex-file-compressed 🚨 36751516 33367709 1.10
tpcds_q20/duckdb:vortex-file-compressed 🚨 17820733 16180387 1.10
tpcds_q21/duckdb:vortex-file-compressed 🚨 21974339 19765272 1.11
tpcds_q22/duckdb:vortex-file-compressed 119691809 109429025 1.09
tpcds_q23/duckdb:vortex-file-compressed 🚨 147854040 132577272 1.12
tpcds_q24/duckdb:vortex-file-compressed 🚨 63704146 56667907 1.12
tpcds_q25/duckdb:vortex-file-compressed 42093315 38314872 1.10
tpcds_q26/duckdb:vortex-file-compressed 🚨 44479881 38972256 1.14
tpcds_q27/duckdb:vortex-file-compressed 🚨 99227350 89816356 1.10
tpcds_q28/duckdb:vortex-file-compressed 🚨 42648927 37888491 1.13
tpcds_q29/duckdb:vortex-file-compressed 40722925 37519544 1.09
tpcds_q30/duckdb:vortex-file-compressed 31348920 28742972 1.09
tpcds_q31/duckdb:vortex-file-compressed 28203080 25898715 1.09
tpcds_q32/duckdb:vortex-file-compressed 🚨 18762525 16941558 1.11
tpcds_q33/duckdb:vortex-file-compressed 🚨 80986011 70742752 1.14
tpcds_q34/duckdb:vortex-file-compressed 21070762 19558108 1.08
tpcds_q35/duckdb:vortex-file-compressed 🚨 71417646 62181696 1.15
tpcds_q36/duckdb:vortex-file-compressed 29955721 27346770 1.10
tpcds_q37/duckdb:vortex-file-compressed 🚨 25833223 22654339 1.14
tpcds_q38/duckdb:vortex-file-compressed 41014504 38307304 1.07
tpcds_q39/duckdb:vortex-file-compressed 🚨 54440595 45578093 1.19
tpcds_q40/duckdb:vortex-file-compressed 🚨 26630136 22315296 1.19
tpcds_q41/duckdb:vortex-file-compressed 🚨 14889783 12975452 1.15
tpcds_q42/duckdb:vortex-file-compressed 🚨 13415723 11857542 1.13
tpcds_q43/duckdb:vortex-file-compressed 🚨 22088346 19747179 1.12
tpcds_q44/duckdb:vortex-file-compressed 🚨 25383557 22761123 1.12
tpcds_q45/duckdb:vortex-file-compressed 🚨 31119018 27816869 1.12
tpcds_q46/duckdb:vortex-file-compressed 53145018 48849367 1.09
tpcds_q47/duckdb:vortex-file-compressed 🚨 56874558 49333993 1.15
tpcds_q48/duckdb:vortex-file-compressed 34809643 31768758 1.10
tpcds_q49/duckdb:vortex-file-compressed 33211274 31143243 1.07
tpcds_q50/duckdb:vortex-file-compressed 🚨 40622737 36874323 1.10
tpcds_q51/duckdb:vortex-file-compressed 107230361 100423019 1.07
tpcds_q52/duckdb:vortex-file-compressed 🚨 14056405 12086577 1.16
tpcds_q53/duckdb:vortex-file-compressed 🚨 19094486 17128415 1.11
tpcds_q54/duckdb:vortex-file-compressed 🚨 57604479 51609521 1.12
tpcds_q55/duckdb:vortex-file-compressed 12849654 12159753 1.06
tpcds_q56/duckdb:vortex-file-compressed 75860568 69223568 1.10
tpcds_q57/duckdb:vortex-file-compressed 48975952 44692238 1.10
tpcds_q58/duckdb:vortex-file-compressed 🚨 36709275 31922389 1.15
tpcds_q59/duckdb:vortex-file-compressed 59462556 56147983 1.06
tpcds_q60/duckdb:vortex-file-compressed 🚨 79104324 70629455 1.12
tpcds_q61/duckdb:vortex-file-compressed 🚨 44918650 39952677 1.12
tpcds_q62/duckdb:vortex-file-compressed 🚨 19549587 17645716 1.11
tpcds_q63/duckdb:vortex-file-compressed 19654985 18058054 1.09
tpcds_q64/duckdb:vortex-file-compressed 🚨 89388312 80342715 1.11
tpcds_q65/duckdb:vortex-file-compressed 🚨 26151579 23035286 1.14
tpcds_q66/duckdb:vortex-file-compressed 🚨 63799616 56853852 1.12
tpcds_q67/duckdb:vortex-file-compressed 162306123 147648835 1.10
tpcds_q68/duckdb:vortex-file-compressed 🚨 45412241 40574334 1.12
tpcds_q69/duckdb:vortex-file-compressed 🚨 42640318 37976669 1.12
tpcds_q70/duckdb:vortex-file-compressed 26475388 24872120 1.06
tpcds_q71/duckdb:vortex-file-compressed 🚨 23649924 21375950 1.11
tpcds_q72/duckdb:vortex-file-compressed 186330852 178334246 1.04
tpcds_q73/duckdb:vortex-file-compressed 🚨 21618500 19651442 1.10
tpcds_q74/duckdb:vortex-file-compressed 🚨 56230358 50175049 1.12
tpcds_q75/duckdb:vortex-file-compressed 64702152 59613087 1.09
tpcds_q76/duckdb:vortex-file-compressed 🚨 79626947 66481120 1.20
tpcds_q77/duckdb:vortex-file-compressed 71807873 67138640 1.07
tpcds_q78/duckdb:vortex-file-compressed 🚨 86494463 77347160 1.12
tpcds_q79/duckdb:vortex-file-compressed 39482060 36832272 1.07
tpcds_q80/duckdb:vortex-file-compressed 🚨 109208038 93733641 1.17
tpcds_q81/duckdb:vortex-file-compressed 🚨 37416426 32180773 1.16
tpcds_q82/duckdb:vortex-file-compressed 🚨 25934366 23324168 1.11
tpcds_q83/duckdb:vortex-file-compressed 🚨 31838884 28694225 1.11
tpcds_q84/duckdb:vortex-file-compressed 🚨 19981807 17035355 1.17
tpcds_q85/duckdb:vortex-file-compressed 🚨 51381481 45653573 1.13
tpcds_q86/duckdb:vortex-file-compressed 18154258 19260732 0.94
tpcds_q87/duckdb:vortex-file-compressed 42230119 39612976 1.07
tpcds_q88/duckdb:vortex-file-compressed 38303150 35618616 1.08
tpcds_q89/duckdb:vortex-file-compressed 🚨 21345730 17525939 1.22
tpcds_q90/duckdb:vortex-file-compressed 🚨 17049738 14986249 1.14
tpcds_q91/duckdb:vortex-file-compressed 🚨 30729619 27256255 1.13
tpcds_q92/duckdb:vortex-file-compressed 🚨 15747403 14021922 1.12
tpcds_q93/duckdb:vortex-file-compressed 🚨 36060915 29888028 1.21
tpcds_q94/duckdb:vortex-file-compressed 🚨 25223095 21954626 1.15
tpcds_q95/duckdb:vortex-file-compressed 147525573 145121339 1.02
tpcds_q96/duckdb:vortex-file-compressed 13285040 12532171 1.06
tpcds_q97/duckdb:vortex-file-compressed 42993255 39631351 1.08
tpcds_q98/duckdb:vortex-file-compressed 🚨 21039137 17997788 1.17
tpcds_q99/duckdb:vortex-file-compressed 35164527 33071069 1.06
duckdb / vortex-compact (1.092x ➖, 0↑ 46↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 37839831 32567043 1.16
tpcds_q02/duckdb:vortex-compact 135085054 124728262 1.08
tpcds_q03/duckdb:vortex-compact 🚨 56723312 49827582 1.14
tpcds_q04/duckdb:vortex-compact 136061795 124011646 1.10
tpcds_q05/duckdb:vortex-compact 176103296 162958720 1.08
tpcds_q06/duckdb:vortex-compact 40055160 37508680 1.07
tpcds_q07/duckdb:vortex-compact 38110609 38211095 1.00
tpcds_q08/duckdb:vortex-compact 31599959 30562162 1.03
tpcds_q09/duckdb:vortex-compact 118095239 109911507 1.07
tpcds_q10/duckdb:vortex-compact 🚨 51122286 44780312 1.14
tpcds_q11/duckdb:vortex-compact 🚨 81467134 72747059 1.12
tpcds_q12/duckdb:vortex-compact 🚨 21949805 18759155 1.17
tpcds_q13/duckdb:vortex-compact 52584198 48686504 1.08
tpcds_q14/duckdb:vortex-compact 293397279 282482249 1.04
tpcds_q15/duckdb:vortex-compact 🚨 51809079 44695949 1.16
tpcds_q16/duckdb:vortex-compact 40696102 37280111 1.09
tpcds_q17/duckdb:vortex-compact 🚨 55878999 48820645 1.14
tpcds_q18/duckdb:vortex-compact 71220715 65551481 1.09
tpcds_q19/duckdb:vortex-compact 🚨 43725345 38865773 1.13
tpcds_q20/duckdb:vortex-compact 🚨 23157424 20427017 1.13
tpcds_q21/duckdb:vortex-compact 🚨 29733775 26821988 1.11
tpcds_q22/duckdb:vortex-compact 🚨 132023694 119281131 1.11
tpcds_q23/duckdb:vortex-compact 🚨 182689668 165834852 1.10
tpcds_q24/duckdb:vortex-compact 🚨 77118478 67261746 1.15
tpcds_q25/duckdb:vortex-compact 51699658 49058683 1.05
tpcds_q26/duckdb:vortex-compact 🚨 57274327 51735068 1.11
tpcds_q27/duckdb:vortex-compact 143573449 133347133 1.08
tpcds_q28/duckdb:vortex-compact 113165581 106561307 1.06
tpcds_q29/duckdb:vortex-compact 53242111 50268740 1.06
tpcds_q30/duckdb:vortex-compact 38270564 35808016 1.07
tpcds_q31/duckdb:vortex-compact 33543781 31493572 1.07
tpcds_q32/duckdb:vortex-compact 🚨 25847772 23446049 1.10
tpcds_q33/duckdb:vortex-compact 138066848 131534478 1.05
tpcds_q34/duckdb:vortex-compact 🚨 26741601 24253652 1.10
tpcds_q35/duckdb:vortex-compact 74366577 67689087 1.10
tpcds_q36/duckdb:vortex-compact 37523085 35044985 1.07
tpcds_q37/duckdb:vortex-compact 33539026 31218379 1.07
tpcds_q38/duckdb:vortex-compact 🚨 43158006 37444329 1.15
tpcds_q39/duckdb:vortex-compact 56575745 52817040 1.07
tpcds_q40/duckdb:vortex-compact 🚨 34693577 31044435 1.12
tpcds_q41/duckdb:vortex-compact 🚨 18924699 16439897 1.15
tpcds_q42/duckdb:vortex-compact 16396523 14991241 1.09
tpcds_q43/duckdb:vortex-compact 25885973 24256743 1.07
tpcds_q44/duckdb:vortex-compact 🚨 35436107 31548449 1.12
tpcds_q45/duckdb:vortex-compact 🚨 36507056 30898440 1.18
tpcds_q46/duckdb:vortex-compact 🚨 61922747 55360690 1.12
tpcds_q47/duckdb:vortex-compact 🚨 60368157 54000611 1.12
tpcds_q48/duckdb:vortex-compact 45457755 41378524 1.10
tpcds_q49/duckdb:vortex-compact 50924671 48737620 1.04
tpcds_q50/duckdb:vortex-compact 47347832 43457904 1.09
tpcds_q51/duckdb:vortex-compact 109908650 102201993 1.08
tpcds_q52/duckdb:vortex-compact 🚨 17176334 15258307 1.13
tpcds_q53/duckdb:vortex-compact 23877385 22097456 1.08
tpcds_q54/duckdb:vortex-compact 91767868 84227511 1.09
tpcds_q55/duckdb:vortex-compact 16080998 16841274 0.95
tpcds_q56/duckdb:vortex-compact 🚨 143901370 128773867 1.12
tpcds_q57/duckdb:vortex-compact 49739945 47928417 1.04
tpcds_q58/duckdb:vortex-compact 42385845 44915356 0.94
tpcds_q59/duckdb:vortex-compact 69629471 65895996 1.06
tpcds_q60/duckdb:vortex-compact 🚨 148771739 128247268 1.16
tpcds_q61/duckdb:vortex-compact 51752841 49294765 1.05
tpcds_q62/duckdb:vortex-compact 23917892 24638711 0.97
tpcds_q63/duckdb:vortex-compact 24585682 23136668 1.06
tpcds_q64/duckdb:vortex-compact 108180279 98559613 1.10
tpcds_q65/duckdb:vortex-compact 🚨 31858135 28091437 1.13
tpcds_q66/duckdb:vortex-compact 🚨 109415886 94578766 1.16
tpcds_q67/duckdb:vortex-compact 🚨 169890578 151504440 1.12
tpcds_q68/duckdb:vortex-compact 54308038 52427876 1.04
tpcds_q69/duckdb:vortex-compact 49247572 46549679 1.06
tpcds_q70/duckdb:vortex-compact 30719813 29233080 1.05
tpcds_q71/duckdb:vortex-compact 🚨 28570340 25380021 1.13
tpcds_q72/duckdb:vortex-compact 208169396 196392490 1.06
tpcds_q73/duckdb:vortex-compact 🚨 26041071 23268361 1.12
tpcds_q74/duckdb:vortex-compact 🚨 61258147 54815460 1.12
tpcds_q75/duckdb:vortex-compact 75648914 69769847 1.08
tpcds_q76/duckdb:vortex-compact 129700939 125627883 1.03
tpcds_q77/duckdb:vortex-compact 141058152 131059958 1.08
tpcds_q78/duckdb:vortex-compact 🚨 92752267 83966492 1.10
tpcds_q79/duckdb:vortex-compact 57407549 57157808 1.00
tpcds_q80/duckdb:vortex-compact 163194231 162520542 1.00
tpcds_q81/duckdb:vortex-compact 🚨 45125865 40689208 1.11
tpcds_q82/duckdb:vortex-compact 🚨 34579794 29224042 1.18
tpcds_q83/duckdb:vortex-compact 🚨 50494176 45196374 1.12
tpcds_q84/duckdb:vortex-compact 🚨 23282296 20881670 1.11
tpcds_q85/duckdb:vortex-compact 🚨 67021881 59832792 1.12
tpcds_q86/duckdb:vortex-compact 🚨 24632571 20850565 1.18
tpcds_q87/duckdb:vortex-compact 🚨 49396027 43445897 1.14
tpcds_q88/duckdb:vortex-compact 40786838 38809951 1.05
tpcds_q89/duckdb:vortex-compact 25271930 23005116 1.10
tpcds_q90/duckdb:vortex-compact 17857617 16361698 1.09
tpcds_q91/duckdb:vortex-compact 🚨 48625771 44120605 1.10
tpcds_q92/duckdb:vortex-compact 🚨 23307551 19919193 1.17
tpcds_q93/duckdb:vortex-compact 🚨 40863404 35589940 1.15
tpcds_q94/duckdb:vortex-compact 🚨 32716817 27760706 1.18
tpcds_q95/duckdb:vortex-compact 157893868 160210473 0.99
tpcds_q96/duckdb:vortex-compact 🚨 15455483 13419020 1.15
tpcds_q97/duckdb:vortex-compact 🚨 44711054 40366419 1.11
tpcds_q98/duckdb:vortex-compact 25211084 23446271 1.08
tpcds_q99/duckdb:vortex-compact 39069357 35919378 1.09
duckdb / parquet (1.067x ➖, 1↑ 23↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 42117186 43440855 0.97
tpcds_q02/duckdb:parquet 58114636 60326408 0.96
tpcds_q03/duckdb:parquet 11842922 11564487 1.02
tpcds_q04/duckdb:parquet 125525749 124389339 1.01
tpcds_q05/duckdb:parquet 🚀 67130724 75123131 0.89
tpcds_q06/duckdb:parquet 🚨 34942383 28292303 1.24
tpcds_q07/duckdb:parquet 22733859 23397440 0.97
tpcds_q08/duckdb:parquet 28034074 28463358 0.98
tpcds_q09/duckdb:parquet 40304262 39621827 1.02
tpcds_q10/duckdb:parquet 🚨 37273706 33585294 1.11
tpcds_q11/duckdb:parquet 96899554 89845983 1.08
tpcds_q12/duckdb:parquet 15883925 14558024 1.09
tpcds_q13/duckdb:parquet 36066653 34156580 1.06
tpcds_q14/duckdb:parquet 177650341 164194823 1.08
tpcds_q15/duckdb:parquet 31657842 30328557 1.04
tpcds_q16/duckdb:parquet 23133865 21141064 1.09
tpcds_q17/duckdb:parquet 40216882 38030433 1.06
tpcds_q18/duckdb:parquet 47542752 45809901 1.04
tpcds_q19/duckdb:parquet 🚨 32937285 28549808 1.15
tpcds_q20/duckdb:parquet 16784417 15651549 1.07
tpcds_q21/duckdb:parquet 12197388 11596616 1.05
tpcds_q22/duckdb:parquet 🚨 76218167 66996126 1.14
tpcds_q23/duckdb:parquet 122062648 114681813 1.06
tpcds_q24/duckdb:parquet 47467162 45613674 1.04
tpcds_q25/duckdb:parquet 34202131 33235461 1.03
tpcds_q26/duckdb:parquet 🚨 41458199 36973067 1.12
tpcds_q27/duckdb:parquet 93671530 88477092 1.06
tpcds_q28/duckdb:parquet 39148553 37354601 1.05
tpcds_q29/duckdb:parquet 37274154 34321461 1.09
tpcds_q30/duckdb:parquet 42851213 40027459 1.07
tpcds_q31/duckdb:parquet 🚨 26216000 22778414 1.15
tpcds_q32/duckdb:parquet 11843923 11645985 1.02
tpcds_q33/duckdb:parquet 🚨 77203654 67865831 1.14
tpcds_q34/duckdb:parquet 22038174 21022316 1.05
tpcds_q35/duckdb:parquet 🚨 66637807 58571618 1.14
tpcds_q36/duckdb:parquet 🚨 23090391 20332965 1.14
tpcds_q37/duckdb:parquet 🚨 14522778 12923791 1.12
tpcds_q38/duckdb:parquet 35055020 32524098 1.08
tpcds_q39/duckdb:parquet 32884274 31811126 1.03
tpcds_q40/duckdb:parquet 18627928 17347189 1.07
tpcds_q41/duckdb:parquet 8238622 7500639 1.10
tpcds_q42/duckdb:parquet 🚨 11514472 9828644 1.17
tpcds_q43/duckdb:parquet 16537441 15402978 1.07
tpcds_q44/duckdb:parquet 🚨 23438464 21168220 1.11
tpcds_q45/duckdb:parquet 27939941 26300671 1.06
tpcds_q46/duckdb:parquet 49043538 44628752 1.10
tpcds_q47/duckdb:parquet 48914630 46012854 1.06
tpcds_q48/duckdb:parquet 32016433 30232022 1.06
tpcds_q49/duckdb:parquet 25247094 24134853 1.05
tpcds_q50/duckdb:parquet 25989833 24443789 1.06
tpcds_q51/duckdb:parquet 100484712 94578959 1.06
tpcds_q52/duckdb:parquet 🚨 11780878 10612245 1.11
tpcds_q53/duckdb:parquet 16925461 16021946 1.06
tpcds_q54/duckdb:parquet 43603780 40360258 1.08
tpcds_q55/duckdb:parquet 11139827 10389131 1.07
tpcds_q56/duckdb:parquet 73127927 69577075 1.05
tpcds_q57/duckdb:parquet 36644791 35310182 1.04
tpcds_q58/duckdb:parquet 🚨 22824981 20673666 1.10
tpcds_q59/duckdb:parquet 36736161 36455187 1.01
tpcds_q60/duckdb:parquet 72612539 70199733 1.03
tpcds_q61/duckdb:parquet 32227857 30960202 1.04
tpcds_q62/duckdb:parquet 12828838 12434280 1.03
tpcds_q63/duckdb:parquet 15833532 15326663 1.03
tpcds_q64/duckdb:parquet 76333419 74057440 1.03
tpcds_q65/duckdb:parquet 21476263 19965352 1.08
tpcds_q66/duckdb:parquet 58993694 53972488 1.09
tpcds_q67/duckdb:parquet 🚨 148701969 133102951 1.12
tpcds_q68/duckdb:parquet 38951249 38128347 1.02
tpcds_q69/duckdb:parquet 38170546 37448539 1.02
tpcds_q70/duckdb:parquet 🚨 22300054 19344429 1.15
tpcds_q71/duckdb:parquet 19303835 18834237 1.02
tpcds_q72/duckdb:parquet 170289764 164409089 1.04
tpcds_q73/duckdb:parquet 19115859 18265389 1.05
tpcds_q74/duckdb:parquet 52455671 49602523 1.06
tpcds_q75/duckdb:parquet 57027431 53304633 1.07
tpcds_q76/duckdb:parquet 73990632 70863287 1.04
tpcds_q77/duckdb:parquet 67120195 63864548 1.05
tpcds_q78/duckdb:parquet 🚨 82365736 72996552 1.13
tpcds_q79/duckdb:parquet 🚨 30558721 27776703 1.10
tpcds_q80/duckdb:parquet 86876311 83603661 1.04
tpcds_q81/duckdb:parquet 49636563 46255731 1.07
tpcds_q82/duckdb:parquet 16272386 15440535 1.05
tpcds_q83/duckdb:parquet 16874755 15395187 1.10
tpcds_q84/duckdb:parquet 20606658 20334482 1.01
tpcds_q85/duckdb:parquet 43128654 39614002 1.09
tpcds_q86/duckdb:parquet 🚨 13289760 12054690 1.10
tpcds_q87/duckdb:parquet 🚨 40848092 36184964 1.13
tpcds_q88/duckdb:parquet 30099881 28641384 1.05
tpcds_q89/duckdb:parquet 18188761 17357174 1.05
tpcds_q90/duckdb:parquet 🚨 9063460 7889013 1.15
tpcds_q91/duckdb:parquet 23933844 24132416 0.99
tpcds_q92/duckdb:parquet 12186627 11290671 1.08
tpcds_q93/duckdb:parquet 33140804 30323332 1.09
tpcds_q94/duckdb:parquet 🚨 18204673 16033133 1.14
tpcds_q95/duckdb:parquet 140779950 143173795 0.98
tpcds_q96/duckdb:parquet 9917209 9199090 1.08
tpcds_q97/duckdb:parquet 🚨 39849211 35541812 1.12
tpcds_q98/duckdb:parquet 19287283 17608101 1.10
tpcds_q99/duckdb:parquet 21398561 19544260 1.09
duckdb / duckdb (1.083x ➖, 0↑ 34↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20888781 19981354 1.05
tpcds_q02/duckdb:duckdb 18710715 18510908 1.01
tpcds_q03/duckdb:duckdb 🚨 9203905 8211105 1.12
tpcds_q04/duckdb:duckdb 171159018 161375431 1.06
tpcds_q05/duckdb:duckdb 🚨 20715671 18547612 1.12
tpcds_q06/duckdb:duckdb 23637518 22384272 1.06
tpcds_q07/duckdb:duckdb 41743356 38028174 1.10
tpcds_q08/duckdb:duckdb 122324316 118881476 1.03
tpcds_q09/duckdb:duckdb 20496418 19635065 1.04
tpcds_q10/duckdb:duckdb 24127630 22295723 1.08
tpcds_q11/duckdb:duckdb 148960191 138284198 1.08
tpcds_q12/duckdb:duckdb 🚨 12032869 10908118 1.10
tpcds_q13/duckdb:duckdb 25171649 23510631 1.07
tpcds_q14/duckdb:duckdb 97700086 92523613 1.06
tpcds_q15/duckdb:duckdb 🚨 27159144 22854833 1.19
tpcds_q16/duckdb:duckdb 19074743 17647410 1.08
tpcds_q17/duckdb:duckdb 🚨 23765384 20801145 1.14
tpcds_q18/duckdb:duckdb 🚨 48119245 43347934 1.11
tpcds_q19/duckdb:duckdb 17306205 16163373 1.07
tpcds_q20/duckdb:duckdb 🚨 13726454 11833172 1.16
tpcds_q21/duckdb:duckdb 🚨 7287915 6395949 1.14
tpcds_q22/duckdb:duckdb 🚨 70879934 59309809 1.20
tpcds_q23/duckdb:duckdb 83686919 81122375 1.03
tpcds_q24/duckdb:duckdb 🚨 25213853 21988780 1.15
tpcds_q25/duckdb:duckdb 17375540 17093640 1.02
tpcds_q26/duckdb:duckdb 25765385 26225794 0.98
tpcds_q27/duckdb:duckdb 🚨 43304428 37654888 1.15
tpcds_q28/duckdb:duckdb 22083333 20905954 1.06
tpcds_q29/duckdb:duckdb 21734937 19969535 1.09
tpcds_q30/duckdb:duckdb 31511501 29172189 1.08
tpcds_q31/duckdb:duckdb 20966705 19738387 1.06
tpcds_q32/duckdb:duckdb 7372880 6823483 1.08
tpcds_q33/duckdb:duckdb 13335164 12784720 1.04
tpcds_q34/duckdb:duckdb 15195563 13816723 1.10
tpcds_q35/duckdb:duckdb 36087458 32949870 1.10
tpcds_q36/duckdb:duckdb 🚨 78209085 68438003 1.14
tpcds_q37/duckdb:duckdb 🚨 8220722 7465639 1.10
tpcds_q38/duckdb:duckdb 31739220 30373356 1.04
tpcds_q39/duckdb:duckdb 🚨 28131715 25010723 1.12
tpcds_q40/duckdb:duckdb 14475672 13325330 1.09
tpcds_q41/duckdb:duckdb 8574340 8603586 1.00
tpcds_q42/duckdb:duckdb 🚨 7063249 6297983 1.12
tpcds_q43/duckdb:duckdb 11988623 11170578 1.07
tpcds_q44/duckdb:duckdb 🚨 14341884 12729171 1.13
tpcds_q45/duckdb:duckdb 18043105 16746238 1.08
tpcds_q46/duckdb:duckdb 38327216 34960558 1.10
tpcds_q47/duckdb:duckdb 43943321 40974459 1.07
tpcds_q48/duckdb:duckdb 🚨 24440196 21662820 1.13
tpcds_q49/duckdb:duckdb 17339141 17718808 0.98
tpcds_q50/duckdb:duckdb 🚨 15685955 13755087 1.14
tpcds_q51/duckdb:duckdb 97316922 89953190 1.08
tpcds_q52/duckdb:duckdb 7437884 7442513 1.00
tpcds_q53/duckdb:duckdb 🚨 13342824 11340868 1.18
tpcds_q54/duckdb:duckdb 17013466 16414878 1.04
tpcds_q55/duckdb:duckdb 7316336 6676577 1.10
tpcds_q56/duckdb:duckdb 13704417 13794240 0.99
tpcds_q57/duckdb:duckdb 33120023 30465625 1.09
tpcds_q58/duckdb:duckdb 🚨 13231229 11584767 1.14
tpcds_q59/duckdb:duckdb 36534213 33977139 1.08
tpcds_q60/duckdb:duckdb 16029575 14851006 1.08
tpcds_q61/duckdb:duckdb 🚨 15198447 13575582 1.12
tpcds_q62/duckdb:duckdb 🚨 9819460 8874600 1.11
tpcds_q63/duckdb:duckdb 11208044 11032912 1.02
tpcds_q64/duckdb:duckdb 55807104 51157764 1.09
tpcds_q65/duckdb:duckdb 🚨 37423107 32276823 1.16
tpcds_q66/duckdb:duckdb 25823085 23789116 1.09
tpcds_q67/duckdb:duckdb 🚨 144723890 125032995 1.16
tpcds_q68/duckdb:duckdb 🚨 27002546 24428289 1.11
tpcds_q69/duckdb:duckdb 🚨 27047682 22792988 1.19
tpcds_q70/duckdb:duckdb 🚨 15645939 14108405 1.11
tpcds_q71/duckdb:duckdb 13399126 12524667 1.07
tpcds_q72/duckdb:duckdb 44883963 42618853 1.05
tpcds_q73/duckdb:duckdb 11122765 10709707 1.04
tpcds_q74/duckdb:duckdb 103888817 96005017 1.08
tpcds_q75/duckdb:duckdb 44701259 42609965 1.05
tpcds_q76/duckdb:duckdb 12732384 11691977 1.09
tpcds_q77/duckdb:duckdb 12101469 11462709 1.06
tpcds_q78/duckdb:duckdb 64827691 62796092 1.03
tpcds_q79/duckdb:duckdb 🚨 19609522 17300628 1.13
tpcds_q80/duckdb:duckdb 29535407 27472180 1.08
tpcds_q81/duckdb:duckdb 38669921 38335078 1.01
tpcds_q82/duckdb:duckdb 8687529 8054381 1.08
tpcds_q83/duckdb:duckdb 9421697 8891499 1.06
tpcds_q84/duckdb:duckdb 🚨 15114028 13584489 1.11
tpcds_q85/duckdb:duckdb 🚨 26681050 22962340 1.16
tpcds_q86/duckdb:duckdb 11347292 10761951 1.05
tpcds_q87/duckdb:duckdb 34867669 32985760 1.06
tpcds_q88/duckdb:duckdb 24824470 24069665 1.03
tpcds_q89/duckdb:duckdb 14029230 13134970 1.07
tpcds_q90/duckdb:duckdb 🚨 5930269 5191363 1.14
tpcds_q91/duckdb:duckdb 12676080 12165537 1.04
tpcds_q92/duckdb:duckdb 9294867 9380863 0.99
tpcds_q93/duckdb:duckdb 🚨 23900056 21041132 1.14
tpcds_q94/duckdb:duckdb 13010267 12858856 1.01
tpcds_q95/duckdb:duckdb 139513258 127214289 1.10
tpcds_q96/duckdb:duckdb 🚨 4930958 4372676 1.13
tpcds_q97/duckdb:duckdb 33225068 30629171 1.08
tpcds_q98/duckdb:duckdb 🚨 14633549 13117246 1.12
tpcds_q99/duckdb:duckdb 17053609 16703522 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -4.5% -3.3% -1.2% +16.1% ➖ noise
1 datafusion:vortex-file-compressed -2.9% -3.3% +0.4% +14.8% ➖ noise
1 duckdb:duckdb +4.5% -3.3% +8.1% +18.5% ➖ noise
1 duckdb:vortex-compact +16.2% -3.3% +20.2% +12.4% 🚨 regression
1 duckdb:vortex-file-compressed +6.5% -3.3% +10.2% +15.9% ➖ noise
2 datafusion:vortex-compact -3.3% -1.5% -1.9% +11.2% ➖ noise
2 datafusion:vortex-file-compressed -4.5% -1.5% -3.1% +12.5% ➖ noise
2 duckdb:duckdb +1.1% -1.5% +2.6% +17.4% ➖ noise
2 duckdb:vortex-compact +8.3% -1.5% +9.9% +11.2% ➖ noise
2 duckdb:vortex-file-compressed +5.7% -1.5% +7.3% +11.2% ➖ noise
3 datafusion:vortex-compact -3.7% +0.9% -4.5% +12.2% ➖ noise
3 datafusion:vortex-file-compressed -6.0% +0.9% -6.8% +12.6% ➖ noise
3 duckdb:duckdb +12.1% +0.9% +11.1% +20.2% ➖ noise
3 duckdb:vortex-compact +13.8% +0.9% +12.8% +12.9% ➖ noise
3 duckdb:vortex-file-compressed +10.6% +0.9% +9.7% +13.4% ➖ noise
4 datafusion:vortex-compact -4.4% -1.1% -3.3% +11.2% ➖ noise
4 datafusion:vortex-file-compressed -0.8% -1.1% +0.3% +11.2% ➖ noise
4 duckdb:duckdb +6.1% -1.1% +7.3% +11.2% ➖ noise
4 duckdb:vortex-compact +9.7% -1.1% +11.0% +11.2% ➖ noise
4 duckdb:vortex-file-compressed +8.9% -1.1% +10.2% +11.2% ➖ noise
5 datafusion:vortex-compact -3.8% -8.7% +5.4% +11.2% ➖ noise
5 datafusion:vortex-file-compressed +16.3% -8.7% +27.5% +26.8% 🚨 regression
5 duckdb:duckdb +11.7% -8.7% +22.4% +12.2% 🚨 regression
5 duckdb:vortex-compact +8.1% -8.7% +18.4% +11.2% 🚨 regression
5 duckdb:vortex-file-compressed +31.5% -8.7% +44.1% +18.8% 🚨 regression
6 datafusion:vortex-compact -4.2% +9.1% -12.2% +11.2% ✅ faster
6 datafusion:vortex-file-compressed +12.2% +9.1% +2.9% +21.6% ➖ noise
6 duckdb:duckdb +5.6% +9.1% -3.2% +15.5% ➖ noise
6 duckdb:vortex-compact +6.8% +9.1% -2.1% +11.2% ➖ noise
6 duckdb:vortex-file-compressed +10.2% +9.1% +1.0% +11.2% ➖ noise
7 datafusion:vortex-compact -0.2% +0.8% -1.0% +11.2% ➖ noise
7 datafusion:vortex-file-compressed -6.7% +0.8% -7.4% +11.2% ➖ noise
7 duckdb:duckdb +9.8% +0.8% +8.9% +17.3% ➖ noise
7 duckdb:vortex-compact -0.3% +0.8% -1.0% +11.2% ➖ noise
7 duckdb:vortex-file-compressed +11.4% +0.8% +10.5% +12.7% ➖ noise
8 datafusion:vortex-compact +1.8% +0.7% +1.0% +11.2% ➖ noise
8 datafusion:vortex-file-compressed -4.4% +0.7% -5.0% +11.2% ➖ noise
8 duckdb:duckdb +2.9% +0.7% +2.2% +11.2% ➖ noise
8 duckdb:vortex-compact +3.4% +0.7% +2.7% +11.2% ➖ noise
8 duckdb:vortex-file-compressed +15.4% +0.7% +14.5% +11.2% 🚨 regression
9 datafusion:vortex-compact +0.8% +2.5% -1.6% +11.2% ➖ noise
9 datafusion:vortex-file-compressed -0.4% +2.5% -2.8% +11.2% ➖ noise
9 duckdb:duckdb +4.4% +2.5% +1.8% +11.2% ➖ noise
9 duckdb:vortex-compact +7.4% +2.5% +4.8% +11.2% ➖ noise
9 duckdb:vortex-file-compressed +9.8% +2.5% +7.1% +11.2% ➖ noise
10 datafusion:vortex-compact +0.9% +5.1% -4.0% +11.2% ➖ noise
10 datafusion:vortex-file-compressed +6.9% +5.1% +1.7% +11.2% ➖ noise
10 duckdb:duckdb +8.2% +5.1% +2.9% +11.4% ➖ noise
10 duckdb:vortex-compact +14.2% +5.1% +8.6% +13.7% ➖ noise
10 duckdb:vortex-file-compressed +6.0% +5.1% +0.9% +11.2% ➖ noise
11 datafusion:vortex-compact +0.3% +4.7% -4.2% +11.2% ➖ noise
11 datafusion:vortex-file-compressed +10.7% +4.7% +5.7% +11.2% ➖ noise
11 duckdb:duckdb +7.7% +4.7% +2.9% +11.2% ➖ noise
11 duckdb:vortex-compact +12.0% +4.7% +7.0% +11.2% ➖ noise
11 duckdb:vortex-file-compressed +9.4% +4.7% +4.5% +11.2% ➖ noise
12 datafusion:vortex-compact -5.0% +10.0% -13.7% +11.2% ✅ faster
12 datafusion:vortex-file-compressed +10.5% +10.0% +0.4% +11.2% ➖ noise
12 duckdb:duckdb +10.3% +10.0% +0.2% +11.6% ➖ noise
12 duckdb:vortex-compact +17.0% +10.0% +6.3% +11.2% ➖ noise
12 duckdb:vortex-file-compressed +5.3% +10.0% -4.3% +12.3% ➖ noise
13 datafusion:vortex-compact +6.9% +2.9% +3.9% +11.2% ➖ noise
13 datafusion:vortex-file-compressed +2.7% +2.9% -0.1% +11.2% ➖ noise
13 duckdb:duckdb +7.1% +2.9% +4.1% +11.2% ➖ noise
13 duckdb:vortex-compact +8.0% +2.9% +5.0% +11.2% ➖ noise
13 duckdb:vortex-file-compressed +16.5% +2.9% +13.2% +14.3% ➖ noise
14 datafusion:vortex-compact -1.7% +0.1% -1.7% +11.2% ➖ noise
14 datafusion:vortex-file-compressed +8.3% +0.1% +8.2% +11.2% ➖ noise
14 duckdb:duckdb +5.6% +0.1% +5.5% +11.2% ➖ noise
14 duckdb:vortex-compact +3.9% +0.1% +3.8% +11.2% ➖ noise
14 duckdb:vortex-file-compressed +8.3% +0.1% +8.3% +15.9% ➖ noise
15 datafusion:vortex-compact -1.9% -1.5% -0.4% +18.5% ➖ noise
15 datafusion:vortex-file-compressed +15.5% -1.5% +17.3% +13.1% 🚨 regression
15 duckdb:duckdb +18.8% -1.5% +20.7% +12.9% 🚨 regression
15 duckdb:vortex-compact +15.9% -1.5% +17.7% +13.1% 🚨 regression
15 duckdb:vortex-file-compressed +12.2% -1.5% +13.9% +17.2% ➖ noise
16 datafusion:vortex-compact -0.1% -1.4% +1.4% +11.2% ➖ noise
16 datafusion:vortex-file-compressed +13.5% -1.4% +15.1% +11.2% 🚨 regression
16 duckdb:duckdb +8.1% -1.4% +9.6% +14.1% ➖ noise
16 duckdb:vortex-compact +9.2% -1.4% +10.7% +13.4% ➖ noise
16 duckdb:vortex-file-compressed +9.4% -1.4% +10.9% +11.2% ➖ noise
17 datafusion:vortex-compact -0.0% -0.7% +0.6% +11.2% ➖ noise
17 datafusion:vortex-file-compressed +4.8% -0.7% +5.5% +11.2% ➖ noise
17 duckdb:duckdb +14.3% -0.7% +15.0% +11.2% 🚨 regression
17 duckdb:vortex-compact +14.5% -0.7% +15.2% +11.2% 🚨 regression
17 duckdb:vortex-file-compressed +19.3% -0.7% +20.1% +11.2% 🚨 regression
18 datafusion:vortex-compact -0.1% +0.8% -0.9% +11.2% ➖ noise
18 datafusion:vortex-file-compressed -0.4% +0.8% -1.2% +11.2% ➖ noise
18 duckdb:duckdb +11.0% +0.8% +10.1% +17.4% ➖ noise
18 duckdb:vortex-compact +8.6% +0.8% +7.8% +11.2% ➖ noise
18 duckdb:vortex-file-compressed +6.4% +0.8% +5.6% +11.2% ➖ noise
19 datafusion:vortex-compact -2.0% +3.7% -5.5% +11.2% ➖ noise
19 datafusion:vortex-file-compressed +5.2% +3.7% +1.4% +11.2% ➖ noise
19 duckdb:duckdb +7.1% +3.7% +3.3% +12.0% ➖ noise
19 duckdb:vortex-compact +12.5% +3.7% +8.5% +11.2% ➖ noise
19 duckdb:vortex-file-compressed +10.1% +3.7% +6.2% +12.6% ➖ noise
20 datafusion:vortex-compact +3.1% -0.3% +3.4% +11.2% ➖ noise
20 datafusion:vortex-file-compressed +4.7% -0.3% +5.1% +11.2% ➖ noise
20 duckdb:duckdb +16.0% -0.3% +16.4% +22.3% ➖ noise
20 duckdb:vortex-compact +13.4% -0.3% +13.7% +11.9% 🚨 regression
20 duckdb:vortex-file-compressed +10.1% -0.3% +10.5% +11.2% ➖ noise
21 datafusion:vortex-compact -2.0% +0.9% -2.8% +11.2% ➖ noise
21 datafusion:vortex-file-compressed +3.8% +0.9% +2.9% +11.2% ➖ noise
21 duckdb:duckdb +13.9% +0.9% +13.0% +11.7% 🚨 regression
21 duckdb:vortex-compact +10.9% +0.9% +9.9% +18.2% ➖ noise
21 duckdb:vortex-file-compressed +11.2% +0.9% +10.2% +15.3% ➖ noise
22 datafusion:vortex-compact -1.1% -9.0% +8.7% +15.4% ➖ noise
22 datafusion:vortex-file-compressed +3.9% -9.0% +14.2% +16.8% ➖ noise
22 duckdb:duckdb +19.5% -9.0% +31.4% +15.0% 🚨 regression
22 duckdb:vortex-compact +10.7% -9.0% +21.7% +14.8% 🚨 regression
22 duckdb:vortex-file-compressed +9.4% -9.0% +20.2% +14.6% 🚨 regression
23 datafusion:vortex-compact +0.3% +0.6% -0.3% +11.2% ➖ noise
23 datafusion:vortex-file-compressed +9.7% +0.6% +9.1% +11.2% ➖ noise
23 duckdb:duckdb +3.2% +0.6% +2.6% +18.8% ➖ noise
23 duckdb:vortex-compact +10.2% +0.6% +9.6% +14.4% ➖ noise
23 duckdb:vortex-file-compressed +11.5% +0.6% +10.9% +11.2% ➖ noise
24 datafusion:vortex-compact +2.9% -6.1% +9.5% +11.2% ➖ noise
24 datafusion:vortex-file-compressed +7.1% -6.1% +14.0% +11.2% 🚨 regression
24 duckdb:duckdb +14.7% -6.1% +22.1% +11.9% 🚨 regression
24 duckdb:vortex-compact +14.7% -6.1% +22.0% +11.2% 🚨 regression
24 duckdb:vortex-file-compressed +12.4% -6.1% +19.7% +11.2% 🚨 regression
25 datafusion:vortex-compact -1.1% -5.9% +5.1% +11.2% ➖ noise
25 datafusion:vortex-file-compressed +6.2% -5.9% +12.9% +11.2% 🚨 regression
25 duckdb:duckdb +1.6% -5.9% +8.1% +11.2% ➖ noise
25 duckdb:vortex-compact +5.4% -5.9% +12.0% +11.2% 🚨 regression
25 duckdb:vortex-file-compressed +9.9% -5.9% +16.8% +11.2% 🚨 regression
26 datafusion:vortex-compact +2.6% +0.7% +1.9% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -3.3% +0.7% -4.0% +11.2% ➖ noise
26 duckdb:duckdb -1.8% +0.7% -2.5% +11.2% ➖ noise
26 duckdb:vortex-compact +10.7% +0.7% +9.9% +11.2% ➖ noise
26 duckdb:vortex-file-compressed +14.1% +0.7% +13.3% +11.2% 🚨 regression
27 datafusion:vortex-compact +0.8% -0.5% +1.3% +11.2% ➖ noise
27 datafusion:vortex-file-compressed +5.9% -0.5% +6.5% +11.2% ➖ noise
27 duckdb:duckdb +15.0% -0.5% +15.6% +16.0% ➖ noise
27 duckdb:vortex-compact +7.7% -0.5% +8.2% +11.2% ➖ noise
27 duckdb:vortex-file-compressed +10.5% -0.5% +11.0% +11.2% ➖ noise
28 datafusion:vortex-compact -0.0% -0.9% +0.9% +11.2% ➖ noise
28 datafusion:vortex-file-compressed +4.9% -0.9% +5.9% +11.2% ➖ noise
28 duckdb:duckdb +5.6% -0.9% +6.6% +11.2% ➖ noise
28 duckdb:vortex-compact +6.2% -0.9% +7.1% +11.2% ➖ noise
28 duckdb:vortex-file-compressed +12.6% -0.9% +13.6% +11.9% 🚨 regression
29 datafusion:vortex-compact +1.8% +4.4% -2.5% +11.2% ➖ noise
29 datafusion:vortex-file-compressed +1.9% +4.4% -2.4% +11.2% ➖ noise
29 duckdb:duckdb +8.8% +4.4% +4.2% +11.2% ➖ noise
29 duckdb:vortex-compact +5.9% +4.4% +1.4% +11.2% ➖ noise
29 duckdb:vortex-file-compressed +8.5% +4.4% +3.9% +11.2% ➖ noise
30 datafusion:vortex-compact -2.9% +0.0% -2.9% +12.2% ➖ noise
30 datafusion:vortex-file-compressed -3.4% +0.0% -3.4% +11.9% ➖ noise
30 duckdb:duckdb +8.0% +0.0% +8.0% +11.2% ➖ noise
30 duckdb:vortex-compact +6.9% +0.0% +6.9% +11.2% ➖ noise
30 duckdb:vortex-file-compressed +9.1% +0.0% +9.1% +11.2% ➖ noise
31 datafusion:vortex-compact -0.1% +6.8% -6.5% +11.2% ➖ noise
31 datafusion:vortex-file-compressed +6.6% +6.8% -0.2% +11.2% ➖ noise
31 duckdb:duckdb +6.2% +6.8% -0.6% +11.2% ➖ noise
31 duckdb:vortex-compact +6.5% +6.8% -0.3% +11.2% ➖ noise
31 duckdb:vortex-file-compressed +8.9% +6.8% +1.9% +11.2% ➖ noise
32 datafusion:vortex-compact -3.2% -2.3% -0.9% +11.2% ➖ noise
32 datafusion:vortex-file-compressed +7.9% -2.3% +10.5% +14.7% ➖ noise
32 duckdb:duckdb +8.1% -2.3% +10.6% +12.8% ➖ noise
32 duckdb:vortex-compact +10.2% -2.3% +12.9% +11.2% 🚨 regression
32 duckdb:vortex-file-compressed +10.7% -2.3% +13.4% +28.8% ➖ noise
33 datafusion:vortex-compact -0.5% +7.4% -7.3% +11.2% ➖ noise
33 datafusion:vortex-file-compressed -2.4% +7.4% -9.1% +11.2% ➖ noise
33 duckdb:duckdb +4.3% +7.4% -2.9% +11.2% ➖ noise
33 duckdb:vortex-compact +5.0% +7.4% -2.3% +11.2% ➖ noise
33 duckdb:vortex-file-compressed +14.5% +7.4% +6.6% +11.5% ➖ noise
34 datafusion:vortex-compact +2.1% +1.3% +0.7% +11.2% ➖ noise
34 datafusion:vortex-file-compressed +9.8% +1.3% +8.4% +11.2% ➖ noise
34 duckdb:duckdb +10.0% +1.3% +8.5% +11.2% ➖ noise
34 duckdb:vortex-compact +10.3% +1.3% +8.8% +11.2% ➖ noise
34 duckdb:vortex-file-compressed +7.7% +1.3% +6.3% +11.2% ➖ noise
35 datafusion:vortex-compact +2.5% +1.4% +1.1% +11.2% ➖ noise
35 datafusion:vortex-file-compressed +1.7% +1.4% +0.2% +11.2% ➖ noise
35 duckdb:duckdb +9.5% +1.4% +8.0% +15.9% ➖ noise
35 duckdb:vortex-compact +9.9% +1.4% +8.3% +12.1% ➖ noise
35 duckdb:vortex-file-compressed +14.9% +1.4% +13.2% +12.3% 🚨 regression
36 datafusion:vortex-compact -4.4% +3.1% -7.2% +11.2% ➖ noise
36 datafusion:vortex-file-compressed +7.1% +3.1% +4.0% +11.2% ➖ noise
36 duckdb:duckdb +14.3% +3.1% +10.9% +11.2% ➖ noise
36 duckdb:vortex-compact +7.1% +3.1% +3.9% +11.9% ➖ noise
36 duckdb:vortex-file-compressed +9.5% +3.1% +6.3% +11.5% ➖ noise
37 datafusion:vortex-compact +0.7% +0.2% +0.5% +11.2% ➖ noise
37 datafusion:vortex-file-compressed +13.7% +0.2% +13.5% +11.5% 🚨 regression
37 duckdb:duckdb +10.1% +0.2% +9.9% +13.3% ➖ noise
37 duckdb:vortex-compact +7.4% +0.2% +7.2% +12.1% ➖ noise
37 duckdb:vortex-file-compressed +14.0% +0.2% +13.8% +17.7% ➖ noise
38 datafusion:vortex-compact +0.6% -3.3% +4.1% +11.2% ➖ noise
38 datafusion:vortex-file-compressed +0.5% -3.3% +3.9% +11.2% ➖ noise
38 duckdb:duckdb +4.5% -3.3% +8.1% +11.2% ➖ noise
38 duckdb:vortex-compact +15.3% -3.3% +19.2% +14.6% 🚨 regression
38 duckdb:vortex-file-compressed +7.1% -3.3% +10.7% +14.5% ➖ noise
39 datafusion:vortex-compact -3.8% +0.5% -4.3% +12.0% ➖ noise
39 datafusion:vortex-file-compressed +6.9% +0.5% +6.4% +11.4% ➖ noise
39 duckdb:duckdb +12.5% +0.5% +11.9% +15.6% ➖ noise
39 duckdb:vortex-compact +7.1% +0.5% +6.6% +16.3% ➖ noise
39 duckdb:vortex-file-compressed +19.4% +0.5% +18.8% +16.1% 🚨 regression
40 datafusion:vortex-compact +3.5% -1.0% +4.6% +11.2% ➖ noise
40 datafusion:vortex-file-compressed +6.1% -1.0% +7.2% +11.2% ➖ noise
40 duckdb:duckdb +8.6% -1.0% +9.8% +11.2% ➖ noise
40 duckdb:vortex-compact +11.8% -1.0% +12.9% +13.9% ➖ noise
40 duckdb:vortex-file-compressed +19.3% -1.0% +20.6% +13.2% 🚨 regression
41 datafusion:vortex-compact +1.4% +0.7% +0.7% +11.5% ➖ noise
41 datafusion:vortex-file-compressed -1.4% +0.7% -2.1% +12.8% ➖ noise
41 duckdb:duckdb -0.3% +0.7% -1.1% +11.2% ➖ noise
41 duckdb:vortex-compact +15.1% +0.7% +14.3% +11.2% 🚨 regression
41 duckdb:vortex-file-compressed +14.8% +0.7% +13.9% +11.2% 🚨 regression
42 datafusion:vortex-compact -6.8% +6.2% -12.3% +11.2% ✅ faster
42 datafusion:vortex-file-compressed -0.9% +6.2% -6.7% +11.2% ➖ noise
42 duckdb:duckdb +12.2% +6.2% +5.6% +16.5% ➖ noise
42 duckdb:vortex-compact +9.4% +6.2% +2.9% +12.6% ➖ noise
42 duckdb:vortex-file-compressed +13.1% +6.2% +6.5% +11.2% ➖ noise
43 datafusion:vortex-compact -0.5% +4.3% -4.6% +11.2% ➖ noise
43 datafusion:vortex-file-compressed +9.2% +4.3% +4.7% +11.5% ➖ noise
43 duckdb:duckdb +7.3% +4.3% +2.9% +11.2% ➖ noise
43 duckdb:vortex-compact +6.7% +4.3% +2.3% +11.2% ➖ noise
43 duckdb:vortex-file-compressed +11.9% +4.3% +7.2% +11.2% ➖ noise
44 datafusion:vortex-compact +0.5% +3.3% -2.7% +11.2% ➖ noise
44 datafusion:vortex-file-compressed +2.1% +3.3% -1.2% +11.2% ➖ noise
44 duckdb:duckdb +12.7% +3.3% +9.1% +18.9% ➖ noise
44 duckdb:vortex-compact +12.3% +3.3% +8.7% +11.2% ➖ noise
44 duckdb:vortex-file-compressed +11.5% +3.3% +8.0% +11.2% ➖ noise
45 datafusion:vortex-compact -1.6% -0.8% -0.8% +11.2% ➖ noise
45 datafusion:vortex-file-compressed +4.3% -0.8% +5.2% +11.2% ➖ noise
45 duckdb:duckdb +7.7% -0.8% +8.6% +11.3% ➖ noise
45 duckdb:vortex-compact +18.2% -0.8% +19.1% +11.2% 🚨 regression
45 duckdb:vortex-file-compressed +11.9% -0.8% +12.8% +11.2% 🚨 regression
46 datafusion:vortex-compact -2.9% +1.3% -4.1% +11.2% ➖ noise
46 datafusion:vortex-file-compressed +5.2% +1.3% +3.9% +11.2% ➖ noise
46 duckdb:duckdb +9.6% +1.3% +8.3% +11.2% ➖ noise
46 duckdb:vortex-compact +11.9% +1.3% +10.5% +11.2% ➖ noise
46 duckdb:vortex-file-compressed +8.8% +1.3% +7.4% +11.2% ➖ noise
47 datafusion:vortex-compact -1.0% +0.1% -1.0% +11.2% ➖ noise
47 datafusion:vortex-file-compressed +4.3% +0.1% +4.3% +11.2% ➖ noise
47 duckdb:duckdb +7.2% +0.1% +7.2% +11.2% ➖ noise
47 duckdb:vortex-compact +11.8% +0.1% +11.7% +11.2% 🚨 regression
47 duckdb:vortex-file-compressed +15.3% +0.1% +15.2% +11.2% 🚨 regression
48 datafusion:vortex-compact +1.2% +1.8% -0.6% +11.2% ➖ noise
48 datafusion:vortex-file-compressed +5.7% +1.8% +3.9% +11.2% ➖ noise
48 duckdb:duckdb +12.8% +1.8% +10.8% +11.2% ➖ noise
48 duckdb:vortex-compact +9.9% +1.8% +7.9% +11.2% ➖ noise
48 duckdb:vortex-file-compressed +9.6% +1.8% +7.6% +11.2% ➖ noise
49 datafusion:vortex-compact -1.0% +0.3% -1.3% +11.2% ➖ noise
49 datafusion:vortex-file-compressed +1.6% +0.3% +1.4% +11.2% ➖ noise
49 duckdb:duckdb -2.1% +0.3% -2.4% +12.9% ➖ noise
49 duckdb:vortex-compact +4.5% +0.3% +4.2% +11.2% ➖ noise
49 duckdb:vortex-file-compressed +6.6% +0.3% +6.4% +12.9% ➖ noise
50 datafusion:vortex-compact -1.3% +3.0% -4.2% +11.2% ➖ noise
50 datafusion:vortex-file-compressed -5.7% +3.0% -8.4% +11.2% ➖ noise
50 duckdb:duckdb +14.0% +3.0% +10.7% +19.7% ➖ noise
50 duckdb:vortex-compact +9.0% +3.0% +5.8% +11.2% ➖ noise
50 duckdb:vortex-file-compressed +10.2% +3.0% +7.0% +11.2% ➖ noise
51 datafusion:vortex-compact +0.6% +3.1% -2.4% +11.2% ➖ noise
51 datafusion:vortex-file-compressed +4.1% +3.1% +1.0% +11.2% ➖ noise
51 duckdb:duckdb +8.2% +3.1% +4.9% +17.7% ➖ noise
51 duckdb:vortex-compact +7.5% +3.1% +4.3% +18.1% ➖ noise
51 duckdb:vortex-file-compressed +6.8% +3.1% +3.6% +11.2% ➖ noise
52 datafusion:vortex-compact -6.5% +0.9% -7.3% +13.0% ➖ noise
52 datafusion:vortex-file-compressed -5.8% +0.9% -6.7% +25.5% ➖ noise
52 duckdb:duckdb -0.1% +0.9% -0.9% +15.5% ➖ noise
52 duckdb:vortex-compact +12.6% +0.9% +11.6% +17.4% ➖ noise
52 duckdb:vortex-file-compressed +16.3% +0.9% +15.3% +17.6% ➖ noise
53 datafusion:vortex-compact +0.4% -2.9% +3.4% +12.3% ➖ noise
53 datafusion:vortex-file-compressed +6.2% -2.9% +9.3% +11.2% ➖ noise
53 duckdb:duckdb +17.7% -2.9% +21.2% +11.4% 🚨 regression
53 duckdb:vortex-compact +8.1% -2.9% +11.3% +11.2% 🚨 regression
53 duckdb:vortex-file-compressed +11.5% -2.9% +14.8% +11.9% 🚨 regression
54 datafusion:vortex-compact -2.8% +2.9% -5.5% +12.8% ➖ noise
54 datafusion:vortex-file-compressed +7.9% +2.9% +4.9% +11.2% ➖ noise
54 duckdb:duckdb +3.6% +2.9% +0.7% +11.6% ➖ noise
54 duckdb:vortex-compact +9.0% +2.9% +5.9% +11.2% ➖ noise
54 duckdb:vortex-file-compressed +11.6% +2.9% +8.5% +13.7% ➖ noise
55 datafusion:vortex-compact +3.8% +0.0% +3.7% +12.0% ➖ noise
55 datafusion:vortex-file-compressed +5.9% +0.0% +5.9% +22.3% ➖ noise
55 duckdb:duckdb +9.6% +0.0% +9.5% +18.5% ➖ noise
55 duckdb:vortex-compact -4.5% +0.0% -4.6% +31.8% ➖ noise
55 duckdb:vortex-file-compressed +5.7% +0.0% +5.6% +11.5% ➖ noise
56 datafusion:vortex-compact -1.8% +0.9% -2.7% +11.2% ➖ noise
56 datafusion:vortex-file-compressed +6.7% +0.9% +5.7% +11.2% ➖ noise
56 duckdb:duckdb -0.7% +0.9% -1.6% +13.0% ➖ noise
56 duckdb:vortex-compact +11.7% +0.9% +10.7% +11.2% ➖ noise
56 duckdb:vortex-file-compressed +9.6% +0.9% +8.6% +13.3% ➖ noise
57 datafusion:vortex-compact +1.1% -0.1% +1.2% +11.2% ➖ noise
57 datafusion:vortex-file-compressed +8.7% -0.1% +8.8% +11.2% ➖ noise
57 duckdb:duckdb +8.7% -0.1% +8.8% +15.7% ➖ noise
57 duckdb:vortex-compact +3.8% -0.1% +3.9% +15.5% ➖ noise
57 duckdb:vortex-file-compressed +9.6% -0.1% +9.7% +17.1% ➖ noise
58 datafusion:vortex-compact -2.6% +0.3% -2.9% +11.2% ➖ noise
58 datafusion:vortex-file-compressed +12.4% +0.3% +12.1% +11.2% 🚨 regression
58 duckdb:duckdb +14.2% +0.3% +13.9% +16.7% ➖ noise
58 duckdb:vortex-compact -5.6% +0.3% -5.9% +13.4% ➖ noise
58 duckdb:vortex-file-compressed +15.0% +0.3% +14.7% +14.9% ➖ noise
59 datafusion:vortex-compact +2.1% -5.7% +8.2% +11.2% ➖ noise
59 datafusion:vortex-file-compressed +11.0% -5.7% +17.7% +11.2% 🚨 regression
59 duckdb:duckdb +7.5% -5.7% +14.0% +11.2% 🚨 regression
59 duckdb:vortex-compact +5.7% -5.7% +12.1% +11.2% 🚨 regression
59 duckdb:vortex-file-compressed +5.9% -5.7% +12.3% +11.2% 🚨 regression
60 datafusion:vortex-compact +1.6% -0.9% +2.6% +11.2% ➖ noise
60 datafusion:vortex-file-compressed +7.9% -0.9% +8.9% +11.2% ➖ noise
60 duckdb:duckdb +7.9% -0.9% +8.9% +12.9% ➖ noise
60 duckdb:vortex-compact +16.0% -0.9% +17.1% +11.2% 🚨 regression
60 duckdb:vortex-file-compressed +12.0% -0.9% +13.0% +11.9% 🚨 regression
61 datafusion:vortex-compact +1.1% -3.0% +4.2% +11.2% ➖ noise
61 datafusion:vortex-file-compressed +11.6% -3.0% +15.1% +11.2% 🚨 regression
61 duckdb:duckdb +12.0% -3.0% +15.4% +11.2% 🚨 regression
61 duckdb:vortex-compact +5.0% -3.0% +8.2% +11.2% ➖ noise
61 duckdb:vortex-file-compressed +12.4% -3.0% +15.9% +11.2% 🚨 regression
62 datafusion:vortex-compact +6.0% -8.3% +15.6% +14.6% 🚨 regression
62 datafusion:vortex-file-compressed +15.0% -8.3% +25.4% +15.6% 🚨 regression
62 duckdb:duckdb +10.6% -8.3% +20.6% +20.1% 🚨 regression
62 duckdb:vortex-compact -2.9% -8.3% +5.8% +31.4% ➖ noise
62 duckdb:vortex-file-compressed +10.8% -8.3% +20.8% +21.3% ➖ noise
63 datafusion:vortex-compact +1.8% +1.2% +0.5% +11.2% ➖ noise
63 datafusion:vortex-file-compressed +9.3% +1.2% +8.0% +11.2% ➖ noise
63 duckdb:duckdb +1.6% +1.2% +0.4% +11.6% ➖ noise
63 duckdb:vortex-compact +6.3% +1.2% +5.0% +11.2% ➖ noise
63 duckdb:vortex-file-compressed +8.8% +1.2% +7.5% +11.2% ➖ noise
64 datafusion:vortex-compact -0.8% -2.2% +1.4% +11.2% ➖ noise
64 datafusion:vortex-file-compressed +10.8% -2.2% +13.3% +11.2% 🚨 regression
64 duckdb:duckdb +9.1% -2.2% +11.5% +11.2% 🚨 regression
64 duckdb:vortex-compact +9.8% -2.2% +12.2% +11.2% 🚨 regression
64 duckdb:vortex-file-compressed +11.3% -2.2% +13.8% +11.2% 🚨 regression
65 datafusion:vortex-compact -2.2% -3.0% +0.8% +11.2% ➖ noise
65 datafusion:vortex-file-compressed +10.4% -3.0% +13.9% +11.2% 🚨 regression
65 duckdb:duckdb +15.9% -3.0% +19.5% +15.6% 🚨 regression
65 duckdb:vortex-compact +13.4% -3.0% +16.9% +11.2% 🚨 regression
65 duckdb:vortex-file-compressed +13.5% -3.0% +17.1% +13.8% 🚨 regression
66 datafusion:vortex-compact -0.6% -4.6% +4.2% +11.2% ➖ noise
66 datafusion:vortex-file-compressed +8.3% -4.6% +13.5% +13.8% ➖ noise
66 duckdb:duckdb +8.5% -4.6% +13.7% +11.6% 🚨 regression
66 duckdb:vortex-compact +15.7% -4.6% +21.2% +13.2% 🚨 regression
66 duckdb:vortex-file-compressed +12.2% -4.6% +17.6% +18.1% ➖ noise
67 datafusion:vortex-compact +5.8% +0.7% +5.1% +11.2% ➖ noise
67 datafusion:vortex-file-compressed -0.3% +0.7% -1.0% +11.2% ➖ noise
67 duckdb:duckdb +15.7% +0.7% +14.9% +11.2% 🚨 regression
67 duckdb:vortex-compact +12.1% +0.7% +11.3% +11.2% 🚨 regression
67 duckdb:vortex-file-compressed +9.9% +0.7% +9.1% +11.2% ➖ noise
68 datafusion:vortex-compact +0.9% -2.7% +3.8% +11.2% ➖ noise
68 datafusion:vortex-file-compressed +11.6% -2.7% +14.7% +11.2% 🚨 regression
68 duckdb:duckdb +10.5% -2.7% +13.6% +11.8% 🚨 regression
68 duckdb:vortex-compact +3.6% -2.7% +6.5% +11.2% ➖ noise
68 duckdb:vortex-file-compressed +11.9% -2.7% +15.1% +11.2% 🚨 regression
69 datafusion:vortex-compact -0.1% -13.0% +14.8% +11.2% 🚨 regression
69 datafusion:vortex-file-compressed +8.8% -13.0% +25.0% +11.2% 🚨 regression
69 duckdb:duckdb +18.7% -13.0% +36.3% +11.6% 🚨 regression
69 duckdb:vortex-compact +5.8% -13.0% +21.6% +11.2% 🚨 regression
69 duckdb:vortex-file-compressed +12.3% -13.0% +29.0% +11.2% 🚨 regression
70 datafusion:vortex-compact -3.3% -1.3% -2.1% +11.2% ➖ noise
70 datafusion:vortex-file-compressed +1.5% -1.3% +2.8% +12.4% ➖ noise
70 duckdb:duckdb +10.9% -1.3% +12.3% +13.5% ➖ noise
70 duckdb:vortex-compact +5.1% -1.3% +6.4% +13.0% ➖ noise
70 duckdb:vortex-file-compressed +6.4% -1.3% +7.8% +14.0% ➖ noise
71 datafusion:vortex-compact -4.0% -3.5% -0.5% +11.2% ➖ noise
71 datafusion:vortex-file-compressed +12.7% -3.5% +16.8% +11.2% 🚨 regression
71 duckdb:duckdb +7.0% -3.5% +10.9% +13.5% ➖ noise
71 duckdb:vortex-compact +12.6% -3.5% +16.7% +12.0% 🚨 regression
71 duckdb:vortex-file-compressed +10.6% -3.5% +14.7% +11.2% 🚨 regression
72 datafusion:vortex-compact -0.0% -5.2% +5.4% +11.2% ➖ noise
72 datafusion:vortex-file-compressed +18.2% -5.2% +24.6% +11.2% 🚨 regression
72 duckdb:duckdb +5.3% -5.2% +11.1% +14.2% ➖ noise
72 duckdb:vortex-compact +6.0% -5.2% +11.8% +11.2% 🚨 regression
72 duckdb:vortex-file-compressed +4.5% -5.2% +10.2% +11.2% ➖ noise
73 datafusion:vortex-compact -1.1% -5.0% +4.1% +21.9% ➖ noise
73 datafusion:vortex-file-compressed -1.3% -5.0% +3.9% +22.6% ➖ noise
73 duckdb:duckdb +3.9% -5.0% +9.3% +13.1% ➖ noise
73 duckdb:vortex-compact +11.9% -5.0% +17.8% +12.3% 🚨 regression
73 duckdb:vortex-file-compressed +10.0% -5.0% +15.8% +11.2% 🚨 regression
74 datafusion:vortex-compact -2.1% -6.4% +4.7% +11.2% ➖ noise
74 datafusion:vortex-file-compressed +6.2% -6.4% +13.5% +11.2% 🚨 regression
74 duckdb:duckdb +8.2% -6.4% +15.7% +11.2% 🚨 regression
74 duckdb:vortex-compact +11.8% -6.4% +19.5% +11.2% 🚨 regression
74 duckdb:vortex-file-compressed +12.1% -6.4% +19.8% +11.3% 🚨 regression
75 datafusion:vortex-compact -1.1% -7.3% +6.7% +11.2% ➖ noise
75 datafusion:vortex-file-compressed +2.2% -7.3% +10.2% +11.2% ➖ noise
75 duckdb:duckdb +4.9% -7.3% +13.2% +11.7% 🚨 regression
75 duckdb:vortex-compact +8.4% -7.3% +16.9% +11.2% 🚨 regression
75 duckdb:vortex-file-compressed +8.5% -7.3% +17.1% +11.2% 🚨 regression
76 datafusion:vortex-compact -1.0% -1.0% +0.0% +11.2% ➖ noise
76 datafusion:vortex-file-compressed -1.0% -1.0% +0.0% +15.8% ➖ noise
76 duckdb:duckdb +8.9% -1.0% +10.0% +15.8% ➖ noise
76 duckdb:vortex-compact +3.2% -1.0% +4.3% +11.6% ➖ noise
76 duckdb:vortex-file-compressed +19.8% -1.0% +21.0% +21.0% ➖ noise
77 datafusion:vortex-compact -1.7% -3.9% +2.2% +11.2% ➖ noise
77 datafusion:vortex-file-compressed +3.2% -3.9% +7.4% +11.2% ➖ noise
77 duckdb:duckdb +5.6% -3.9% +9.8% +15.6% ➖ noise
77 duckdb:vortex-compact +7.6% -3.9% +12.0% +11.7% 🚨 regression
77 duckdb:vortex-file-compressed +7.0% -3.9% +11.3% +13.0% ➖ noise
78 datafusion:vortex-compact +0.5% +4.1% -3.4% +11.2% ➖ noise
78 datafusion:vortex-file-compressed +3.2% +4.1% -0.8% +11.2% ➖ noise
78 duckdb:duckdb +3.2% +4.1% -0.8% +11.2% ➖ noise
78 duckdb:vortex-compact +10.5% +4.1% +6.1% +11.2% ➖ noise
78 duckdb:vortex-file-compressed +11.8% +4.1% +7.5% +11.2% ➖ noise
79 datafusion:vortex-compact +3.3% +4.8% -1.4% +11.2% ➖ noise
79 datafusion:vortex-file-compressed -1.1% +4.8% -5.6% +11.2% ➖ noise
79 duckdb:duckdb +13.3% +4.8% +8.2% +11.2% ➖ noise
79 duckdb:vortex-compact +0.4% +4.8% -4.1% +11.9% ➖ noise
79 duckdb:vortex-file-compressed +7.2% +4.8% +2.3% +11.2% ➖ noise
80 datafusion:vortex-compact +3.2% +1.1% +2.0% +11.2% ➖ noise
80 datafusion:vortex-file-compressed -0.6% +1.1% -1.7% +11.2% ➖ noise
80 duckdb:duckdb +7.5% +1.1% +6.3% +11.2% ➖ noise
80 duckdb:vortex-compact +0.4% +1.1% -0.7% +13.3% ➖ noise
80 duckdb:vortex-file-compressed +16.5% +1.1% +15.2% +11.2% 🚨 regression
81 datafusion:vortex-compact +1.3% +3.2% -1.9% +11.9% ➖ noise
81 datafusion:vortex-file-compressed -0.0% +3.2% -3.1% +16.3% ➖ noise
81 duckdb:duckdb +0.9% +3.2% -2.3% +11.6% ➖ noise
81 duckdb:vortex-compact +10.9% +3.2% +7.4% +11.2% ➖ noise
81 duckdb:vortex-file-compressed +16.3% +3.2% +12.6% +13.3% ➖ noise
82 datafusion:vortex-compact +4.1% +4.1% -0.0% +11.2% ➖ noise
82 datafusion:vortex-file-compressed +3.9% +4.1% -0.1% +11.2% ➖ noise
82 duckdb:duckdb +7.9% +4.1% +3.6% +12.9% ➖ noise
82 duckdb:vortex-compact +18.3% +4.1% +13.7% +16.4% ➖ noise
82 duckdb:vortex-file-compressed +11.2% +4.1% +6.8% +13.8% ➖ noise
83 datafusion:vortex-compact +0.2% +4.2% -3.9% +11.2% ➖ noise
83 datafusion:vortex-file-compressed -1.6% +4.2% -5.5% +11.2% ➖ noise
83 duckdb:duckdb +6.0% +4.2% +1.7% +41.5% ➖ noise
83 duckdb:vortex-compact +11.7% +4.2% +7.2% +11.2% ➖ noise
83 duckdb:vortex-file-compressed +11.0% +4.2% +6.5% +11.2% ➖ noise
84 datafusion:vortex-compact +3.0% -1.2% +4.2% +11.2% ➖ noise
84 datafusion:vortex-file-compressed -0.5% -1.2% +0.6% +11.7% ➖ noise
84 duckdb:duckdb +11.3% -1.2% +12.6% +13.8% ➖ noise
84 duckdb:vortex-compact +11.5% -1.2% +12.8% +11.2% 🚨 regression
84 duckdb:vortex-file-compressed +17.3% -1.2% +18.7% +11.2% 🚨 regression
85 datafusion:vortex-compact +0.8% +2.8% -1.9% +11.2% ➖ noise
85 datafusion:vortex-file-compressed -2.1% +2.8% -4.8% +11.2% ➖ noise
85 duckdb:duckdb +16.2% +2.8% +13.0% +11.2% 🚨 regression
85 duckdb:vortex-compact +12.0% +2.8% +9.0% +11.2% ➖ noise
85 duckdb:vortex-file-compressed +12.5% +2.8% +9.5% +11.2% ➖ noise
86 datafusion:vortex-compact +0.5% +3.6% -3.0% +12.2% ➖ noise
86 datafusion:vortex-file-compressed -5.9% +3.6% -9.2% +13.4% ➖ noise
86 duckdb:duckdb +5.4% +3.6% +1.7% +13.8% ➖ noise
86 duckdb:vortex-compact +18.1% +3.6% +14.0% +28.1% ➖ noise
86 duckdb:vortex-file-compressed -5.7% +3.6% -9.1% +15.6% ➖ noise
87 datafusion:vortex-compact -0.6% +7.1% -7.2% +11.2% ➖ noise
87 datafusion:vortex-file-compressed -2.6% +7.1% -9.0% +11.2% ➖ noise
87 duckdb:duckdb +5.7% +7.1% -1.3% +14.3% ➖ noise
87 duckdb:vortex-compact +13.7% +7.1% +6.2% +12.7% ➖ noise
87 duckdb:vortex-file-compressed +6.6% +7.1% -0.5% +14.4% ➖ noise
88 datafusion:vortex-compact -0.9% +1.7% -2.5% +11.2% ➖ noise
88 datafusion:vortex-file-compressed -1.5% +1.7% -3.2% +11.2% ➖ noise
88 duckdb:duckdb +3.1% +1.7% +1.4% +11.2% ➖ noise
88 duckdb:vortex-compact +5.1% +1.7% +3.4% +11.2% ➖ noise
88 duckdb:vortex-file-compressed +7.5% +1.7% +5.8% +11.2% ➖ noise
89 datafusion:vortex-compact -0.1% +1.5% -1.6% +11.8% ➖ noise
89 datafusion:vortex-file-compressed -4.9% +1.5% -6.3% +12.9% ➖ noise
89 duckdb:duckdb +6.8% +1.5% +5.2% +11.2% ➖ noise
89 duckdb:vortex-compact +9.9% +1.5% +8.2% +11.2% ➖ noise
89 duckdb:vortex-file-compressed +21.8% +1.5% +20.0% +15.9% 🚨 regression
90 datafusion:vortex-compact -1.5% +8.3% -9.1% +11.2% ➖ noise
90 datafusion:vortex-file-compressed -11.2% +8.3% -18.0% +11.2% ✅ faster
90 duckdb:duckdb +14.2% +8.3% +5.4% +12.5% ➖ noise
90 duckdb:vortex-compact +9.1% +8.3% +0.7% +11.2% ➖ noise
90 duckdb:vortex-file-compressed +13.8% +8.3% +5.0% +11.2% ➖ noise
91 datafusion:vortex-compact +2.0% -4.3% +6.5% +11.2% ➖ noise
91 datafusion:vortex-file-compressed -7.2% -4.3% -3.0% +11.2% ➖ noise
91 duckdb:duckdb +4.2% -4.3% +8.9% +11.2% ➖ noise
91 duckdb:vortex-compact +10.2% -4.3% +15.2% +11.2% 🚨 regression
91 duckdb:vortex-file-compressed +12.7% -4.3% +17.8% +11.2% 🚨 regression
92 datafusion:vortex-compact +2.8% +2.3% +0.5% +11.2% ➖ noise
92 datafusion:vortex-file-compressed -9.4% +2.3% -11.5% +11.2% ✅ faster
92 duckdb:duckdb -0.9% +2.3% -3.2% +16.8% ➖ noise
92 duckdb:vortex-compact +17.0% +2.3% +14.4% +18.9% ➖ noise
92 duckdb:vortex-file-compressed +12.3% +2.3% +9.8% +11.9% ➖ noise
93 datafusion:vortex-compact -2.8% +2.0% -4.8% +11.2% ➖ noise
93 datafusion:vortex-file-compressed -8.6% +2.0% -10.4% +11.2% ✅ faster
93 duckdb:duckdb +13.6% +2.0% +11.3% +16.4% ➖ noise
93 duckdb:vortex-compact +14.8% +2.0% +12.5% +11.6% 🚨 regression
93 duckdb:vortex-file-compressed +20.7% +2.0% +18.2% +12.7% 🚨 regression
94 datafusion:vortex-compact +0.1% +6.5% -6.1% +11.2% ➖ noise
94 datafusion:vortex-file-compressed -2.9% +6.5% -8.9% +15.6% ➖ noise
94 duckdb:duckdb +1.2% +6.5% -5.0% +11.8% ➖ noise
94 duckdb:vortex-compact +17.9% +6.5% +10.6% +17.6% ➖ noise
94 duckdb:vortex-file-compressed +14.9% +6.5% +7.8% +11.2% ➖ noise
95 datafusion:vortex-compact +3.3% -1.0% +4.3% +11.6% ➖ noise
95 datafusion:vortex-file-compressed -14.5% -1.0% -13.7% +11.2% ✅ faster
95 duckdb:duckdb +9.7% -1.0% +10.7% +20.9% ➖ noise
95 duckdb:vortex-compact -1.4% -1.0% -0.5% +17.4% ➖ noise
95 duckdb:vortex-file-compressed +1.7% -1.0% +2.7% +12.3% ➖ noise
96 datafusion:vortex-compact +1.6% +3.4% -1.7% +11.2% ➖ noise
96 datafusion:vortex-file-compressed -16.9% +3.4% -19.7% +11.5% ✅ faster
96 duckdb:duckdb +12.8% +3.4% +9.1% +15.2% ➖ noise
96 duckdb:vortex-compact +15.2% +3.4% +11.4% +12.4% ➖ noise
96 duckdb:vortex-file-compressed +6.0% +3.4% +2.5% +15.5% ➖ noise
97 datafusion:vortex-compact +1.6% +6.7% -4.8% +11.2% ➖ noise
97 datafusion:vortex-file-compressed -22.8% +6.7% -27.7% +11.2% ✅ faster
97 duckdb:duckdb +8.5% +6.7% +1.6% +11.2% ➖ noise
97 duckdb:vortex-compact +10.8% +6.7% +3.8% +15.4% ➖ noise
97 duckdb:vortex-file-compressed +8.5% +6.7% +1.6% +11.7% ➖ noise
98 datafusion:vortex-compact +1.5% +2.5% -1.0% +11.2% ➖ noise
98 datafusion:vortex-file-compressed -19.1% +2.5% -21.1% +11.9% ✅ faster
98 duckdb:duckdb +11.6% +2.5% +8.8% +13.6% ➖ noise
98 duckdb:vortex-compact +7.5% +2.5% +4.9% +14.7% ➖ noise
98 duckdb:vortex-file-compressed +16.9% +2.5% +14.0% +13.0% 🚨 regression
99 datafusion:vortex-compact +0.3% +3.9% -3.5% +17.3% ➖ noise
99 datafusion:vortex-file-compressed -19.9% +3.9% -22.9% +19.7% ✅ faster
99 duckdb:duckdb +2.1% +3.9% -1.7% +21.5% ➖ noise
99 duckdb:vortex-compact +8.8% +3.9% +4.7% +41.4% ➖ noise
99 duckdb:vortex-file-compressed +6.3% +3.9% +2.3% +28.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.958x ➖
Shifts: Parquet (control) -4.2% · Median polish -2.2%


datafusion / vortex-file-compressed (0.981x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 404176668 402822841 1.00
tpch_q02/datafusion:vortex-file-compressed 114107605 116884449 0.98
tpch_q03/datafusion:vortex-file-compressed 204607375 207136491 0.99
tpch_q04/datafusion:vortex-file-compressed 100798518 101601406 0.99
tpch_q05/datafusion:vortex-file-compressed 378992600 383954901 0.99
tpch_q06/datafusion:vortex-file-compressed 41207911 41798969 0.99
tpch_q07/datafusion:vortex-file-compressed 560668780 566509544 0.99
tpch_q08/datafusion:vortex-file-compressed 373790083 381587444 0.98
tpch_q09/datafusion:vortex-file-compressed 661578672 681231039 0.97
tpch_q10/datafusion:vortex-file-compressed 235381065 239793233 0.98
tpch_q11/datafusion:vortex-file-compressed 83840822 86867956 0.97
tpch_q12/datafusion:vortex-file-compressed 110263134 113288038 0.97
tpch_q13/datafusion:vortex-file-compressed 222943753 224032061 1.00
tpch_q14/datafusion:vortex-file-compressed 58270203 58445744 1.00
tpch_q15/datafusion:vortex-file-compressed 108918483 110700524 0.98
tpch_q16/datafusion:vortex-file-compressed 77274246 80832465 0.96
tpch_q17/datafusion:vortex-file-compressed 643817347 659167202 0.98
tpch_q18/datafusion:vortex-file-compressed 878694004 906181933 0.97
tpch_q19/datafusion:vortex-file-compressed 123355669 128051275 0.96
tpch_q20/datafusion:vortex-file-compressed 171070945 173808149 0.98
tpch_q21/datafusion:vortex-file-compressed 663007159 669481181 0.99
tpch_q22/datafusion:vortex-file-compressed 60124337 61875504 0.97
datafusion / vortex-compact (0.979x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 439573218 450774689 0.98
tpch_q02/datafusion:vortex-compact 121078356 121084775 1.00
tpch_q03/datafusion:vortex-compact 214648775 220379040 0.97
tpch_q04/datafusion:vortex-compact 121386277 122656358 0.99
tpch_q05/datafusion:vortex-compact 391146492 399757336 0.98
tpch_q06/datafusion:vortex-compact 63886332 65077966 0.98
tpch_q07/datafusion:vortex-compact 587661530 602379453 0.98
tpch_q08/datafusion:vortex-compact 386770322 391966137 0.99
tpch_q09/datafusion:vortex-compact 678348054 696240197 0.97
tpch_q10/datafusion:vortex-compact 276107372 276566400 1.00
tpch_q11/datafusion:vortex-compact 91058863 93797263 0.97
tpch_q12/datafusion:vortex-compact 169424031 172097698 0.98
tpch_q13/datafusion:vortex-compact 271816725 279333926 0.97
tpch_q14/datafusion:vortex-compact 75549896 77928214 0.97
tpch_q15/datafusion:vortex-compact 165548759 170260445 0.97
tpch_q16/datafusion:vortex-compact 83405256 86172498 0.97
tpch_q17/datafusion:vortex-compact 649380990 664885430 0.98
tpch_q18/datafusion:vortex-compact 891630021 915673307 0.97
tpch_q19/datafusion:vortex-compact 218639450 211621010 1.03
tpch_q20/datafusion:vortex-compact 197137313 205408467 0.96
tpch_q21/datafusion:vortex-compact 703889720 715494346 0.98
tpch_q22/datafusion:vortex-compact 71214585 75336115 0.95
datafusion / parquet (0.940x ➖, 6↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 445288166 426118728 1.04
tpch_q02/datafusion:parquet 184125873 192184598 0.96
tpch_q03/datafusion:parquet 290542118 297655325 0.98
tpch_q04/datafusion:parquet 130204115 135319980 0.96
tpch_q05/datafusion:parquet 443907734 459366092 0.97
tpch_q06/datafusion:parquet 131219449 124879646 1.05
tpch_q07/datafusion:parquet 621098001 647066306 0.96
tpch_q08/datafusion:parquet 487703094 496036185 0.98
tpch_q09/datafusion:parquet 761378092 773759536 0.98
tpch_q10/datafusion:parquet 499580101 503891311 0.99
tpch_q11/datafusion:parquet 127247852 132571735 0.96
tpch_q12/datafusion:parquet 212715896 226688723 0.94
tpch_q13/datafusion:parquet 337845458 374274679 0.90
tpch_q14/datafusion:parquet 🚀 157402475 179824501 0.88
tpch_q15/datafusion:parquet 🚀 253676699 288229293 0.88
tpch_q16/datafusion:parquet 136822063 149125807 0.92
tpch_q17/datafusion:parquet 🚀 683779086 807143086 0.85
tpch_q18/datafusion:parquet 🚀 883119651 1043492756 0.85
tpch_q19/datafusion:parquet 🚀 267199594 311356782 0.86
tpch_q20/datafusion:parquet 🚀 303859915 341819261 0.89
tpch_q21/datafusion:parquet 732899020 802081809 0.91
tpch_q22/datafusion:parquet 224569141 220395062 1.02
datafusion / arrow (0.961x ➖, 1↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 590455451 610522366 0.97
tpch_q02/datafusion:arrow 162992633 167148886 0.98
tpch_q03/datafusion:arrow 🚀 458477867 510429400 0.90
tpch_q04/datafusion:arrow 349942574 380148920 0.92
tpch_q05/datafusion:arrow 923120529 966452885 0.96
tpch_q06/datafusion:arrow 274352057 280896821 0.98
tpch_q07/datafusion:arrow 1130663432 1154517702 0.98
tpch_q08/datafusion:arrow 1118348752 1165309819 0.96
tpch_q09/datafusion:arrow 1335925573 1364547765 0.98
tpch_q10/datafusion:arrow 601462714 610908695 0.98
tpch_q11/datafusion:arrow 150510687 149311248 1.01
tpch_q12/datafusion:arrow 664866091 682451456 0.97
tpch_q13/datafusion:arrow 527594617 530662727 0.99
tpch_q14/datafusion:arrow 306766393 313810705 0.98
tpch_q15/datafusion:arrow 649698417 701208746 0.93
tpch_q16/datafusion:arrow 106723883 108161940 0.99
tpch_q17/datafusion:arrow 1316053266 1366110100 0.96
tpch_q18/datafusion:arrow 1797060266 1863037662 0.96
tpch_q19/datafusion:arrow 497551857 538975392 0.92
tpch_q20/datafusion:arrow 494382933 529533211 0.93
tpch_q21/datafusion:arrow 2796841404 2963825228 0.94
tpch_q22/datafusion:arrow 142505859 147121181 0.97
duckdb / vortex-file-compressed (0.973x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 177809731 177976078 1.00
tpch_q02/duckdb:vortex-file-compressed 52198062 53494713 0.98
tpch_q03/duckdb:vortex-file-compressed 127888048 129861393 0.98
tpch_q04/duckdb:vortex-file-compressed 148796370 148312980 1.00
tpch_q05/duckdb:vortex-file-compressed 130760434 133115173 0.98
tpch_q06/duckdb:vortex-file-compressed 48799168 49131699 0.99
tpch_q07/duckdb:vortex-file-compressed 147839358 147838418 1.00
tpch_q08/duckdb:vortex-file-compressed 172934585 182924965 0.95
tpch_q09/duckdb:vortex-file-compressed 335220449 342233373 0.98
tpch_q10/duckdb:vortex-file-compressed 153127104 159739919 0.96
tpch_q11/duckdb:vortex-file-compressed 35392201 35857382 0.99
tpch_q12/duckdb:vortex-file-compressed 96670479 98626156 0.98
tpch_q13/duckdb:vortex-file-compressed 248550182 252834623 0.98
tpch_q14/duckdb:vortex-file-compressed 71825800 74810607 0.96
tpch_q15/duckdb:vortex-file-compressed 95734774 102583474 0.93
tpch_q16/duckdb:vortex-file-compressed 82680103 84388071 0.98
tpch_q17/duckdb:vortex-file-compressed 100352354 105665593 0.95
tpch_q18/duckdb:vortex-file-compressed 280500801 299353055 0.94
tpch_q19/duckdb:vortex-file-compressed 90107961 93869691 0.96
tpch_q20/duckdb:vortex-file-compressed 166733920 173176490 0.96
tpch_q21/duckdb:vortex-file-compressed 551632885 565539316 0.98
tpch_q22/duckdb:vortex-file-compressed 77123248 78418368 0.98
duckdb / vortex-compact (0.986x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230042251 231680432 0.99
tpch_q02/duckdb:vortex-compact 62006281 59821308 1.04
tpch_q03/duckdb:vortex-compact 140357421 146901195 0.96
tpch_q04/duckdb:vortex-compact 177234253 182058507 0.97
tpch_q05/duckdb:vortex-compact 151870166 154470195 0.98
tpch_q06/duckdb:vortex-compact 86637235 88196204 0.98
tpch_q07/duckdb:vortex-compact 206287736 209595484 0.98
tpch_q08/duckdb:vortex-compact 191998803 195156434 0.98
tpch_q09/duckdb:vortex-compact 366072333 368705608 0.99
tpch_q10/duckdb:vortex-compact 186429572 190798643 0.98
tpch_q11/duckdb:vortex-compact 41709246 42253197 0.99
tpch_q12/duckdb:vortex-compact 209806904 212401142 0.99
tpch_q13/duckdb:vortex-compact 297743861 298561819 1.00
tpch_q14/duckdb:vortex-compact 105568580 107527570 0.98
tpch_q15/duckdb:vortex-compact 120519356 120038506 1.00
tpch_q16/duckdb:vortex-compact 86250110 87544922 0.99
tpch_q17/duckdb:vortex-compact 117870772 119371857 0.99
tpch_q18/duckdb:vortex-compact 291067702 302258973 0.96
tpch_q19/duckdb:vortex-compact 115967568 117064996 0.99
tpch_q20/duckdb:vortex-compact 206163337 209916998 0.98
tpch_q21/duckdb:vortex-compact 631989875 643146223 0.98
tpch_q22/duckdb:vortex-compact 90572982 91993084 0.98
duckdb / parquet (0.977x ➖, 2↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260211843 262584690 0.99
tpch_q02/duckdb:parquet 104928211 98120997 1.07
tpch_q03/duckdb:parquet 213739796 216052408 0.99
tpch_q04/duckdb:parquet 134447963 140124567 0.96
tpch_q05/duckdb:parquet 219135533 224238873 0.98
tpch_q06/duckdb:parquet 69326315 67327310 1.03
tpch_q07/duckdb:parquet 184092055 177338659 1.04
tpch_q08/duckdb:parquet 255154947 254216571 1.00
tpch_q09/duckdb:parquet 464786028 460269804 1.01
tpch_q10/duckdb:parquet 610312438 616387941 0.99
tpch_q11/duckdb:parquet 🚀 43463646 50394281 0.86
tpch_q12/duckdb:parquet 125537271 133544459 0.94
tpch_q13/duckdb:parquet 450304632 458460178 0.98
tpch_q14/duckdb:parquet 172913430 183983267 0.94
tpch_q15/duckdb:parquet 99108892 100031659 0.99
tpch_q16/duckdb:parquet 🚀 133203863 165080391 0.81
tpch_q17/duckdb:parquet 181302322 181282738 1.00
tpch_q18/duckdb:parquet 347101720 356639641 0.97
tpch_q19/duckdb:parquet 280216819 291455296 0.96
tpch_q20/duckdb:parquet 250799849 233359861 1.07
tpch_q21/duckdb:parquet 567454116 580608071 0.98
tpch_q22/duckdb:parquet 289054932 298790389 0.97
duckdb / duckdb (0.950x ➖, 1↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 118828981 122843968 0.97
tpch_q02/duckdb:duckdb 46797133 48113120 0.97
tpch_q03/duckdb:duckdb 95774297 104217885 0.92
tpch_q04/duckdb:duckdb 133649072 148402199 0.90
tpch_q05/duckdb:duckdb 🚀 109299939 122289749 0.89
tpch_q06/duckdb:duckdb 39177519 40205677 0.97
tpch_q07/duckdb:duckdb 86617115 91495634 0.95
tpch_q08/duckdb:duckdb 109624393 118575083 0.92
tpch_q09/duckdb:duckdb 275395989 296585971 0.93
tpch_q10/duckdb:duckdb 201976988 212876353 0.95
tpch_q11/duckdb:duckdb 15127223 15578199 0.97
tpch_q12/duckdb:duckdb 82469290 85012126 0.97
tpch_q13/duckdb:duckdb 251314863 259683062 0.97
tpch_q14/duckdb:duckdb 70740410 74090047 0.95
tpch_q15/duckdb:duckdb 76841669 82322094 0.93
tpch_q16/duckdb:duckdb 73241816 78147200 0.94
tpch_q17/duckdb:duckdb 84297691 88797964 0.95
tpch_q18/duckdb:duckdb 211623884 224551779 0.94
tpch_q19/duckdb:duckdb 115456159 122531419 0.94
tpch_q20/duckdb:duckdb 111554694 112639844 0.99
tpch_q21/duckdb:duckdb 299585901 302398536 0.99
tpch_q22/duckdb:duckdb 66131881 67474868 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -3.3% +1.8% -5.0% +13.1% ➖ noise
1 datafusion:vortex-compact -2.5% +1.8% -4.2% +13.1% ➖ noise
1 datafusion:vortex-file-compressed +0.3% +1.8% -1.4% +13.2% ➖ noise
1 duckdb:duckdb -3.3% +1.8% -4.9% +13.1% ➖ noise
1 duckdb:vortex-compact -0.7% +1.8% -2.4% +13.1% ➖ noise
1 duckdb:vortex-file-compressed -0.1% +1.8% -1.8% +13.1% ➖ noise
2 datafusion:arrow -2.5% +1.2% -3.7% +13.1% ➖ noise
2 datafusion:vortex-compact -0.0% +1.2% -1.2% +13.1% ➖ noise
2 datafusion:vortex-file-compressed -2.4% +1.2% -3.6% +13.1% ➖ noise
2 duckdb:duckdb -2.7% +1.2% -3.9% +14.5% ➖ noise
2 duckdb:vortex-compact +3.7% +1.2% +2.4% +13.1% ➖ noise
2 duckdb:vortex-file-compressed -2.4% +1.2% -3.6% +13.1% ➖ noise
3 datafusion:arrow -10.2% -1.7% -8.6% +13.1% ➖ noise
3 datafusion:vortex-compact -2.6% -1.7% -0.9% +13.1% ➖ noise
3 datafusion:vortex-file-compressed -1.2% -1.7% +0.5% +13.1% ➖ noise
3 duckdb:duckdb -8.1% -1.7% -6.5% +13.1% ➖ noise
3 duckdb:vortex-compact -4.5% -1.7% -2.8% +13.1% ➖ noise
3 duckdb:vortex-file-compressed -1.5% -1.7% +0.2% +13.1% ➖ noise
4 datafusion:arrow -7.9% -3.9% -4.2% +13.1% ➖ noise
4 datafusion:vortex-compact -1.0% -3.9% +3.0% +13.1% ➖ noise
4 datafusion:vortex-file-compressed -0.8% -3.9% +3.3% +13.1% ➖ noise
4 duckdb:duckdb -9.9% -3.9% -6.3% +13.1% ➖ noise
4 duckdb:vortex-compact -2.6% -3.9% +1.3% +13.1% ➖ noise
4 duckdb:vortex-file-compressed +0.3% -3.9% +4.4% +13.1% ➖ noise
5 datafusion:arrow -4.5% -2.8% -1.7% +13.1% ➖ noise
5 datafusion:vortex-compact -2.2% -2.8% +0.7% +13.1% ➖ noise
5 datafusion:vortex-file-compressed -1.3% -2.8% +1.6% +13.1% ➖ noise
5 duckdb:duckdb -10.6% -2.8% -8.0% +13.1% ➖ noise
5 duckdb:vortex-compact -1.7% -2.8% +1.2% +13.1% ➖ noise
5 duckdb:vortex-file-compressed -1.8% -2.8% +1.1% +13.1% ➖ noise
6 datafusion:arrow -2.3% +4.0% -6.1% +13.1% ➖ noise
6 datafusion:vortex-compact -1.8% +4.0% -5.6% +13.1% ➖ noise
6 datafusion:vortex-file-compressed -1.4% +4.0% -5.2% +13.1% ➖ noise
6 duckdb:duckdb -2.6% +4.0% -6.3% +14.6% ➖ noise
6 duckdb:vortex-compact -1.8% +4.0% -5.6% +13.1% ➖ noise
6 duckdb:vortex-file-compressed -0.7% +4.0% -4.5% +13.1% ➖ noise
7 datafusion:arrow -2.1% -0.2% -1.9% +13.1% ➖ noise
7 datafusion:vortex-compact -2.4% -0.2% -2.3% +13.1% ➖ noise
7 datafusion:vortex-file-compressed -1.0% -0.2% -0.9% +13.1% ➖ noise
7 duckdb:duckdb -5.3% -0.2% -5.2% +13.1% ➖ noise
7 duckdb:vortex-compact -1.6% -0.2% -1.4% +13.1% ➖ noise
7 duckdb:vortex-file-compressed +0.0% -0.2% +0.2% +13.1% ➖ noise
8 datafusion:arrow -4.0% -0.7% -3.4% +13.1% ➖ noise
8 datafusion:vortex-compact -1.3% -0.7% -0.7% +13.1% ➖ noise
8 datafusion:vortex-file-compressed -2.0% -0.7% -1.4% +13.1% ➖ noise
8 duckdb:duckdb -7.5% -0.7% -6.9% +13.1% ➖ noise
8 duckdb:vortex-compact -1.6% -0.7% -1.0% +13.1% ➖ noise
8 duckdb:vortex-file-compressed -5.5% -0.7% -4.8% +13.1% ➖ noise
9 datafusion:arrow -2.1% -0.3% -1.8% +13.1% ➖ noise
9 datafusion:vortex-compact -2.6% -0.3% -2.3% +13.1% ➖ noise
9 datafusion:vortex-file-compressed -2.9% -0.3% -2.6% +13.1% ➖ noise
9 duckdb:duckdb -7.1% -0.3% -6.8% +13.1% ➖ noise
9 duckdb:vortex-compact -0.7% -0.3% -0.4% +13.1% ➖ noise
9 duckdb:vortex-file-compressed -2.0% -0.3% -1.7% +13.1% ➖ noise
10 datafusion:arrow -1.5% -0.9% -0.6% +13.1% ➖ noise
10 datafusion:vortex-compact -0.2% -0.9% +0.8% +13.1% ➖ noise
10 datafusion:vortex-file-compressed -1.8% -0.9% -0.9% +13.1% ➖ noise
10 duckdb:duckdb -5.1% -0.9% -4.2% +13.1% ➖ noise
10 duckdb:vortex-compact -2.3% -0.9% -1.4% +13.1% ➖ noise
10 duckdb:vortex-file-compressed -4.1% -0.9% -3.2% +13.1% ➖ noise
11 datafusion:arrow +0.8% -9.0% +10.8% +13.5% ➖ noise
11 datafusion:vortex-compact -2.9% -9.0% +6.7% +13.9% ➖ noise
11 datafusion:vortex-file-compressed -3.5% -9.0% +6.1% +13.2% ➖ noise
11 duckdb:duckdb -2.9% -9.0% +6.7% +21.5% ➖ noise
11 duckdb:vortex-compact -1.3% -9.0% +8.5% +16.6% ➖ noise
11 duckdb:vortex-file-compressed -1.3% -9.0% +8.5% +15.5% ➖ noise
12 datafusion:arrow -2.6% -6.1% +3.7% +49.2% ➖ noise
12 datafusion:vortex-compact -1.6% -6.1% +4.8% +13.1% ➖ noise
12 datafusion:vortex-file-compressed -2.7% -6.1% +3.6% +13.1% ➖ noise
12 duckdb:duckdb -3.0% -6.1% +3.3% +13.1% ➖ noise
12 duckdb:vortex-compact -1.2% -6.1% +5.2% +13.1% ➖ noise
12 duckdb:vortex-file-compressed -2.0% -6.1% +4.4% +13.1% ➖ noise
13 datafusion:arrow -0.6% -5.8% +5.6% +13.1% ➖ noise
13 datafusion:vortex-compact -2.7% -5.8% +3.3% +13.1% ➖ noise
13 datafusion:vortex-file-compressed -0.5% -5.8% +5.7% +13.1% ➖ noise
13 duckdb:duckdb -3.2% -5.8% +2.8% +13.1% ➖ noise
13 duckdb:vortex-compact -0.3% -5.8% +5.9% +13.1% ➖ noise
13 duckdb:vortex-file-compressed -1.7% -5.8% +4.4% +13.1% ➖ noise
14 datafusion:arrow -2.2% -9.3% +7.8% +13.1% ➖ noise
14 datafusion:vortex-compact -3.1% -9.3% +6.9% +13.1% ➖ noise
14 datafusion:vortex-file-compressed -0.3% -9.3% +9.9% +13.1% ➖ noise
14 duckdb:duckdb -4.5% -9.3% +5.3% +13.1% ➖ noise
14 duckdb:vortex-compact -1.8% -9.3% +8.2% +13.1% ➖ noise
14 duckdb:vortex-file-compressed -4.0% -9.3% +5.9% +13.1% ➖ noise
15 datafusion:arrow -7.3% -6.6% -0.8% +13.1% ➖ noise
15 datafusion:vortex-compact -2.8% -6.6% +4.1% +13.1% ➖ noise
15 datafusion:vortex-file-compressed -1.6% -6.6% +5.4% +13.1% ➖ noise
15 duckdb:duckdb -6.7% -6.6% -0.0% +13.1% ➖ noise
15 duckdb:vortex-compact +0.4% -6.6% +7.5% +13.1% ➖ noise
15 duckdb:vortex-file-compressed -6.7% -6.6% -0.1% +13.1% ➖ noise
16 datafusion:arrow -1.3% -14.0% +14.7% +16.5% ➖ noise
16 datafusion:vortex-compact -3.2% -14.0% +12.5% +13.1% ➖ noise
16 datafusion:vortex-file-compressed -4.4% -14.0% +11.1% +13.1% ➖ noise
16 duckdb:duckdb -6.3% -14.0% +8.9% +13.1% ➖ noise
16 duckdb:vortex-compact -1.5% -14.0% +14.5% +13.1% 🚨 regression
16 duckdb:vortex-file-compressed -2.0% -14.0% +13.9% +13.1% 🚨 regression
17 datafusion:arrow -3.7% -8.0% +4.7% +13.1% ➖ noise
17 datafusion:vortex-compact -2.3% -8.0% +6.1% +13.1% ➖ noise
17 datafusion:vortex-file-compressed -2.3% -8.0% +6.1% +13.1% ➖ noise
17 duckdb:duckdb -5.1% -8.0% +3.1% +13.1% ➖ noise
17 duckdb:vortex-compact -1.3% -8.0% +7.3% +13.1% ➖ noise
17 duckdb:vortex-file-compressed -5.0% -8.0% +3.2% +13.1% ➖ noise
18 datafusion:arrow -3.5% -9.2% +6.3% +13.1% ➖ noise
18 datafusion:vortex-compact -2.6% -9.2% +7.3% +13.1% ➖ noise
18 datafusion:vortex-file-compressed -3.0% -9.2% +6.8% +13.1% ➖ noise
18 duckdb:duckdb -5.8% -9.2% +3.8% +13.1% ➖ noise
18 duckdb:vortex-compact -3.7% -9.2% +6.1% +13.1% ➖ noise
18 duckdb:vortex-file-compressed -6.3% -9.2% +3.2% +13.1% ➖ noise
19 datafusion:arrow -7.7% -9.2% +1.6% +13.1% ➖ noise
19 datafusion:vortex-compact +3.3% -9.2% +13.7% +13.1% 🚨 regression
19 datafusion:vortex-file-compressed -3.7% -9.2% +6.1% +13.1% ➖ noise
19 duckdb:duckdb -5.8% -9.2% +3.7% +13.1% ➖ noise
19 duckdb:vortex-compact -0.9% -9.2% +9.1% +13.1% ➖ noise
19 duckdb:vortex-file-compressed -4.0% -9.2% +5.7% +13.1% ➖ noise
20 datafusion:arrow -6.6% -2.3% -4.5% +13.1% ➖ noise
20 datafusion:vortex-compact -4.0% -2.3% -1.8% +13.1% ➖ noise
20 datafusion:vortex-file-compressed -1.6% -2.3% +0.7% +13.1% ➖ noise
20 duckdb:duckdb -1.0% -2.3% +1.3% +13.1% ➖ noise
20 duckdb:vortex-compact -1.8% -2.3% +0.5% +13.1% ➖ noise
20 duckdb:vortex-file-compressed -3.7% -2.3% -1.5% +13.1% ➖ noise
21 datafusion:arrow -5.6% -5.5% -0.1% +13.1% ➖ noise
21 datafusion:vortex-compact -1.6% -5.5% +4.1% +13.1% ➖ noise
21 datafusion:vortex-file-compressed -1.0% -5.5% +4.8% +13.1% ➖ noise
21 duckdb:duckdb -0.9% -5.5% +4.8% +13.1% ➖ noise
21 duckdb:vortex-compact -1.7% -5.5% +4.0% +13.1% ➖ noise
21 duckdb:vortex-file-compressed -2.5% -5.5% +3.2% +13.1% ➖ noise
22 datafusion:arrow -3.1% -0.7% -2.4% +13.1% ➖ noise
22 datafusion:vortex-compact -5.5% -0.7% -4.8% +13.1% ➖ noise
22 datafusion:vortex-file-compressed -2.8% -0.7% -2.1% +13.1% ➖ noise
22 duckdb:duckdb -2.0% -0.7% -1.3% +13.1% ➖ noise
22 duckdb:vortex-compact -1.5% -0.7% -0.8% +13.1% ➖ noise
22 duckdb:vortex-file-compressed -1.7% -0.7% -0.9% +13.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.4%
Vortex (geomean): 1.077x ➖
Parquet (geomean): 1.188x ➖
Shifts: Parquet (control) +18.8% · Median polish +7.1%


datafusion / vortex-file-compressed (1.076x ➖, 0↑ 4↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 180776182 195647313 0.92
tpch_q02/datafusion:vortex-file-compressed 423849023 466186551 0.91
tpch_q03/datafusion:vortex-file-compressed 406441179 425016431 0.96
tpch_q04/datafusion:vortex-file-compressed 225924505 199563626 1.13
tpch_q05/datafusion:vortex-file-compressed 529467117 413960111 1.28
tpch_q06/datafusion:vortex-file-compressed 🚨 338627839 254663613 1.33
tpch_q07/datafusion:vortex-file-compressed 🚨 513857027 367376065 1.40
tpch_q08/datafusion:vortex-file-compressed 🚨 667912449 466864829 1.43
tpch_q09/datafusion:vortex-file-compressed 410095507 467106646 0.88
tpch_q10/datafusion:vortex-file-compressed 506385126 526720155 0.96
tpch_q11/datafusion:vortex-file-compressed 326346818 382718324 0.85
tpch_q12/datafusion:vortex-file-compressed 490521928 406932863 1.21
tpch_q13/datafusion:vortex-file-compressed 257195056 216064104 1.19
tpch_q14/datafusion:vortex-file-compressed 193258928 171242141 1.13
tpch_q15/datafusion:vortex-file-compressed 383822870 303758111 1.26
tpch_q16/datafusion:vortex-file-compressed 176420350 166296691 1.06
tpch_q17/datafusion:vortex-file-compressed 390061934 340537465 1.15
tpch_q18/datafusion:vortex-file-compressed 310718265 310654571 1.00
tpch_q19/datafusion:vortex-file-compressed 🚨 442910676 332152978 1.33
tpch_q20/datafusion:vortex-file-compressed 339501338 388637108 0.87
tpch_q21/datafusion:vortex-file-compressed 462017386 648759179 0.71
tpch_q22/datafusion:vortex-file-compressed 157255978 143742094 1.09
datafusion / vortex-compact (1.059x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 270305062 247470030 1.09
tpch_q02/datafusion:vortex-compact 473560314 412074734 1.15
tpch_q03/datafusion:vortex-compact 359324485 285484946 1.26
tpch_q04/datafusion:vortex-compact 256863497 223917681 1.15
tpch_q05/datafusion:vortex-compact 389015512 383566168 1.01
tpch_q06/datafusion:vortex-compact 343703501 339327924 1.01
tpch_q07/datafusion:vortex-compact 542144230 426503960 1.27
tpch_q08/datafusion:vortex-compact 476485506 501989767 0.95
tpch_q09/datafusion:vortex-compact 349611057 382238437 0.91
tpch_q10/datafusion:vortex-compact 453682790 453810984 1.00
tpch_q11/datafusion:vortex-compact 302325637 316426433 0.96
tpch_q12/datafusion:vortex-compact 384904317 413083923 0.93
tpch_q13/datafusion:vortex-compact 213597254 215577617 0.99
tpch_q14/datafusion:vortex-compact 259254948 248741496 1.04
tpch_q15/datafusion:vortex-compact 507981871 410812833 1.24
tpch_q16/datafusion:vortex-compact 165300229 154479940 1.07
tpch_q17/datafusion:vortex-compact 325500331 341471023 0.95
tpch_q18/datafusion:vortex-compact 352084452 272103621 1.29
tpch_q19/datafusion:vortex-compact 373356918 407143449 0.92
tpch_q20/datafusion:vortex-compact 451368305 442434608 1.02
tpch_q21/datafusion:vortex-compact 503166065 453210782 1.11
tpch_q22/datafusion:vortex-compact 129004642 117783995 1.10
datafusion / parquet (1.306x ❌, 0↑ 11↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 273677403 235987900 1.16
tpch_q02/datafusion:parquet 🚨 649766195 408256253 1.59
tpch_q03/datafusion:parquet 🚨 402035263 309032203 1.30
tpch_q04/datafusion:parquet 🚨 244766934 143761497 1.70
tpch_q05/datafusion:parquet 🚨 671997477 469711130 1.43
tpch_q06/datafusion:parquet 🚨 197191231 142889331 1.38
tpch_q07/datafusion:parquet 🚨 619515108 457998523 1.35
tpch_q08/datafusion:parquet 🚨 893583419 582417768 1.53
tpch_q09/datafusion:parquet 596429085 459434661 1.30
tpch_q10/datafusion:parquet 631220053 518036301 1.22
tpch_q11/datafusion:parquet 355054466 354972183 1.00
tpch_q12/datafusion:parquet 299037317 257079623 1.16
tpch_q13/datafusion:parquet 447862550 438341742 1.02
tpch_q14/datafusion:parquet 227939673 193692308 1.18
tpch_q15/datafusion:parquet 🚨 398835440 284264646 1.40
tpch_q16/datafusion:parquet 193769296 169478480 1.14
tpch_q17/datafusion:parquet 🚨 592020997 362460885 1.63
tpch_q18/datafusion:parquet 🚨 673392546 452444070 1.49
tpch_q19/datafusion:parquet 🚨 419529676 309647936 1.35
tpch_q20/datafusion:parquet 404185465 316942753 1.28
tpch_q21/datafusion:parquet 613255357 504085059 1.22
tpch_q22/datafusion:parquet 154898572 131582283 1.18
duckdb / vortex-file-compressed (1.084x ➖, 0↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 246463159 256225822 0.96
tpch_q02/duckdb:vortex-file-compressed 965726327 850155763 1.14
tpch_q03/duckdb:vortex-file-compressed 645119167 549479879 1.17
tpch_q04/duckdb:vortex-file-compressed 397968633 369273383 1.08
tpch_q05/duckdb:vortex-file-compressed 940038078 876252281 1.07
tpch_q06/duckdb:vortex-file-compressed 420956264 401413636 1.05
tpch_q07/duckdb:vortex-file-compressed 755161955 694499765 1.09
tpch_q08/duckdb:vortex-file-compressed 905678348 873389892 1.04
tpch_q09/duckdb:vortex-file-compressed 878840088 842645930 1.04
tpch_q10/duckdb:vortex-file-compressed 752819509 709974726 1.06
tpch_q11/duckdb:vortex-file-compressed 604244195 491989860 1.23
tpch_q12/duckdb:vortex-file-compressed 🚨 599220896 456881708 1.31
tpch_q13/duckdb:vortex-file-compressed 445845150 426274655 1.05
tpch_q14/duckdb:vortex-file-compressed 422729555 415288344 1.02
tpch_q15/duckdb:vortex-file-compressed 298392064 291412419 1.02
tpch_q16/duckdb:vortex-file-compressed 354923878 340535781 1.04
tpch_q17/duckdb:vortex-file-compressed 630045552 610199057 1.03
tpch_q18/duckdb:vortex-file-compressed 551864608 487752079 1.13
tpch_q19/duckdb:vortex-file-compressed 450902068 389491829 1.16
tpch_q20/duckdb:vortex-file-compressed 823902198 734197772 1.12
tpch_q21/duckdb:vortex-file-compressed 1072701066 1026711876 1.04
tpch_q22/duckdb:vortex-file-compressed 360879810 344382322 1.05
duckdb / vortex-compact (1.088x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 297024339 271715686 1.09
tpch_q02/duckdb:vortex-compact 841987782 836130601 1.01
tpch_q03/duckdb:vortex-compact 613993915 513132569 1.20
tpch_q04/duckdb:vortex-compact 333373760 309758276 1.08
tpch_q05/duckdb:vortex-compact 872152306 757242615 1.15
tpch_q06/duckdb:vortex-compact 406849894 362045359 1.12
tpch_q07/duckdb:vortex-compact 728298404 664068499 1.10
tpch_q08/duckdb:vortex-compact 889135504 795226305 1.12
tpch_q09/duckdb:vortex-compact 906044445 751801341 1.21
tpch_q10/duckdb:vortex-compact 643305539 592295317 1.09
tpch_q11/duckdb:vortex-compact 475447218 438111555 1.09
tpch_q12/duckdb:vortex-compact 447739939 381621999 1.17
tpch_q13/duckdb:vortex-compact 481167480 410175251 1.17
tpch_q14/duckdb:vortex-compact 473352979 410248815 1.15
tpch_q15/duckdb:vortex-compact 251413102 275933613 0.91
tpch_q16/duckdb:vortex-compact 355677587 317564095 1.12
tpch_q17/duckdb:vortex-compact 597171890 572328432 1.04
tpch_q18/duckdb:vortex-compact 412904535 459850693 0.90
tpch_q19/duckdb:vortex-compact 443681208 435617743 1.02
tpch_q20/duckdb:vortex-compact 899851425 785911123 1.14
tpch_q21/duckdb:vortex-compact 1029645303 971896573 1.06
tpch_q22/duckdb:vortex-compact 331402071 309968084 1.07
duckdb / parquet (1.081x ➖, 0↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 533822227 472072300 1.13
tpch_q02/duckdb:parquet 1336201217 1297314528 1.03
tpch_q03/duckdb:parquet 1135767277 958765230 1.18
tpch_q04/duckdb:parquet 🚨 734154106 557987821 1.32
tpch_q05/duckdb:parquet 1615831371 1459684609 1.11
tpch_q06/duckdb:parquet 482141503 410708443 1.17
tpch_q07/duckdb:parquet 1217215492 1197473559 1.02
tpch_q08/duckdb:parquet 1732966222 1587816342 1.09
tpch_q09/duckdb:parquet 1360156476 1263586009 1.08
tpch_q10/duckdb:parquet 1302010199 1307128791 1.00
tpch_q11/duckdb:parquet 892680169 782539756 1.14
tpch_q12/duckdb:parquet 611026080 544697427 1.12
tpch_q13/duckdb:parquet 871367222 875142033 1.00
tpch_q14/duckdb:parquet 645618028 715457626 0.90
tpch_q15/duckdb:parquet 546201279 505017564 1.08
tpch_q16/duckdb:parquet 602949827 483083870 1.25
tpch_q17/duckdb:parquet 783347960 727837419 1.08
tpch_q18/duckdb:parquet 797166657 835999458 0.95
tpch_q19/duckdb:parquet 901844715 781850492 1.15
tpch_q20/duckdb:parquet 999617757 1010347871 0.99
tpch_q21/duckdb:parquet 1348007474 1212447975 1.11
tpch_q22/duckdb:parquet 507750626 523818006 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +9.2% +14.5% -4.6% +134.0% ➖ noise
1 datafusion:vortex-file-compressed -7.6% +14.5% -19.3% +166.3% ➖ noise
1 duckdb:vortex-compact +9.3% +14.5% -4.5% +49.1% ➖ noise
1 duckdb:vortex-file-compressed -3.8% +14.5% -16.0% +41.3% ➖ noise
2 datafusion:vortex-compact +14.9% +28.0% -10.2% +32.2% ➖ noise
2 datafusion:vortex-file-compressed -9.1% +28.0% -29.0% +39.9% ✅ faster
2 duckdb:vortex-compact +0.7% +28.0% -21.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +13.6% +28.0% -11.3% +30.0% ➖ noise
3 datafusion:vortex-compact +25.9% +24.1% +1.4% +87.7% ➖ noise
3 datafusion:vortex-file-compressed -4.4% +24.1% -23.0% +87.4% ➖ noise
3 duckdb:vortex-compact +19.7% +24.1% -3.6% +38.0% ➖ noise
3 duckdb:vortex-file-compressed +17.4% +24.1% -5.4% +38.8% ➖ noise
4 datafusion:vortex-compact +14.7% +49.7% -23.4% +36.2% ➖ noise
4 datafusion:vortex-file-compressed +13.2% +49.7% -24.4% +61.1% ➖ noise
4 duckdb:vortex-compact +7.6% +49.7% -28.1% +30.0% ✅ faster
4 duckdb:vortex-file-compressed +7.8% +49.7% -28.0% +32.3% ✅ faster
5 datafusion:vortex-compact +1.4% +25.8% -19.4% +38.4% ➖ noise
5 datafusion:vortex-file-compressed +27.9% +25.8% +1.6% +30.0% ➖ noise
5 duckdb:vortex-compact +15.2% +25.8% -8.5% +32.4% ➖ noise
5 duckdb:vortex-file-compressed +7.3% +25.8% -14.8% +30.0% ➖ noise
6 datafusion:vortex-compact +1.3% +27.3% -20.4% +32.4% ➖ noise
6 datafusion:vortex-file-compressed +33.0% +27.3% +4.5% +59.8% ➖ noise
6 duckdb:vortex-compact +12.4% +27.3% -11.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.9% +27.3% -17.6% +30.8% ➖ noise
7 datafusion:vortex-compact +27.1% +17.3% +8.4% +31.3% ➖ noise
7 datafusion:vortex-file-compressed +39.9% +17.3% +19.3% +36.6% ➖ noise
7 duckdb:vortex-compact +9.7% +17.3% -6.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.7% +17.3% -7.3% +30.0% ➖ noise
8 datafusion:vortex-compact -5.1% +29.4% -26.6% +30.0% ✅ faster
8 datafusion:vortex-file-compressed +43.1% +29.4% +10.6% +30.0% ➖ noise
8 duckdb:vortex-compact +11.8% +29.4% -13.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.7% +29.4% -19.9% +30.0% ➖ noise
9 datafusion:vortex-compact -8.5% +18.2% -22.6% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -12.2% +18.2% -25.7% +40.6% ➖ noise
9 duckdb:vortex-compact +20.5% +18.2% +1.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +4.3% +18.2% -11.8% +30.0% ➖ noise
10 datafusion:vortex-compact -0.0% +10.2% -9.3% +30.2% ➖ noise
10 datafusion:vortex-file-compressed -3.9% +10.2% -12.7% +30.0% ➖ noise
10 duckdb:vortex-compact +8.6% +10.2% -1.4% +42.0% ➖ noise
10 duckdb:vortex-file-compressed +6.0% +10.2% -3.8% +30.0% ➖ noise
11 datafusion:vortex-compact -4.5% +6.8% -10.6% +48.2% ➖ noise
11 datafusion:vortex-file-compressed -14.7% +6.8% -20.2% +31.8% ➖ noise
11 duckdb:vortex-compact +8.5% +6.8% +1.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +22.8% +6.8% +15.0% +30.7% ➖ noise
12 datafusion:vortex-compact -6.8% +14.2% -18.4% +32.1% ➖ noise
12 datafusion:vortex-file-compressed +20.5% +14.2% +5.5% +30.0% ➖ noise
12 duckdb:vortex-compact +17.3% +14.2% +2.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +31.2% +14.2% +14.8% +30.0% ➖ noise
13 datafusion:vortex-compact -0.9% +0.9% -1.8% +43.4% ➖ noise
13 datafusion:vortex-file-compressed +19.0% +0.9% +18.0% +99.7% ➖ noise
13 duckdb:vortex-compact +17.3% +0.9% +16.3% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +4.6% +0.9% +3.7% +32.6% ➖ noise
14 datafusion:vortex-compact +4.2% +3.1% +1.1% +34.7% ➖ noise
14 datafusion:vortex-file-compressed +12.9% +3.1% +9.5% +30.0% ➖ noise
14 duckdb:vortex-compact +15.4% +3.1% +12.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +1.8% +3.1% -1.2% +30.4% ➖ noise
15 datafusion:vortex-compact +23.7% +23.2% +0.4% +32.7% ➖ noise
15 datafusion:vortex-file-compressed +26.4% +23.2% +2.6% +56.8% ➖ noise
15 duckdb:vortex-compact -8.9% +23.2% -26.0% +38.0% ➖ noise
15 duckdb:vortex-file-compressed +2.4% +23.2% -16.9% +52.9% ➖ noise
16 datafusion:vortex-compact +7.0% +19.5% -10.4% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +6.1% +19.5% -11.2% +30.0% ➖ noise
16 duckdb:vortex-compact +12.0% +19.5% -6.2% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +4.2% +19.5% -12.8% +30.0% ➖ noise
17 datafusion:vortex-compact -4.7% +32.6% -28.1% +38.0% ✅ faster
17 datafusion:vortex-file-compressed +14.5% +32.6% -13.6% +41.6% ➖ noise
17 duckdb:vortex-compact +4.3% +32.6% -21.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +3.3% +32.6% -22.1% +30.0% ➖ noise
18 datafusion:vortex-compact +29.4% +19.1% +8.6% +45.1% ➖ noise
18 datafusion:vortex-file-compressed +0.0% +19.1% -16.0% +137.4% ➖ noise
18 duckdb:vortex-compact -10.2% +19.1% -24.6% +30.0% ✅ faster
18 duckdb:vortex-file-compressed +13.1% +19.1% -5.0% +30.0% ➖ noise
19 datafusion:vortex-compact -8.3% +25.0% -26.6% +33.0% ✅ faster
19 datafusion:vortex-file-compressed +33.3% +25.0% +6.7% +34.9% ➖ noise
19 duckdb:vortex-compact +1.9% +25.0% -18.5% +37.1% ➖ noise
19 duckdb:vortex-file-compressed +15.8% +25.0% -7.4% +42.9% ➖ noise
20 datafusion:vortex-compact +2.0% +12.3% -9.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -12.6% +12.3% -22.2% +30.0% ➖ noise
20 duckdb:vortex-compact +14.5% +12.3% +1.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +12.2% +12.3% -0.1% +30.0% ➖ noise
21 datafusion:vortex-compact +11.0% +16.3% -4.5% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -28.8% +16.3% -38.8% +30.0% ✅ faster
21 duckdb:vortex-compact +5.9% +16.3% -8.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +4.5% +16.3% -10.2% +30.0% ➖ noise
22 datafusion:vortex-compact +9.5% +6.8% +2.5% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +9.4% +6.8% +2.4% +47.7% ➖ noise
22 duckdb:vortex-compact +6.9% +6.8% +0.1% +30.6% ➖ noise
22 duckdb:vortex-file-compressed +4.8% +6.8% -1.9% +32.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.5%
Vortex (geomean): 1.052x ➖
Parquet (geomean): 1.079x ➖
Shifts: Parquet (control) +7.9% · Median polish +4.9%


datafusion / vortex-file-compressed (1.106x ➖, 0↑ 2↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 52796293 36469461 1.45
fineweb_q01/datafusion:vortex-file-compressed 🚨 713398366 529827821 1.35
fineweb_q02/datafusion:vortex-file-compressed 549800519 526899435 1.04
fineweb_q03/datafusion:vortex-file-compressed 1408830135 1450931170 0.97
fineweb_q04/datafusion:vortex-file-compressed 1410592969 1380544485 1.02
fineweb_q05/datafusion:vortex-file-compressed 1410676249 1319003018 1.07
fineweb_q06/datafusion:vortex-file-compressed 1512773757 1508863463 1.00
fineweb_q07/datafusion:vortex-file-compressed 1391708100 1306095721 1.07
fineweb_q08/datafusion:vortex-file-compressed 561353519 522056229 1.08
datafusion / vortex-compact (1.044x ➖, 1↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 35373445 52285024 0.68
fineweb_q01/datafusion:vortex-compact 🚨 811051486 504136444 1.61
fineweb_q02/datafusion:vortex-compact 660613997 655598478 1.01
fineweb_q03/datafusion:vortex-compact 1873701541 1805899554 1.04
fineweb_q04/datafusion:vortex-compact 2197085239 2186968873 1.00
fineweb_q05/datafusion:vortex-compact 1664803399 1703349264 0.98
fineweb_q06/datafusion:vortex-compact 1473307588 1452287368 1.01
fineweb_q07/datafusion:vortex-compact 1686008006 1373270608 1.23
fineweb_q08/datafusion:vortex-compact 422915997 398350131 1.06
datafusion / parquet (1.084x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1255112448 1152288569 1.09
fineweb_q01/datafusion:parquet 1771041732 1992781035 0.89
fineweb_q02/datafusion:parquet 1902144017 1796969997 1.06
fineweb_q03/datafusion:parquet 1881452178 1635337333 1.15
fineweb_q04/datafusion:parquet 1836049630 1804588469 1.02
fineweb_q05/datafusion:parquet 1784936837 1786597946 1.00
fineweb_q06/datafusion:parquet 1880615327 1755400915 1.07
fineweb_q07/datafusion:parquet 2118977225 1689822296 1.25
fineweb_q08/datafusion:parquet 2145929020 1672255441 1.28
duckdb / vortex-file-compressed (1.069x ➖, 0↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 111270629 84553225 1.32
fineweb_q01/duckdb:vortex-file-compressed 575848315 526321256 1.09
fineweb_q02/duckdb:vortex-file-compressed 462565860 433790252 1.07
fineweb_q03/duckdb:vortex-file-compressed 1504544440 1434389245 1.05
fineweb_q04/duckdb:vortex-file-compressed 1487517782 1453297788 1.02
fineweb_q05/duckdb:vortex-file-compressed 1463066563 1421396787 1.03
fineweb_q06/duckdb:vortex-file-compressed 1650788891 1610995957 1.02
fineweb_q07/duckdb:vortex-file-compressed 1470741290 1380384234 1.07
fineweb_q08/duckdb:vortex-file-compressed 642888271 651248110 0.99
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 79606411 112440532 0.71
fineweb_q01/duckdb:vortex-compact 492627474 489994589 1.01
fineweb_q02/duckdb:vortex-compact 567908041 541749328 1.05
fineweb_q03/duckdb:vortex-compact 1612487059 1610709434 1.00
fineweb_q04/duckdb:vortex-compact 1675203606 1649114211 1.02
fineweb_q05/duckdb:vortex-compact 1520778797 1410668329 1.08
fineweb_q06/duckdb:vortex-compact 1464591948 1364762587 1.07
fineweb_q07/duckdb:vortex-compact 1373871844 1251425872 1.10
fineweb_q08/duckdb:vortex-compact 482332988 496762062 0.97
duckdb / parquet (1.074x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1072094958 1040000354 1.03
fineweb_q01/duckdb:parquet 1713692797 1553519218 1.10
fineweb_q02/duckdb:parquet 1712364365 1492194204 1.15
fineweb_q03/duckdb:parquet 4190532756 3814063380 1.10
fineweb_q04/duckdb:parquet 1857437819 1784895447 1.04
fineweb_q05/duckdb:parquet 2809397781 2583606509 1.09
fineweb_q06/duckdb:parquet 3432724867 3312677178 1.04
fineweb_q07/duckdb:parquet 4000514814 3779783325 1.06
fineweb_q08/duckdb:parquet 1090468941 1017251553 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -32.3% +6.0% -36.2% +163.4% ➖ noise
0 datafusion:vortex-file-compressed +44.8% +6.0% +36.6% +162.4% ➖ noise
0 duckdb:vortex-compact -29.2% +6.0% -33.2% +66.1% ➖ noise
0 duckdb:vortex-file-compressed +31.6% +6.0% +24.2% +45.5% ➖ noise
1 datafusion:vortex-compact +60.9% -1.0% +62.5% +56.3% 🚨 regression
1 datafusion:vortex-file-compressed +34.6% -1.0% +36.0% +81.8% ➖ noise
1 duckdb:vortex-compact +0.5% -1.0% +1.5% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +9.4% -1.0% +10.5% +36.4% ➖ noise
2 datafusion:vortex-compact +0.8% +10.2% -8.6% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +4.3% +10.2% -5.3% +39.4% ➖ noise
2 duckdb:vortex-compact +4.8% +10.2% -4.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +6.6% +10.2% -3.2% +30.0% ➖ noise
3 datafusion:vortex-compact +3.8% +12.4% -7.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -2.9% +12.4% -13.6% +30.0% ➖ noise
3 duckdb:vortex-compact +0.1% +12.4% -11.0% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +4.9% +12.4% -6.7% +30.0% ➖ noise
4 datafusion:vortex-compact +0.5% +2.9% -2.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +2.2% +2.9% -0.7% +30.0% ➖ noise
4 duckdb:vortex-compact +1.6% +2.9% -1.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% +2.9% -0.5% +30.0% ➖ noise
5 datafusion:vortex-compact -2.3% +4.2% -6.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +7.0% +4.2% +2.6% +30.0% ➖ noise
5 duckdb:vortex-compact +7.8% +4.2% +3.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +2.9% +4.2% -1.2% +30.0% ➖ noise
6 datafusion:vortex-compact +1.4% +5.4% -3.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +0.3% +5.4% -4.8% +30.0% ➖ noise
6 duckdb:vortex-compact +7.3% +5.4% +1.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.5% +5.4% -2.7% +30.0% ➖ noise
7 datafusion:vortex-compact +22.8% +15.2% +6.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +6.6% +15.2% -7.5% +30.0% ➖ noise
7 duckdb:vortex-compact +9.8% +15.2% -4.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +6.5% +15.2% -7.5% +30.0% ➖ noise
8 datafusion:vortex-compact +6.2% +17.3% -9.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +7.5% +17.3% -8.3% +30.0% ➖ noise
8 duckdb:vortex-compact -2.9% +17.3% -17.2% +56.2% ➖ noise
8 duckdb:vortex-file-compressed -1.3% +17.3% -15.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.5%
Vortex (geomean): 1.039x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +1.2%


duckdb / vortex-file-compressed (1.062x ➖, 0↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11413533 10747937 1.06
statpopgen_q01/duckdb:vortex-file-compressed 🚨 28530218 19047819 1.50
statpopgen_q02/duckdb:vortex-file-compressed 1334330388 1315816313 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3070426562 2990836897 1.03
statpopgen_q04/duckdb:vortex-file-compressed 3101380838 3074955251 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1428608290 1386934254 1.03
statpopgen_q06/duckdb:vortex-file-compressed 2059797438 2040370479 1.01
statpopgen_q07/duckdb:vortex-file-compressed 218033224 205549072 1.06
statpopgen_q08/duckdb:vortex-file-compressed 224004377 219199574 1.02
statpopgen_q09/duckdb:vortex-file-compressed 2896975733 2875321097 1.01
statpopgen_q10/duckdb:vortex-file-compressed 4677251799 4557430375 1.03
duckdb / vortex-compact (1.017x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11212927 11065220 1.01
statpopgen_q01/duckdb:vortex-compact 168982655 166847854 1.01
statpopgen_q02/duckdb:vortex-compact 1849573492 1803612651 1.03
statpopgen_q03/duckdb:vortex-compact 3544696704 3506085925 1.01
statpopgen_q04/duckdb:vortex-compact 3564054270 3540425088 1.01
statpopgen_q05/duckdb:vortex-compact 1898249255 1818741633 1.04
statpopgen_q06/duckdb:vortex-compact 2720792422 2705610814 1.01
statpopgen_q07/duckdb:vortex-compact 978769315 964891783 1.01
statpopgen_q08/duckdb:vortex-compact 1015496828 991678483 1.02
statpopgen_q09/duckdb:vortex-compact 3391898811 3315342906 1.02
statpopgen_q10/duckdb:vortex-compact 5466803289 5442493127 1.00
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 322753108 317050842 1.02
statpopgen_q01/duckdb:parquet 411176955 399032284 1.03
statpopgen_q02/duckdb:parquet 1008298932 998066313 1.01
statpopgen_q03/duckdb:parquet 1516455875 1513933876 1.00
statpopgen_q04/duckdb:parquet 1528886286 1523860020 1.00
statpopgen_q05/duckdb:parquet 1025492744 1003737699 1.02
statpopgen_q06/duckdb:parquet 1498432811 1474581111 1.02
statpopgen_q07/duckdb:parquet 1907814312 1867284414 1.02
statpopgen_q08/duckdb:parquet 1908829914 1877502070 1.02
statpopgen_q09/duckdb:parquet 1388067267 1374640842 1.01
statpopgen_q10/duckdb:parquet 2684728644 2675885101 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +1.3% +1.8% -0.5% +18.7% ➖ noise
0 duckdb:vortex-file-compressed +6.2% +1.8% +4.3% +10.0% ➖ noise
1 duckdb:vortex-compact +1.3% +3.0% -1.7% +26.3% ➖ noise
1 duckdb:vortex-file-compressed +49.8% +3.0% +45.4% +251.1% ➖ noise
2 duckdb:vortex-compact +2.5% +1.0% +1.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.4% +1.0% +0.4% +10.0% ➖ noise
3 duckdb:vortex-compact +1.1% +0.2% +0.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.7% +0.2% +2.5% +10.0% ➖ noise
4 duckdb:vortex-compact +0.7% +0.3% +0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.9% +0.3% +0.5% +10.0% ➖ noise
5 duckdb:vortex-compact +4.4% +2.2% +2.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.0% +2.2% +0.8% +10.0% ➖ noise
6 duckdb:vortex-compact +0.6% +1.6% -1.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.0% +1.6% -0.7% +10.0% ➖ noise
7 duckdb:vortex-compact +1.4% +2.2% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +6.1% +2.2% +3.8% +10.0% ➖ noise
8 duckdb:vortex-compact +2.4% +1.7% +0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.2% +1.7% +0.5% +10.0% ➖ noise
9 duckdb:vortex-compact +2.3% +1.0% +1.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.8% +1.0% -0.2% +10.0% ➖ noise
10 duckdb:vortex-compact +0.4% +0.3% +0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.6% +0.3% +2.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.0%
Vortex (geomean): 1.068x ➖
Parquet (geomean): 1.136x ➖
Shifts: Parquet (control) +13.6% · Median polish +6.5%


datafusion / vortex-file-compressed (1.075x ➖, 0↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 668023201 691660479 0.97
tpch_q02/datafusion:vortex-file-compressed 661110993 675548084 0.98
tpch_q03/datafusion:vortex-file-compressed 777733057 724248967 1.07
tpch_q04/datafusion:vortex-file-compressed 687629627 587198470 1.17
tpch_q05/datafusion:vortex-file-compressed 976711827 929703911 1.05
tpch_q06/datafusion:vortex-file-compressed 634606371 637327953 1.00
tpch_q07/datafusion:vortex-file-compressed 1025361372 1058214620 0.97
tpch_q08/datafusion:vortex-file-compressed 1159270145 1132656234 1.02
tpch_q09/datafusion:vortex-file-compressed 1380089716 1442146622 0.96
tpch_q10/datafusion:vortex-file-compressed 1287661040 1003384442 1.28
tpch_q11/datafusion:vortex-file-compressed 525564944 536941182 0.98
tpch_q12/datafusion:vortex-file-compressed 1057595827 867688588 1.22
tpch_q13/datafusion:vortex-file-compressed 440620557 426134689 1.03
tpch_q14/datafusion:vortex-file-compressed 584432016 546063387 1.07
tpch_q15/datafusion:vortex-file-compressed 1166704097 1054807260 1.11
tpch_q16/datafusion:vortex-file-compressed 373806990 312821440 1.19
tpch_q17/datafusion:vortex-file-compressed 1156969201 1118127498 1.03
tpch_q18/datafusion:vortex-file-compressed 1249123302 1291813826 0.97
tpch_q19/datafusion:vortex-file-compressed 725290291 656947093 1.10
tpch_q20/datafusion:vortex-file-compressed 930562238 890579742 1.04
tpch_q21/datafusion:vortex-file-compressed 1617194434 1598256687 1.01
tpch_q22/datafusion:vortex-file-compressed 🚨 483790543 306304873 1.58
datafusion / vortex-compact (1.033x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 872989967 675846157 1.29
tpch_q02/datafusion:vortex-compact 767335720 845620220 0.91
tpch_q03/datafusion:vortex-compact 886608586 697890202 1.27
tpch_q04/datafusion:vortex-compact 543523811 495601844 1.10
tpch_q05/datafusion:vortex-compact 977489287 860583241 1.14
tpch_q06/datafusion:vortex-compact 611873489 556515862 1.10
tpch_q07/datafusion:vortex-compact 1029735924 950161549 1.08
tpch_q08/datafusion:vortex-compact 1008970200 1009807520 1.00
tpch_q09/datafusion:vortex-compact 1193099284 1138159137 1.05
tpch_q10/datafusion:vortex-compact 826428375 892039794 0.93
tpch_q11/datafusion:vortex-compact 388749997 470393583 0.83
tpch_q12/datafusion:vortex-compact 750134671 765321395 0.98
tpch_q13/datafusion:vortex-compact 391950352 390151983 1.00
tpch_q14/datafusion:vortex-compact 556418258 535375939 1.04
tpch_q15/datafusion:vortex-compact 1048944031 1040439658 1.01
tpch_q16/datafusion:vortex-compact 287274634 304795292 0.94
tpch_q17/datafusion:vortex-compact 1104250409 1099413103 1.00
tpch_q18/datafusion:vortex-compact 1089650837 1066526373 1.02
tpch_q19/datafusion:vortex-compact 595799997 600421612 0.99
tpch_q20/datafusion:vortex-compact 874929472 774723406 1.13
tpch_q21/datafusion:vortex-compact 1382790821 1350978877 1.02
tpch_q22/datafusion:vortex-compact 363330066 362852218 1.00
datafusion / parquet (1.137x ➖, 0↑ 3↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 890678575 875445354 1.02
tpch_q02/datafusion:parquet 953214307 845375745 1.13
tpch_q03/datafusion:parquet 1013431910 883644781 1.15
tpch_q04/datafusion:parquet 490425543 564760786 0.87
tpch_q05/datafusion:parquet 1185750898 1121654138 1.06
tpch_q06/datafusion:parquet 536063799 497319938 1.08
tpch_q07/datafusion:parquet 1341762298 1246400163 1.08
tpch_q08/datafusion:parquet 1605059341 1501240524 1.07
tpch_q09/datafusion:parquet 1698167602 1719463248 0.99
tpch_q10/datafusion:parquet 2202643329 2012967078 1.09
tpch_q11/datafusion:parquet 🚨 883679429 469262287 1.88
tpch_q12/datafusion:parquet 853587192 710956896 1.20
tpch_q13/datafusion:parquet 🚨 1087592999 676177824 1.61
tpch_q14/datafusion:parquet 897749952 772193022 1.16
tpch_q15/datafusion:parquet 1230674898 1204714539 1.02
tpch_q16/datafusion:parquet 354231713 337719935 1.05
tpch_q17/datafusion:parquet 1433014871 1303578212 1.10
tpch_q18/datafusion:parquet 1470257423 1499730787 0.98
tpch_q19/datafusion:parquet 1144220714 935134169 1.22
tpch_q20/datafusion:parquet 1177665014 1174022874 1.00
tpch_q21/datafusion:parquet 1713896859 1654187107 1.04
tpch_q22/datafusion:parquet 🚨 1083044600 646685595 1.67
duckdb / vortex-file-compressed (1.088x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 619337636 621458042 1.00
tpch_q02/duckdb:vortex-file-compressed 1239860721 1003178598 1.24
tpch_q03/duckdb:vortex-file-compressed 851159506 974485040 0.87
tpch_q04/duckdb:vortex-file-compressed 618013548 601111795 1.03
tpch_q05/duckdb:vortex-file-compressed 1198720225 1018775678 1.18
tpch_q06/duckdb:vortex-file-compressed 803770882 749256069 1.07
tpch_q07/duckdb:vortex-file-compressed 1151623367 985623748 1.17
tpch_q08/duckdb:vortex-file-compressed 1320451575 1357280746 0.97
tpch_q09/duckdb:vortex-file-compressed 1522843207 1517347166 1.00
tpch_q10/duckdb:vortex-file-compressed 1097745869 942235995 1.17
tpch_q11/duckdb:vortex-file-compressed 585096099 572702185 1.02
tpch_q12/duckdb:vortex-file-compressed 786678839 609755293 1.29
tpch_q13/duckdb:vortex-file-compressed 988371019 959214667 1.03
tpch_q14/duckdb:vortex-file-compressed 838542081 786384225 1.07
tpch_q15/duckdb:vortex-file-compressed 502261327 511357951 0.98
tpch_q16/duckdb:vortex-file-compressed 484672564 441574353 1.10
tpch_q17/duckdb:vortex-file-compressed 1008998594 1011441956 1.00
tpch_q18/duckdb:vortex-file-compressed 929608553 819243679 1.13
tpch_q19/duckdb:vortex-file-compressed 840983693 692802815 1.21
tpch_q20/duckdb:vortex-file-compressed 1336373814 1125134312 1.19
tpch_q21/duckdb:vortex-file-compressed 2003227142 1844810313 1.09
tpch_q22/duckdb:vortex-file-compressed 659477184 528857210 1.25
duckdb / vortex-compact (1.079x ➖, 0↑ 1↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 582684227 590504072 0.99
tpch_q02/duckdb:vortex-compact 1101441745 980660031 1.12
tpch_q03/duckdb:vortex-compact 845673174 845616979 1.00
tpch_q04/duckdb:vortex-compact 552220997 474552772 1.16
tpch_q05/duckdb:vortex-compact 987167293 915616574 1.08
tpch_q06/duckdb:vortex-compact 695404741 642598884 1.08
tpch_q07/duckdb:vortex-compact 1044138391 956347145 1.09
tpch_q08/duckdb:vortex-compact 1437949627 1330869007 1.08
tpch_q09/duckdb:vortex-compact 1351858025 1206095882 1.12
tpch_q10/duckdb:vortex-compact 🚨 1611318584 955382481 1.69
tpch_q11/duckdb:vortex-compact 615781457 603536870 1.02
tpch_q12/duckdb:vortex-compact 588027019 658324541 0.89
tpch_q13/duckdb:vortex-compact 836784288 816190537 1.03
tpch_q14/duckdb:vortex-compact 866540506 812516284 1.07
tpch_q15/duckdb:vortex-compact 573750235 524647108 1.09
tpch_q16/duckdb:vortex-compact 339687914 328702701 1.03
tpch_q17/duckdb:vortex-compact 983091238 881382874 1.12
tpch_q18/duckdb:vortex-compact 725261675 804814906 0.90
tpch_q19/duckdb:vortex-compact 747004391 677018985 1.10
tpch_q20/duckdb:vortex-compact 1309273107 1124279418 1.16
tpch_q21/duckdb:vortex-compact 1652948987 1652727355 1.00
tpch_q22/duckdb:vortex-compact 673901076 621228404 1.08
duckdb / parquet (1.135x ➖, 0↑ 0↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1036683798 839923943 1.23
tpch_q02/duckdb:parquet 1682016410 1424994399 1.18
tpch_q03/duckdb:parquet 1521617715 1510956491 1.01
tpch_q04/duckdb:parquet 1042081147 856642443 1.22
tpch_q05/duckdb:parquet 2160842048 1926160126 1.12
tpch_q06/duckdb:parquet 702716948 655558698 1.07
tpch_q07/duckdb:parquet 1694362787 1522773667 1.11
tpch_q08/duckdb:parquet 2403958209 2167309813 1.11
tpch_q09/duckdb:parquet 2372057985 2107781586 1.13
tpch_q10/duckdb:parquet 3199507157 3008220595 1.06
tpch_q11/duckdb:parquet 912320409 836346111 1.09
tpch_q12/duckdb:parquet 1158166955 899178885 1.29
tpch_q13/duckdb:parquet 1193208162 1132157592 1.05
tpch_q14/duckdb:parquet 1204282083 1086802952 1.11
tpch_q15/duckdb:parquet 915973207 844975642 1.08
tpch_q16/duckdb:parquet 827404919 722400911 1.15
tpch_q17/duckdb:parquet 1360470784 1179333253 1.15
tpch_q18/duckdb:parquet 1586132801 1479898728 1.07
tpch_q19/duckdb:parquet 1708320438 1428788803 1.20
tpch_q20/duckdb:parquet 1792667917 1492277912 1.20
tpch_q21/duckdb:parquet 1984977285 1604850530 1.24
tpch_q22/duckdb:parquet 1050318757 914326113 1.15
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +29.2% +12.1% +15.3% +97.2% ➖ noise
1 datafusion:vortex-file-compressed -3.4% +12.1% -13.8% +82.4% ➖ noise
1 duckdb:vortex-compact -1.3% +12.1% -11.9% +35.9% ➖ noise
1 duckdb:vortex-file-compressed -0.3% +12.1% -11.1% +30.0% ➖ noise
2 datafusion:vortex-compact -9.3% +15.4% -21.3% +84.2% ➖ noise
2 datafusion:vortex-file-compressed -2.1% +15.4% -15.2% +84.5% ➖ noise
2 duckdb:vortex-compact +12.3% +15.4% -2.6% +38.3% ➖ noise
2 duckdb:vortex-file-compressed +23.6% +15.4% +7.1% +41.7% ➖ noise
3 datafusion:vortex-compact +27.0% +7.5% +18.2% +79.3% ➖ noise
3 datafusion:vortex-file-compressed +7.4% +7.5% -0.1% +88.5% ➖ noise
3 duckdb:vortex-compact +0.0% +7.5% -6.9% +43.8% ➖ noise
3 duckdb:vortex-file-compressed -12.7% +7.5% -18.7% +46.7% ➖ noise
4 datafusion:vortex-compact +9.7% +2.8% +6.7% +32.9% ➖ noise
4 datafusion:vortex-file-compressed +17.1% +2.8% +13.9% +31.5% ➖ noise
4 duckdb:vortex-compact +16.4% +2.8% +13.2% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.8% +2.8% +0.0% +30.0% ➖ noise
5 datafusion:vortex-compact +13.6% +8.9% +4.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +5.1% +8.9% -3.5% +30.0% ➖ noise
5 duckdb:vortex-compact +7.8% +8.9% -1.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +17.7% +8.9% +8.0% +41.2% ➖ noise
6 datafusion:vortex-compact +9.9% +7.5% +2.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -0.4% +7.5% -7.4% +30.0% ➖ noise
6 duckdb:vortex-compact +8.2% +7.5% +0.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +7.3% +7.5% -0.2% +30.0% ➖ noise
7 datafusion:vortex-compact +8.4% +9.4% -1.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -3.1% +9.4% -11.5% +30.0% ➖ noise
7 duckdb:vortex-compact +9.2% +9.4% -0.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +16.8% +9.4% +6.8% +30.0% ➖ noise
8 datafusion:vortex-compact -0.1% +8.9% -8.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +2.3% +8.9% -6.0% +30.0% ➖ noise
8 duckdb:vortex-compact +8.0% +8.9% -0.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -2.7% +8.9% -10.7% +30.0% ➖ noise
9 datafusion:vortex-compact +4.8% +5.4% -0.6% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -4.3% +5.4% -9.2% +30.0% ➖ noise
9 duckdb:vortex-compact +12.1% +5.4% +6.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +0.4% +5.4% -4.8% +30.0% ➖ noise
10 datafusion:vortex-compact -7.4% +7.9% -14.1% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +28.3% +7.9% +19.0% +41.7% ➖ noise
10 duckdb:vortex-compact +68.7% +7.9% +56.3% +44.0% 🚨 regression
10 duckdb:vortex-file-compressed +16.5% +7.9% +8.0% +36.2% ➖ noise
11 datafusion:vortex-compact -17.4% +43.3% -42.3% +30.0% ✅ faster
11 datafusion:vortex-file-compressed -2.1% +43.3% -31.7% +36.8% ✅ faster
11 duckdb:vortex-compact +2.0% +43.3% -28.8% +30.0% ✅ faster
11 duckdb:vortex-file-compressed +2.2% +43.3% -28.7% +30.0% ✅ faster
12 datafusion:vortex-compact -2.0% +24.4% -21.2% +31.5% ➖ noise
12 datafusion:vortex-file-compressed +21.9% +24.4% -2.0% +38.5% ➖ noise
12 duckdb:vortex-compact -10.7% +24.4% -28.2% +36.0% ✅ faster
12 duckdb:vortex-file-compressed +29.0% +24.4% +3.7% +30.2% ➖ noise
13 datafusion:vortex-compact +0.5% +30.2% -22.8% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +3.4% +30.2% -20.6% +52.8% ➖ noise
13 duckdb:vortex-compact +2.5% +30.2% -21.3% +49.0% ➖ noise
13 duckdb:vortex-file-compressed +3.0% +30.2% -20.9% +61.7% ➖ noise
14 datafusion:vortex-compact +3.9% +13.5% -8.4% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +7.0% +13.5% -5.7% +30.0% ➖ noise
14 duckdb:vortex-compact +6.6% +13.5% -6.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +6.6% +13.5% -6.1% +30.0% ➖ noise
15 datafusion:vortex-compact +0.8% +5.2% -4.2% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +10.6% +5.2% +5.1% +30.0% ➖ noise
15 duckdb:vortex-compact +9.4% +5.2% +3.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -1.8% +5.2% -6.7% +30.0% ➖ noise
16 datafusion:vortex-compact -5.7% +9.6% -14.0% +43.2% ➖ noise
16 datafusion:vortex-file-compressed +19.5% +9.6% +9.0% +30.0% ➖ noise
16 duckdb:vortex-compact +3.3% +9.6% -5.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +9.8% +9.6% +0.1% +30.0% ➖ noise
17 datafusion:vortex-compact +0.4% +12.6% -10.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +3.5% +12.6% -8.1% +30.0% ➖ noise
17 duckdb:vortex-compact +11.5% +12.6% -1.0% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -0.2% +12.6% -11.4% +30.0% ➖ noise
18 datafusion:vortex-compact +2.2% +2.5% -0.3% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -3.3% +2.5% -5.7% +30.0% ➖ noise
18 duckdb:vortex-compact -9.9% +2.5% -12.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +13.5% +2.5% +10.7% +30.0% ➖ noise
19 datafusion:vortex-compact -0.8% +21.0% -18.0% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +10.4% +21.0% -8.7% +30.0% ➖ noise
19 duckdb:vortex-compact +10.3% +21.0% -8.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +21.4% +21.0% +0.4% +30.0% ➖ noise
20 datafusion:vortex-compact +12.9% +9.8% +2.9% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +4.5% +9.8% -4.8% +30.0% ➖ noise
20 duckdb:vortex-compact +16.5% +9.8% +6.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +18.8% +9.8% +8.2% +30.0% ➖ noise
21 datafusion:vortex-compact +2.4% +13.2% -9.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +1.2% +13.2% -10.6% +30.0% ➖ noise
21 duckdb:vortex-compact +0.0% +13.2% -11.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +8.6% +13.2% -4.1% +30.0% ➖ noise
22 datafusion:vortex-compact +0.1% +38.7% -27.8% +30.0% ✅ faster
22 datafusion:vortex-file-compressed +57.9% +38.7% +13.9% +30.0% ➖ noise
22 duckdb:vortex-compact +8.5% +38.7% -21.8% +39.4% ➖ noise
22 duckdb:vortex-file-compressed +24.7% +38.7% -10.1% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 1.246x ❌
Parquet (geomean): 1.189x ❌
Shifts: Parquet (control) +18.9% · Median polish +18.8%


datafusion / vortex-file-compressed (1.285x ❌, 0↑ 40↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2579004 1940607 1.33
clickbench_q01/datafusion:vortex-file-compressed 15515821 14268481 1.09
clickbench_q02/datafusion:vortex-file-compressed 🚨 37881108 33924010 1.12
clickbench_q03/datafusion:vortex-file-compressed 🚨 44579985 36694876 1.21
clickbench_q04/datafusion:vortex-file-compressed 🚨 386541643 307676094 1.26
clickbench_q05/datafusion:vortex-file-compressed 🚨 414048744 319107611 1.30
clickbench_q06/datafusion:vortex-file-compressed 🚨 2744734 2028595 1.35
clickbench_q07/datafusion:vortex-file-compressed 🚨 20481652 17701211 1.16
clickbench_q08/datafusion:vortex-file-compressed 🚨 513614613 369569604 1.39
clickbench_q09/datafusion:vortex-file-compressed 🚨 749719312 550667767 1.36
clickbench_q10/datafusion:vortex-file-compressed 🚨 108662495 74360944 1.46
clickbench_q11/datafusion:vortex-file-compressed 🚨 123594389 84708174 1.46
clickbench_q12/datafusion:vortex-file-compressed 🚨 422864862 280719203 1.51
clickbench_q13/datafusion:vortex-file-compressed 🚨 534926084 419874129 1.27
clickbench_q14/datafusion:vortex-file-compressed 🚨 326725475 252003829 1.30
clickbench_q15/datafusion:vortex-file-compressed 🚨 462429093 367676181 1.26
clickbench_q16/datafusion:vortex-file-compressed 🚨 900541098 689049047 1.31
clickbench_q17/datafusion:vortex-file-compressed 🚨 902869051 677872427 1.33
clickbench_q18/datafusion:vortex-file-compressed 🚨 1844379544 1422366012 1.30
clickbench_q19/datafusion:vortex-file-compressed 🚨 31327782 22598164 1.39
clickbench_q20/datafusion:vortex-file-compressed 🚨 432574422 356035488 1.21
clickbench_q21/datafusion:vortex-file-compressed 🚨 552628737 404536999 1.37
clickbench_q22/datafusion:vortex-file-compressed 🚨 737424275 537195496 1.37
clickbench_q23/datafusion:vortex-file-compressed 🚨 984595582 755079109 1.30
clickbench_q24/datafusion:vortex-file-compressed 🚨 61489660 47316755 1.30
clickbench_q25/datafusion:vortex-file-compressed 🚨 88617613 72304977 1.23
clickbench_q26/datafusion:vortex-file-compressed 🚨 57708219 50093983 1.15
clickbench_q27/datafusion:vortex-file-compressed 888873206 808276425 1.10
clickbench_q28/datafusion:vortex-file-compressed 🚨 7435505038 6726343126 1.11
clickbench_q29/datafusion:vortex-file-compressed 251294203 246535599 1.02
clickbench_q30/datafusion:vortex-file-compressed 🚨 298821666 220083002 1.36
clickbench_q31/datafusion:vortex-file-compressed 🚨 356746165 262748546 1.36
clickbench_q32/datafusion:vortex-file-compressed 🚨 1604398178 1318058161 1.22
clickbench_q33/datafusion:vortex-file-compressed 🚨 1805400823 1419580323 1.27
clickbench_q34/datafusion:vortex-file-compressed 🚨 1801860240 1413958694 1.27
clickbench_q35/datafusion:vortex-file-compressed 🚨 717767798 502536977 1.43
clickbench_q36/datafusion:vortex-file-compressed 🚨 140781190 78318298 1.80
clickbench_q37/datafusion:vortex-file-compressed 🚨 50916639 40606419 1.25
clickbench_q38/datafusion:vortex-file-compressed 🚨 27770507 22865321 1.21
clickbench_q39/datafusion:vortex-file-compressed 🚨 188592336 144826476 1.30
clickbench_q40/datafusion:vortex-file-compressed 🚨 23766450 19166025 1.24
clickbench_q41/datafusion:vortex-file-compressed 🚨 21486649 17198947 1.25
clickbench_q42/datafusion:vortex-file-compressed 🚨 25838629 20232162 1.28
datafusion / parquet (1.219x ❌, 0↑ 40↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 2351397 1822344 1.29
clickbench_q01/datafusion:parquet 22938878 21569955 1.06
clickbench_q02/datafusion:parquet 59869877 56979104 1.05
clickbench_q03/datafusion:parquet 🚨 49190079 43125410 1.14
clickbench_q04/datafusion:parquet 🚨 403777336 334292127 1.21
clickbench_q05/datafusion:parquet 🚨 465351509 364142391 1.28
clickbench_q06/datafusion:parquet 🚨 2579565 1879524 1.37
clickbench_q07/datafusion:parquet 🚨 28662737 24978542 1.15
clickbench_q08/datafusion:parquet 🚨 505651510 402570237 1.26
clickbench_q09/datafusion:parquet 🚨 855278257 640566537 1.34
clickbench_q10/datafusion:parquet 🚨 132440833 109450868 1.21
clickbench_q11/datafusion:parquet 🚨 158606792 135028443 1.17
clickbench_q12/datafusion:parquet 🚨 436462102 356750296 1.22
clickbench_q13/datafusion:parquet 🚨 641467414 505228331 1.27
clickbench_q14/datafusion:parquet 🚨 451851609 351526829 1.29
clickbench_q15/datafusion:parquet 🚨 487694976 380459782 1.28
clickbench_q16/datafusion:parquet 🚨 964211162 677892056 1.42
clickbench_q17/datafusion:parquet 🚨 912944438 669566434 1.36
clickbench_q18/datafusion:parquet 🚨 1696724055 1439805123 1.18
clickbench_q19/datafusion:parquet 🚨 38597443 33094942 1.17
clickbench_q20/datafusion:parquet 🚨 708589039 612688237 1.16
clickbench_q21/datafusion:parquet 🚨 771508276 679295757 1.14
clickbench_q22/datafusion:parquet 🚨 1164759590 939460885 1.24
clickbench_q23/datafusion:parquet 🚨 4513421137 3595467245 1.26
clickbench_q24/datafusion:parquet 🚨 101599807 86611608 1.17
clickbench_q25/datafusion:parquet 🚨 159220175 138730427 1.15
clickbench_q26/datafusion:parquet 🚨 96327592 86644837 1.11
clickbench_q27/datafusion:parquet 🚨 1264048266 1039987140 1.22
clickbench_q28/datafusion:parquet 7161274609 6672996590 1.07
clickbench_q29/datafusion:parquet 🚨 270847512 238805643 1.13
clickbench_q30/datafusion:parquet 🚨 437299764 350045039 1.25
clickbench_q31/datafusion:parquet 🚨 475668966 384764050 1.24
clickbench_q32/datafusion:parquet 🚨 1715088980 1269662066 1.35
clickbench_q33/datafusion:parquet 🚨 2028785552 1514678433 1.34
clickbench_q34/datafusion:parquet 🚨 1984145041 1523767074 1.30
clickbench_q35/datafusion:parquet 🚨 692550320 522405268 1.33
clickbench_q36/datafusion:parquet 🚨 183791813 144952433 1.27
clickbench_q37/datafusion:parquet 🚨 70260285 62493438 1.12
clickbench_q38/datafusion:parquet 🚨 107097492 88609140 1.21
clickbench_q39/datafusion:parquet 🚨 319444077 259264200 1.23
clickbench_q40/datafusion:parquet 🚨 40008403 33889534 1.18
clickbench_q41/datafusion:parquet 🚨 36491072 30933571 1.18
clickbench_q42/datafusion:parquet 🚨 36490424 30422719 1.20
duckdb / vortex-file-compressed (1.208x ❌, 0↑ 40↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 6939268 5916219 1.17
clickbench_q01/duckdb:vortex-file-compressed 🚨 15926977 13945777 1.14
clickbench_q02/duckdb:vortex-file-compressed 🚨 26815313 23897232 1.12
clickbench_q03/duckdb:vortex-file-compressed 🚨 33434161 29525720 1.13
clickbench_q04/duckdb:vortex-file-compressed 🚨 202665634 169710197 1.19
clickbench_q05/duckdb:vortex-file-compressed 🚨 240639050 199443274 1.21
clickbench_q06/duckdb:vortex-file-compressed 🚨 23686584 19060609 1.24
clickbench_q07/duckdb:vortex-file-compressed 🚨 18479224 15255439 1.21
clickbench_q08/duckdb:vortex-file-compressed 🚨 311255889 262308803 1.19
clickbench_q09/duckdb:vortex-file-compressed 🚨 426893734 374608662 1.14
clickbench_q10/duckdb:vortex-file-compressed 🚨 103071949 74566832 1.38
clickbench_q11/duckdb:vortex-file-compressed 🚨 104416062 81696467 1.28
clickbench_q12/duckdb:vortex-file-compressed 🚨 296367235 212250065 1.40
clickbench_q13/duckdb:vortex-file-compressed 🚨 569997566 437754745 1.30
clickbench_q14/duckdb:vortex-file-compressed 🚨 292530000 240895707 1.21
clickbench_q15/duckdb:vortex-file-compressed 🚨 252157993 215569796 1.17
clickbench_q16/duckdb:vortex-file-compressed 🚨 859082043 710270830 1.21
clickbench_q17/duckdb:vortex-file-compressed 🚨 699488909 560816772 1.25
clickbench_q18/duckdb:vortex-file-compressed 🚨 1378089663 1235896309 1.12
clickbench_q19/duckdb:vortex-file-compressed 🚨 29428575 21276929 1.38
clickbench_q20/duckdb:vortex-file-compressed 🚨 461328206 405953172 1.14
clickbench_q21/duckdb:vortex-file-compressed 🚨 493189381 408513857 1.21
clickbench_q22/duckdb:vortex-file-compressed 🚨 688786336 609919124 1.13
clickbench_q23/duckdb:vortex-file-compressed 🚨 917181088 768504772 1.19
clickbench_q24/duckdb:vortex-file-compressed 🚨 70851024 47469694 1.49
clickbench_q25/duckdb:vortex-file-compressed 🚨 92055533 72957920 1.26
clickbench_q26/duckdb:vortex-file-compressed 41750363 43990890 0.95
clickbench_q27/duckdb:vortex-file-compressed 🚨 608310547 532411878 1.14
clickbench_q28/duckdb:vortex-file-compressed 🚨 3494057998 3000128797 1.16
clickbench_q29/duckdb:vortex-file-compressed 31011466 28210086 1.10
clickbench_q30/duckdb:vortex-file-compressed 🚨 232156911 174013369 1.33
clickbench_q31/duckdb:vortex-file-compressed 🚨 345239597 257850969 1.34
clickbench_q32/duckdb:vortex-file-compressed 🚨 1482298437 1244362362 1.19
clickbench_q33/duckdb:vortex-file-compressed 🚨 1840615895 1560179035 1.18
clickbench_q34/duckdb:vortex-file-compressed 🚨 1950988675 1688556727 1.16
clickbench_q35/duckdb:vortex-file-compressed 399972555 367096109 1.09
clickbench_q36/duckdb:vortex-file-compressed 🚨 37458604 32645619 1.15
clickbench_q37/duckdb:vortex-file-compressed 🚨 28065465 23075032 1.22
clickbench_q38/duckdb:vortex-file-compressed 🚨 29425399 23919896 1.23
clickbench_q39/duckdb:vortex-file-compressed 🚨 53774022 45646937 1.18
clickbench_q40/duckdb:vortex-file-compressed 🚨 28181242 22695545 1.24
clickbench_q41/duckdb:vortex-file-compressed 🚨 26365305 21118239 1.25
clickbench_q42/duckdb:vortex-file-compressed 🚨 31242854 23304918 1.34
duckdb / parquet (1.159x ❌, 0↑ 38↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 300054451 219864917 1.36
clickbench_q01/duckdb:parquet 🚨 56123175 50502959 1.11
clickbench_q02/duckdb:parquet 🚨 76111861 64803767 1.17
clickbench_q03/duckdb:parquet 🚨 73680106 63082915 1.17
clickbench_q04/duckdb:parquet 🚨 235115407 202666437 1.16
clickbench_q05/duckdb:parquet 🚨 313420195 276865254 1.13
clickbench_q06/duckdb:parquet 🚨 69053006 60878200 1.13
clickbench_q07/duckdb:parquet 🚨 59529564 53132483 1.12
clickbench_q08/duckdb:parquet 🚨 322015366 266710961 1.21
clickbench_q09/duckdb:parquet 🚨 453429517 394674594 1.15
clickbench_q10/duckdb:parquet 🚨 116437191 94245770 1.24
clickbench_q11/duckdb:parquet 🚨 126158886 108230273 1.17
clickbench_q12/duckdb:parquet 🚨 343891043 294611234 1.17
clickbench_q13/duckdb:parquet 🚨 661888091 515207322 1.28
clickbench_q14/duckdb:parquet 🚨 416572207 326676129 1.28
clickbench_q15/duckdb:parquet 🚨 305540163 242115042 1.26
clickbench_q16/duckdb:parquet 🚨 744961952 613359429 1.21
clickbench_q17/duckdb:parquet 🚨 576359585 509050925 1.13
clickbench_q18/duckdb:parquet 🚨 1231659647 1061741437 1.16
clickbench_q19/duckdb:parquet 🚨 56767269 49908809 1.14
clickbench_q20/duckdb:parquet 🚨 491633379 433549504 1.13
clickbench_q21/duckdb:parquet 🚨 619894792 555376997 1.12
clickbench_q22/duckdb:parquet 🚨 1048879696 922371110 1.14
clickbench_q23/duckdb:parquet 🚨 365288114 317741663 1.15
clickbench_q24/duckdb:parquet 84068330 77686998 1.08
clickbench_q25/duckdb:parquet 148049382 140619378 1.05
clickbench_q26/duckdb:parquet 57385971 52684354 1.09
clickbench_q27/duckdb:parquet 🚨 714089447 647536559 1.10
clickbench_q28/duckdb:parquet 5310944836 4863899299 1.09
clickbench_q29/duckdb:parquet 🚨 67201945 60910905 1.10
clickbench_q30/duckdb:parquet 🚨 346770919 303948960 1.14
clickbench_q31/duckdb:parquet 🚨 398093384 350036117 1.14
clickbench_q32/duckdb:parquet 🚨 1298429498 1141697494 1.14
clickbench_q33/duckdb:parquet 🚨 1497578368 1230940753 1.22
clickbench_q34/duckdb:parquet 🚨 1559452207 1245747709 1.25
clickbench_q35/duckdb:parquet 🚨 405401447 352942216 1.15
clickbench_q36/duckdb:parquet 🚨 75084562 63436437 1.18
clickbench_q37/duckdb:parquet 🚨 60104137 52946778 1.14
clickbench_q38/duckdb:parquet 🚨 65075810 57275900 1.14
clickbench_q39/duckdb:parquet 107729988 98390022 1.09
clickbench_q40/duckdb:parquet 🚨 64939928 55115906 1.18
clickbench_q41/duckdb:parquet 🚨 67957969 59228285 1.15
clickbench_q42/duckdb:parquet 🚨 60819874 52456123 1.16
duckdb / duckdb (1.111x ❌, 0↑ 27↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 20231151 18035491 1.12
clickbench_q01/duckdb:duckdb 35546930 33331886 1.07
clickbench_q02/duckdb:duckdb 🚨 50126955 45020225 1.11
clickbench_q03/duckdb:duckdb 🚨 54368039 47113752 1.15
clickbench_q04/duckdb:duckdb 🚨 254671323 218425827 1.17
clickbench_q05/duckdb:duckdb 357347704 326716830 1.09
clickbench_q06/duckdb:duckdb 🚨 39704919 35452743 1.12
clickbench_q07/duckdb:duckdb 38050723 36052100 1.06
clickbench_q08/duckdb:duckdb 328474586 310471888 1.06
clickbench_q09/duckdb:duckdb 🚨 538228011 478418541 1.13
clickbench_q10/duckdb:duckdb 107366998 98552604 1.09
clickbench_q11/duckdb:duckdb 🚨 122145255 108370432 1.13
clickbench_q12/duckdb:duckdb 338711388 310279877 1.09
clickbench_q13/duckdb:duckdb 🚨 640309589 539462459 1.19
clickbench_q14/duckdb:duckdb 🚨 391829794 352467959 1.11
clickbench_q15/duckdb:duckdb 289564856 271172056 1.07
clickbench_q16/duckdb:duckdb 🚨 774337918 686098087 1.13
clickbench_q17/duckdb:duckdb 659927579 602824586 1.09
clickbench_q18/duckdb:duckdb 🚨 1474788088 1277362863 1.15
clickbench_q19/duckdb:duckdb 37710039 34652406 1.09
clickbench_q20/duckdb:duckdb 975317518 913630105 1.07
clickbench_q21/duckdb:duckdb 1056821566 1037543534 1.02
clickbench_q22/duckdb:duckdb 1155942675 1118046899 1.03
clickbench_q23/duckdb:duckdb 🚨 287546550 255159040 1.13
clickbench_q24/duckdb:duckdb 🚨 69715120 60903248 1.14
clickbench_q25/duckdb:duckdb 133644661 122785080 1.09
clickbench_q26/duckdb:duckdb 60048400 55997760 1.07
clickbench_q27/duckdb:duckdb 1154919846 1155144841 1.00
clickbench_q28/duckdb:duckdb 🚨 5139013444 4635232560 1.11
clickbench_q29/duckdb:duckdb 🚨 56931940 48398548 1.18
clickbench_q30/duckdb:duckdb 🚨 345723487 293825187 1.18
clickbench_q31/duckdb:duckdb 🚨 479582246 431632721 1.11
clickbench_q32/duckdb:duckdb 1609914460 1542628783 1.04
clickbench_q33/duckdb:duckdb 🚨 2297763939 2067305499 1.11
clickbench_q34/duckdb:duckdb 🚨 2381130955 2075445092 1.15
clickbench_q35/duckdb:duckdb 🚨 306323315 263763060 1.16
clickbench_q36/duckdb:duckdb 🚨 46818826 42147223 1.11
clickbench_q37/duckdb:duckdb 🚨 35296898 31165483 1.13
clickbench_q38/duckdb:duckdb 🚨 34122374 30898383 1.10
clickbench_q39/duckdb:duckdb 🚨 81464481 64307132 1.27
clickbench_q40/duckdb:duckdb 🚨 35342791 31260731 1.13
clickbench_q41/duckdb:duckdb 🚨 33923544 30585317 1.11
clickbench_q42/duckdb:duckdb 🚨 36004081 31553751 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +32.9% +32.7% +0.1% +488.8% ➖ noise
0 duckdb:duckdb +12.2% +32.7% -15.5% +248.4% ➖ noise
0 duckdb:vortex-file-compressed +17.3% +32.7% -11.6% +290.3% ➖ noise
1 datafusion:vortex-file-compressed +8.7% +8.7% +0.0% +23.7% ➖ noise
1 duckdb:duckdb +6.6% +8.7% -1.9% +56.7% ➖ noise
1 duckdb:vortex-file-compressed +14.2% +8.7% +5.1% +17.7% ➖ noise
2 datafusion:vortex-file-compressed +11.7% +11.1% +0.5% +27.9% ➖ noise
2 duckdb:duckdb +11.3% +11.1% +0.2% +19.9% ➖ noise
2 duckdb:vortex-file-compressed +12.2% +11.1% +1.0% +14.9% ➖ noise
3 datafusion:vortex-file-compressed +21.5% +15.4% +5.3% +155.9% ➖ noise
3 duckdb:duckdb +15.4% +15.4% -0.0% +48.3% ➖ noise
3 duckdb:vortex-file-compressed +13.2% +15.4% -1.9% +31.3% ➖ noise
4 datafusion:vortex-file-compressed +25.6% +18.4% +6.1% +14.3% ➖ noise
4 duckdb:duckdb +16.6% +18.4% -1.5% +14.3% ➖ noise
4 duckdb:vortex-file-compressed +19.4% +18.4% +0.9% +14.3% ➖ noise
5 datafusion:vortex-file-compressed +29.8% +20.3% +7.9% +14.3% ➖ noise
5 duckdb:duckdb +9.4% +20.3% -9.1% +14.3% ➖ noise
5 duckdb:vortex-file-compressed +20.7% +20.3% +0.3% +14.3% ➖ noise
6 datafusion:vortex-file-compressed +35.3% +24.8% +8.4% +45.3% ➖ noise
6 duckdb:duckdb +12.0% +24.8% -10.2% +26.8% ➖ noise
6 duckdb:vortex-file-compressed +24.3% +24.8% -0.4% +14.5% ➖ noise
7 datafusion:vortex-file-compressed +15.7% +13.4% +2.0% +17.5% ➖ noise
7 duckdb:duckdb +5.5% +13.4% -6.9% +14.3% ➖ noise
7 duckdb:vortex-file-compressed +21.1% +13.4% +6.8% +14.3% ➖ noise
8 datafusion:vortex-file-compressed +39.0% +23.1% +12.9% +14.3% ➖ noise
8 duckdb:duckdb +5.8% +23.1% -14.1% +14.3% ✅ faster
8 duckdb:vortex-file-compressed +18.7% +23.1% -3.6% +14.3% ➖ noise
9 datafusion:vortex-file-compressed +36.1% +23.9% +9.9% +14.3% ➖ noise
9 duckdb:duckdb +12.5% +23.9% -9.2% +14.3% ➖ noise
9 duckdb:vortex-file-compressed +14.0% +23.9% -8.0% +14.3% ➖ noise
10 datafusion:vortex-file-compressed +46.1% +22.3% +19.5% +14.3% 🚨 regression
10 duckdb:duckdb +8.9% +22.3% -10.9% +14.3% ➖ noise
10 duckdb:vortex-file-compressed +38.2% +22.3% +13.1% +14.3% ➖ noise
11 datafusion:vortex-file-compressed +45.9% +17.0% +24.7% +14.3% 🚨 regression
11 duckdb:duckdb +12.7% +17.0% -3.7% +14.3% ➖ noise
11 duckdb:vortex-file-compressed +27.8% +17.0% +9.2% +14.3% ➖ noise
12 datafusion:vortex-file-compressed +50.6% +19.5% +26.1% +17.4% 🚨 regression
12 duckdb:duckdb +9.2% +19.5% -8.7% +14.3% ➖ noise
12 duckdb:vortex-file-compressed +39.6% +19.5% +16.8% +14.3% 🚨 regression
13 datafusion:vortex-file-compressed +27.4% +27.7% -0.2% +14.3% ➖ noise
13 duckdb:duckdb +18.7% +27.7% -7.1% +14.3% ➖ noise
13 duckdb:vortex-file-compressed +30.2% +27.7% +2.0% +14.3% ➖ noise
14 datafusion:vortex-file-compressed +29.7% +28.0% +1.3% +14.3% ➖ noise
14 duckdb:duckdb +11.2% +28.0% -13.2% +14.3% ✅ faster
14 duckdb:vortex-file-compressed +21.4% +28.0% -5.2% +14.3% ➖ noise
15 datafusion:vortex-file-compressed +25.8% +27.2% -1.1% +14.3% ➖ noise
15 duckdb:duckdb +6.8% +27.2% -16.0% +14.3% ✅ faster
15 duckdb:vortex-file-compressed +17.0% +27.2% -8.0% +14.3% ➖ noise
16 datafusion:vortex-file-compressed +30.7% +31.4% -0.6% +14.3% ➖ noise
16 duckdb:duckdb +12.9% +31.4% -14.1% +14.3% ✅ faster
16 duckdb:vortex-file-compressed +21.0% +31.4% -8.0% +16.7% ➖ noise
17 datafusion:vortex-file-compressed +33.2% +24.2% +7.2% +14.3% ➖ noise
17 duckdb:duckdb +9.5% +24.2% -11.9% +14.3% ➖ noise
17 duckdb:vortex-file-compressed +24.7% +24.2% +0.4% +14.3% ➖ noise
18 datafusion:vortex-file-compressed +29.7% +16.9% +10.9% +14.3% ➖ noise
18 duckdb:duckdb +15.5% +16.9% -1.3% +14.3% ➖ noise
18 duckdb:vortex-file-compressed +11.5% +16.9% -4.6% +14.4% ➖ noise
19 datafusion:vortex-file-compressed +38.6% +15.2% +20.4% +14.3% 🚨 regression
19 duckdb:duckdb +8.8% +15.2% -5.5% +14.3% ➖ noise
19 duckdb:vortex-file-compressed +38.3% +15.2% +20.1% +26.9% ➖ noise
20 datafusion:vortex-file-compressed +21.5% +14.5% +6.1% +155.4% ➖ noise
20 duckdb:duckdb +6.8% +14.5% -6.8% +26.5% ➖ noise
20 duckdb:vortex-file-compressed +13.6% +14.5% -0.8% +15.0% ➖ noise
21 datafusion:vortex-file-compressed +36.6% +12.6% +21.3% +14.3% 🚨 regression
21 duckdb:duckdb +1.9% +12.6% -9.5% +14.3% ➖ noise
21 duckdb:vortex-file-compressed +20.7% +12.6% +7.2% +14.3% ➖ noise
22 datafusion:vortex-file-compressed +37.3% +18.7% +15.6% +14.3% 🚨 regression
22 duckdb:duckdb +3.4% +18.7% -12.9% +14.3% ✅ faster
22 duckdb:vortex-file-compressed +12.9% +18.7% -4.9% +18.4% ➖ noise
23 datafusion:vortex-file-compressed +30.4% +20.1% +8.5% +31.6% ➖ noise
23 duckdb:duckdb +12.7% +20.1% -6.2% +14.3% ➖ noise
23 duckdb:vortex-file-compressed +19.3% +20.1% -0.7% +36.9% ➖ noise
24 datafusion:vortex-file-compressed +30.0% +12.7% +15.3% +18.5% ➖ noise
24 duckdb:duckdb +14.5% +12.7% +1.6% +14.3% ➖ noise
24 duckdb:vortex-file-compressed +49.3% +12.7% +32.5% +30.9% 🚨 regression
25 datafusion:vortex-file-compressed +22.6% +9.9% +11.5% +14.3% ➖ noise
25 duckdb:duckdb +8.8% +9.9% -1.0% +14.3% ➖ noise
25 duckdb:vortex-file-compressed +26.2% +9.9% +14.8% +14.3% 🚨 regression
26 datafusion:vortex-file-compressed +15.2% +10.0% +4.7% +14.4% ➖ noise
26 duckdb:duckdb +7.2% +10.0% -2.6% +14.3% ➖ noise
26 duckdb:vortex-file-compressed -5.1% +10.0% -13.8% +51.6% ➖ noise
27 datafusion:vortex-file-compressed +10.0% +15.8% -5.0% +14.3% ➖ noise
27 duckdb:duckdb -0.0% +15.8% -13.6% +14.3% ✅ faster
27 duckdb:vortex-file-compressed +14.3% +15.8% -1.3% +14.3% ➖ noise
28 datafusion:vortex-file-compressed +10.5% +8.3% +2.1% +14.3% ➖ noise
28 duckdb:duckdb +10.9% +8.3% +2.4% +14.3% ➖ noise
28 duckdb:vortex-file-compressed +16.5% +8.3% +7.6% +14.3% ➖ noise
29 datafusion:vortex-file-compressed +1.9% +11.9% -8.9% +14.3% ➖ noise
29 duckdb:duckdb +17.6% +11.9% +5.2% +14.3% ➖ noise
29 duckdb:vortex-file-compressed +9.9% +11.9% -1.7% +14.3% ➖ noise
30 datafusion:vortex-file-compressed +35.8% +19.4% +13.7% +14.3% ➖ noise
30 duckdb:duckdb +17.7% +19.4% -1.4% +14.3% ➖ noise
30 duckdb:vortex-file-compressed +33.4% +19.4% +11.8% +14.3% ➖ noise
31 datafusion:vortex-file-compressed +35.8% +18.6% +14.5% +14.3% 🚨 regression
31 duckdb:duckdb +11.1% +18.6% -6.3% +14.3% ➖ noise
31 duckdb:vortex-file-compressed +33.9% +18.6% +12.9% +14.3% ➖ noise
32 datafusion:vortex-file-compressed +21.7% +23.9% -1.8% +25.0% ➖ noise
32 duckdb:duckdb +4.4% +23.9% -15.8% +14.3% ✅ faster
32 duckdb:vortex-file-compressed +19.1% +23.9% -3.9% +14.3% ➖ noise
33 datafusion:vortex-file-compressed +27.2% +27.7% -0.4% +14.3% ➖ noise
33 duckdb:duckdb +11.1% +27.7% -12.9% +14.3% ✅ faster
33 duckdb:vortex-file-compressed +18.0% +27.7% -7.6% +14.3% ➖ noise
34 datafusion:vortex-file-compressed +27.4% +27.7% -0.2% +14.3% ➖ noise
34 duckdb:duckdb +14.7% +27.7% -10.1% +14.3% ➖ noise
34 duckdb:vortex-file-compressed +15.5% +27.7% -9.5% +14.3% ➖ noise
35 datafusion:vortex-file-compressed +42.8% +23.4% +15.7% +14.3% 🚨 regression
35 duckdb:duckdb +16.1% +23.4% -5.9% +14.3% ➖ noise
35 duckdb:vortex-file-compressed +9.0% +23.4% -11.7% +14.3% ➖ noise
36 datafusion:vortex-file-compressed +79.8% +22.5% +46.7% +14.3% 🚨 regression
36 duckdb:duckdb +11.1% +22.5% -9.3% +14.3% ➖ noise
36 duckdb:vortex-file-compressed +14.7% +22.5% -6.3% +14.3% ➖ noise
37 datafusion:vortex-file-compressed +25.4% +13.0% +11.0% +14.3% ➖ noise
37 duckdb:duckdb +13.3% +13.0% +0.3% +14.3% ➖ noise
37 duckdb:vortex-file-compressed +21.6% +13.0% +7.7% +14.3% ➖ noise
38 datafusion:vortex-file-compressed +21.5% +17.2% +3.6% +14.3% ➖ noise
38 duckdb:duckdb +10.4% +17.2% -5.8% +14.3% ➖ noise
38 duckdb:vortex-file-compressed +23.0% +17.2% +5.0% +14.3% ➖ noise
39 datafusion:vortex-file-compressed +30.2% +16.1% +12.1% +14.3% ➖ noise
39 duckdb:duckdb +26.7% +16.1% +9.1% +17.2% ➖ noise
39 duckdb:vortex-file-compressed +17.8% +16.1% +1.4% +14.3% ➖ noise
40 datafusion:vortex-file-compressed +24.0% +17.9% +5.1% +23.7% ➖ noise
40 duckdb:duckdb +13.1% +17.9% -4.1% +14.3% ➖ noise
40 duckdb:vortex-file-compressed +24.2% +17.9% +5.3% +14.3% ➖ noise
41 datafusion:vortex-file-compressed +24.9% +16.3% +7.4% +14.3% ➖ noise
41 duckdb:duckdb +10.9% +16.3% -4.7% +14.3% ➖ noise
41 duckdb:vortex-file-compressed +24.8% +16.3% +7.3% +14.3% ➖ noise
42 datafusion:vortex-file-compressed +27.7% +17.9% +8.3% +14.3% ➖ noise
42 duckdb:duckdb +14.1% +17.9% -3.2% +14.3% ➖ noise
42 duckdb:vortex-file-compressed +34.1% +17.9% +13.7% +14.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.955x ➖
Parquet (geomean): 1.086x ➖


unknown / unknown (1.033x ➖, 9↑ 13↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2139313 2564836 0.83
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1301004 1323781 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11783441252 11540315901 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11174855642 11314446910 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8098859 8166764 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6673026 6261850 1.07
random-access/feature-vectors/uniform/lance-tokio-local-disk 1503730 1514375 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2534843 2460270 1.03
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11519644889 11337462379 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11747275206 11477568861 1.02
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12626780 14316638 0.88
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12730042 14194089 0.90
random-access/lance-tokio-local-disk 775309 756032 1.03
random-access/lance-tokio-local-disk-footer 🚨 1594626 1404986 1.13
random-access/nested-lists/correlated/lance-tokio-local-disk 275054 265572 1.04
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 735033 722901 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk 151231510 139650730 1.08
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 148947683 139217201 1.07
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 864437 711737 1.21
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 852269 714115 1.19
random-access/nested-lists/uniform/lance-tokio-local-disk 🚨 1378770 1185900 1.16
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 1984957 1674853 1.19
random-access/nested-lists/uniform/parquet-tokio-local-disk 150058331 137543611 1.09
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 149071020 137792790 1.08
random-access/nested-lists/uniform/vortex-tokio-local-disk 2391619 2393665 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2527285 2578964 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk 445777 434248 1.03
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 691251 641794 1.08
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 32594738 25494876 1.28
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 32434630 25885125 1.25
random-access/nested-structs/correlated/vortex-tokio-local-disk 920903 895423 1.03
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 924869 892273 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk 3054349 2812694 1.09
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 3692229 3059951 1.21
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 31571082 25705219 1.23
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 30153513 25549936 1.18
random-access/nested-structs/uniform/vortex-tokio-local-disk 1802428 1744801 1.03
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1806135 1739853 1.04
random-access/parquet-tokio-local-disk 191681237 189527044 1.01
random-access/parquet-tokio-local-disk-footer 189144363 187733227 1.01
random-access/taxi/correlated/lance-tokio-local-disk 1081216 992316 1.09
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚨 1916679 1716343 1.12
random-access/taxi/correlated/parquet-tokio-local-disk 280715623 280711213 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 304004740 278068321 1.09
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 2065607 2484565 0.83
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 2002506 2426462 0.83
random-access/taxi/uniform/lance-tokio-local-disk 🚨 9924625 8645541 1.15
random-access/taxi/uniform/lance-tokio-local-disk-footer 9823513 9354009 1.05
random-access/taxi/uniform/parquet-tokio-local-disk 🚨 322812025 293040264 1.10
random-access/taxi/uniform/parquet-tokio-local-disk-footer 323058391 297667382 1.09
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4461915 5379547 0.83
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4573208 5398242 0.85
random-access/vortex-tokio-local-disk 🚀 1428053 1741219 0.82
random-access/vortex-tokio-local-disk-footer 🚀 1431656 1767069 0.81

@danking
Copy link
Copy Markdown
Contributor

danking commented Mar 27, 2026

Ah we don't have any python-side benchmarks :|

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.005x ➖
Parquet (geomean): 0.992x ➖


unknown / unknown (0.989x ➖, 5↑ 3↓)
name PR edb409b (ns) base 6fade3c (ns) ratio (PR/base)
compress time/Arade 1150633922 1147688442 1.00
compress time/Bimbo 7133646537 7280209721 0.98
compress time/CMSprovider 3046746109 3078994240 0.99
compress time/Euro2016 431532402 434712607 0.99
compress time/Food 408961863 421114038 0.97
compress time/HashTags 935447990 958323070 0.98
compress time/TPC-H l_comment canonical 1366048506 1332124505 1.03
compress time/TPC-H l_comment chunked 1348744515 1378524647 0.98
compress time/taxi 738817687 748611767 0.99
compress time/wide table cols=100 chunks=1 rows=1000 15389374 15691452 0.98
compress time/wide table cols=100 chunks=50 rows=1000 16423925 15946148 1.03
compress time/wide table cols=1000 chunks=1 rows=1000 152144867 158933838 0.96
compress time/wide table cols=1000 chunks=50 rows=1000 152196529 157625464 0.97
compress time/wide table cols=10000 chunks=1 rows=1000 1530073467 1564612448 0.98
compress time/wide table cols=10000 chunks=50 rows=1000 1522121945 1553481255 0.98
decompress time/Arade 30300456 30625373 0.99
decompress time/Bimbo 100377667 98445777 1.02
decompress time/CMSprovider 86196038 87605079 0.98
decompress time/Euro2016 21430097 22619324 0.95
decompress time/Food 🚀 8752748 9801106 0.89
decompress time/HashTags 83885086 86323288 0.97
decompress time/TPC-H l_comment canonical 43571845 42184975 1.03
decompress time/TPC-H l_comment chunked 44194880 45594529 0.97
decompress time/taxi 20374483 21852692 0.93
decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2549082 2920539 0.87
decompress time/wide table cols=100 chunks=50 rows=1000 2512312 2634059 0.95
decompress time/wide table cols=1000 chunks=1 rows=1000 22824182 23160621 0.99
decompress time/wide table cols=1000 chunks=50 rows=1000 22917197 23700439 0.97
decompress time/wide table cols=10000 chunks=1 rows=1000 235736210 241457265 0.98
decompress time/wide table cols=10000 chunks=50 rows=1000 233718947 239713859 0.97
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 🚀 3036521174 3449894508 0.88
parquet_rs-zstd compress time/Bimbo 17425384546 17895706392 0.97
parquet_rs-zstd compress time/CMSprovider 7818556309 8330955021 0.94
parquet_rs-zstd compress time/Euro2016 1360032125 1410009370 0.96
parquet_rs-zstd compress time/Food 951237933 1004537766 0.95
parquet_rs-zstd compress time/HashTags 2475538738 2747765778 0.90
parquet_rs-zstd compress time/TPC-H l_comment canonical 3087349226 3411486895 0.90
parquet_rs-zstd compress time/TPC-H l_comment chunked 3075286247 3295846083 0.93
parquet_rs-zstd compress time/taxi 1524248994 1574395958 0.97
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6929810 6936318 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6981872 6912258 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 88197231 90852004 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 90160205 90667629 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 969799477 952055775 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 949160017 957667210 0.99
parquet_rs-zstd decompress time/Arade 652812283 694421187 0.94
parquet_rs-zstd decompress time/Bimbo 1821509167 1782833627 1.02
parquet_rs-zstd decompress time/CMSprovider 1943170306 1969060471 0.99
parquet_rs-zstd decompress time/Euro2016 387013543 395668790 0.98
parquet_rs-zstd decompress time/Food 225052647 230830510 0.97
parquet_rs-zstd decompress time/HashTags 🚀 634430441 726401460 0.87
parquet_rs-zstd decompress time/TPC-H l_comment canonical 569540941 588490267 0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked 566213207 579769813 0.98
parquet_rs-zstd decompress time/taxi 254136268 251389249 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2699762 2736189 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2726804 2709673 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32391913 33102066 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32180647 33465109 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 374956984 385351258 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 372828100 383270416 0.97
vortex-file-compressed size/Arade 143435604 143435604 1.00
vortex-file-compressed size/Bimbo 526882596 526882596 1.00
vortex-file-compressed size/CMSprovider 448399308 448399308 1.00
vortex-file-compressed size/Euro2016 164984372 164916548 1.00
vortex-file-compressed size/Food 44208064 44208064 1.00
vortex-file-compressed size/HashTags 195421908 195421908 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179481808 179481808 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179481808 179481808 1.00
vortex-file-compressed size/taxi 51543292 51543292 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 🚨 0 0 1.14
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.05
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio compress time/Food 0 0 1.03
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.08
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 🚨 0 0 1.13
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio compress time/taxi 0 0 1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.05
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.97
vortex:parquet-zstd ratio decompress time/Food 0 0 0.92
vortex:parquet-zstd ratio decompress time/HashTags 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.07
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.92
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 🚀 0 1 0.88
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@AdamGS AdamGS merged commit b524763 into develop Mar 27, 2026
76 checks passed
@AdamGS AdamGS deleted the adamg/cache-python-class-imports branch March 27, 2026 15:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement lang/python Relates to the Vortex Python API

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants