Skip to content

Conversation

@0ax1
Copy link
Contributor

@0ax1 0ax1 commented Jun 20, 2025

No description provided.

@0ax1 0ax1 requested a review from joseph-isaacs June 20, 2025 10:41
@0ax1 0ax1 force-pushed the ad/wire-up-ddb-clickbench branch from b4b51dd to 0fbfd22 Compare June 20, 2025 10:43
enum EngineCtx {
DataFusion(DataFusionCtx),
DuckDB(DuckDBCtx),
DuckDB(ddb2::DuckDBCtx),
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The 2 suffix will go away once TPC-H is moved over too.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

dont forget tpc-ds 🙈

@0ax1 0ax1 added chore Release label indicating a trivial change benchmark-sql labels Jun 20, 2025
@0ax1 0ax1 force-pushed the ad/wire-up-ddb-clickbench branch 2 times, most recently from e61d455 to 6edd161 Compare June 20, 2025 11:11
EngineCtx::DuckDB(DuckDBCtx {
duckdb_path: duckdb_path.to_path_buf(),
})
fn new_with_duckdb() -> anyhow::Result<Self> {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🥳

@github-actions
Copy link
Contributor

github-actions bot commented Jun 20, 2025

Benchmarks: TPC-H on NVME

Table of Results
name PR d9b7c16 base 403729e ratio (PR/base) unit
tpch_q01/DataFusion:arrow 62880757 6.18075e+07 1.01737 ns
tpch_q02/DataFusion:arrow 19828791 1.88626e+07 1.05122 ns
tpch_q03/DataFusion:arrow 22707443 2.13686e+07 1.06265 ns
tpch_q04/DataFusion:arrow 19491519 1.89447e+07 1.02887 ns
tpch_q05/DataFusion:arrow 32913900 3.18629e+07 1.03298 ns
tpch_q06/DataFusion:arrow 7718605 7.0031e+06 1.10217 ns
tpch_q07/DataFusion:arrow 54850572 5.38718e+07 1.01817 ns
tpch_q08/DataFusion:arrow 19982642 1.88572e+07 1.05968 ns
tpch_q09/DataFusion:arrow 35432905 3.47593e+07 1.01938 ns
tpch_q10/DataFusion:arrow 33494948 3.17748e+07 1.05414 ns
tpch_q11/DataFusion:arrow 8036103 7.94273e+06 1.01176 ns
tpch_q12/DataFusion:arrow 23170086 2.19278e+07 1.05666 ns
tpch_q13/DataFusion:arrow 15037371 1.51948e+07 0.989636 ns
tpch_q14/DataFusion:arrow 8166353 7.79165e+06 1.04809 ns
tpch_q15/DataFusion:arrow 15643721 1.49032e+07 1.04969 ns
tpch_q16/DataFusion:arrow 17668078 1.71052e+07 1.0329 ns
tpch_q17/DataFusion:arrow 49252453 4.92918e+07 0.999202 ns
tpch_q18/DataFusion:arrow 109227950 1.09598e+08 0.99662 ns
tpch_q19/DataFusion:arrow 17467964 1.64391e+07 1.06258 ns
tpch_q20/DataFusion:arrow 21642312 2.11203e+07 1.02472 ns
tpch_q21/DataFusion:arrow 81866864 8.13635e+07 1.00619 ns
tpch_q22/DataFusion:arrow 10356025 9.73846e+06 1.06341 ns
tpch_q01/DataFusion:parquet 81490204 8.07353e+07 1.00935 ns
tpch_q02/DataFusion:parquet 65877909 6.95036e+07 0.947835 ns
tpch_q03/DataFusion:parquet 43998699 4.19332e+07 1.04926 ns
tpch_q04/DataFusion:parquet 22389171 2.10864e+07 1.06178 ns
tpch_q05/DataFusion:parquet 63997872 6.29575e+07 1.01652 ns
tpch_q06/DataFusion:parquet 17494484 1.68086e+07 1.04081 ns
tpch_q07/DataFusion:parquet 100586638 9.90241e+07 1.01578 ns
tpch_q08/DataFusion:parquet 75378933 7.39517e+07 1.0193 ns
tpch_q09/DataFusion:parquet 103721664 1.01831e+08 1.01856 ns
tpch_q10/DataFusion:parquet 81554232 7.66577e+07 1.06387 ns
tpch_q11/DataFusion:parquet 32371234 3.19898e+07 1.01192 ns
tpch_q12/DataFusion:parquet 34403445 3.20779e+07 1.0725 ns
tpch_q13/DataFusion:parquet 38404314 3.7202e+07 1.03232 ns
tpch_q14/DataFusion:parquet 23596540 2.30164e+07 1.02521 ns
tpch_q15/DataFusion:parquet 41460407 3.92378e+07 1.05664 ns
tpch_q16/DataFusion:parquet 31653084 2.88605e+07 1.09676 ns
tpch_q17/DataFusion:parquet 92007180 9.02988e+07 1.01892 ns
tpch_q18/DataFusion:parquet 127989764 1.23067e+08 1.04 ns
tpch_q19/DataFusion:parquet 39753774 4.13072e+07 0.962394 ns
tpch_q20/DataFusion:parquet 59938384 5.57966e+07 1.07423 ns
tpch_q21/DataFusion:parquet 131004014 1.23672e+08 1.05929 ns
tpch_q22/DataFusion:parquet 34884716 3.41027e+07 1.02293 ns
tpch_q01/DataFusion:vortex-file-compressed 58367429 5.24401e+07 1.11303 ns
tpch_q02/DataFusion:vortex-file-compressed 50888909 4.9208e+07 1.03416 ns
tpch_q03/DataFusion:vortex-file-compressed 30202828 2.90007e+07 1.04145 ns
tpch_q04/DataFusion:vortex-file-compressed 16823412 1.62553e+07 1.03495 ns
tpch_q05/DataFusion:vortex-file-compressed 55201104 5.28154e+07 1.04517 ns
tpch_q06/DataFusion:vortex-file-compressed 7392087 7.14136e+06 1.03511 ns
tpch_q07/DataFusion:vortex-file-compressed 82692352 8.1672e+07 1.01249 ns
tpch_q08/DataFusion:vortex-file-compressed 59670562 5.58281e+07 1.06883 ns
tpch_q09/DataFusion:vortex-file-compressed 90295402 8.71798e+07 1.03574 ns
tpch_q10/DataFusion:vortex-file-compressed 42896069 3.78932e+07 1.13203 ns
tpch_q11/DataFusion:vortex-file-compressed 27305169 2.57724e+07 1.05947 ns
tpch_q12/DataFusion:vortex-file-compressed 19079501 1.76314e+07 1.08213 ns
tpch_q13/DataFusion:vortex-file-compressed 19986775 1.93354e+07 1.03369 ns
tpch_q14/DataFusion:vortex-file-compressed 11000350 1.06992e+07 1.02815 ns
tpch_q15/DataFusion:vortex-file-compressed 18627012 1.78813e+07 1.0417 ns
tpch_q16/DataFusion:vortex-file-compressed 26985713 2.57546e+07 1.0478 ns
tpch_q17/DataFusion:vortex-file-compressed 78395058 7.65461e+07 1.02415 ns
tpch_q18/DataFusion:vortex-file-compressed 113543261 1.0914e+08 1.04035 ns
tpch_q19/DataFusion:vortex-file-compressed 14983435 1.42033e+07 1.05493 ns
tpch_q20/DataFusion:vortex-file-compressed 34008635 3.39455e+07 1.00186 ns
tpch_q21/DataFusion:vortex-file-compressed 105780278 1.03952e+08 1.01759 ns
tpch_q22/DataFusion:vortex-file-compressed 12797725 1.21933e+07 1.04957 ns
tpch_q01/DuckDB:parquet 35000000 3.6e+07 0.972222 ns
tpch_q02/DuckDB:parquet 26000000 2.6e+07 1 ns
tpch_q03/DuckDB:parquet 35000000 3.6e+07 0.972222 ns
tpch_q04/DuckDB:parquet 25000000 2.6e+07 0.961538 ns
tpch_q05/DuckDB:parquet 37000000 3.7e+07 1 ns
tpch_q06/DuckDB:parquet 13000000 1.2e+07 1.08333 ns
tpch_q07/DuckDB:parquet 42000000 4.2e+07 1 ns
tpch_q08/DuckDB:parquet 43000000 4.4e+07 0.977273 ns
tpch_q09/DuckDB:parquet 81000000 8.2e+07 0.987805 ns
tpch_q10/DuckDB:parquet 83000000 8.2e+07 1.0122 ns
tpch_q11/DuckDB:parquet 15000000 1.4e+07 1.07143 ns
tpch_q12/DuckDB:parquet 26000000 2.5e+07 1.04 ns
tpch_q13/DuckDB:parquet 47000000 4.7e+07 1 ns
tpch_q14/DuckDB:parquet 30000000 3e+07 1 ns
tpch_q15/DuckDB:parquet 36000000 3.8e+07 0.947368 ns
tpch_q16/DuckDB:parquet 49000000 4.9e+07 1 ns
tpch_q17/DuckDB:parquet 36000000 3.6e+07 1 ns
tpch_q18/DuckDB:parquet 47000000 4.7e+07 1 ns
tpch_q19/DuckDB:parquet 43000000 4.2e+07 1.02381 ns
tpch_q20/DuckDB:parquet 38000000 3.6e+07 1.05556 ns
tpch_q21/DuckDB:parquet 103000000 1.01e+08 1.0198 ns
tpch_q22/DuckDB:parquet 32000000 3.2e+07 1 ns
tpch_q01/DuckDB:vortex-file-compressed 50000000 5.5e+07 0.909091 ns
tpch_q02/DuckDB:vortex-file-compressed 33000000 3.4e+07 0.970588 ns
tpch_q03/DuckDB:vortex-file-compressed 53000000 5.1e+07 1.03922 ns
tpch_q04/DuckDB:vortex-file-compressed 45000000 4.5e+07 1 ns
tpch_q05/DuckDB:vortex-file-compressed 58000000 5.9e+07 0.983051 ns
tpch_q06/DuckDB:vortex-file-compressed 4000000 4e+06 1 ns
tpch_q07/DuckDB:vortex-file-compressed 58000000 5.9e+07 0.983051 ns
tpch_q08/DuckDB:vortex-file-compressed 67000000 6.6e+07 1.01515 ns
tpch_q09/DuckDB:vortex-file-compressed 83000000 8.8e+07 0.943182 ns
tpch_q10/DuckDB:vortex-file-compressed 83000000 8.4e+07 0.988095 ns
tpch_q11/DuckDB:vortex-file-compressed 24000000 2.2e+07 1.09091 ns
tpch_q12/DuckDB:vortex-file-compressed 40000000 4.3e+07 0.930233 ns
tpch_q13/DuckDB:vortex-file-compressed 56000000 5.5e+07 1.01818 ns
tpch_q14/DuckDB:vortex-file-compressed 34000000 3.6e+07 0.944444 ns
tpch_q15/DuckDB:vortex-file-compressed 54000000 5.6e+07 0.964286 ns
tpch_q16/DuckDB:vortex-file-compressed 51000000 5.2e+07 0.980769 ns
tpch_q17/DuckDB:vortex-file-compressed 86000000 7.2e+07 1.19444 ns
tpch_q18/DuckDB:vortex-file-compressed 62000000 6.2e+07 1 ns
tpch_q19/DuckDB:vortex-file-compressed 43000000 4.3e+07 1 ns
tpch_q20/DuckDB:vortex-file-compressed 48000000 4.6e+07 1.04348 ns
tpch_q21/DuckDB:vortex-file-compressed 128000000 1.28e+08 1 ns
tpch_q22/DuckDB:vortex-file-compressed 32000000 3.2e+07 1 ns
tpch_q01/DuckDB:duckdb 21000000 2e+07 1.05 ns
tpch_q02/DuckDB:duckdb 16000000 1.5e+07 1.06667 ns
tpch_q03/DuckDB:duckdb 27000000 2.7e+07 1 ns
tpch_q04/DuckDB:duckdb 19000000 1.9e+07 1 ns
tpch_q05/DuckDB:duckdb 28000000 2.7e+07 1.03704 ns
tpch_q06/DuckDB:duckdb 8000000 7e+06 1.14286 ns
tpch_q07/DuckDB:duckdb 31000000 3.1e+07 1 ns
tpch_q08/DuckDB:duckdb 29000000 2.9e+07 1 ns
tpch_q09/DuckDB:duckdb 70000000 6.9e+07 1.01449 ns
tpch_q10/DuckDB:duckdb 66000000 6.6e+07 1 ns
tpch_q11/DuckDB:duckdb 9000000 9e+06 1 ns
tpch_q12/DuckDB:duckdb 22000000 2.3e+07 0.956522 ns
tpch_q13/DuckDB:duckdb 41000000 4.1e+07 1 ns
tpch_q14/DuckDB:duckdb 22000000 2.2e+07 1 ns
tpch_q15/DuckDB:duckdb 26000000 2.4e+07 1.08333 ns
tpch_q16/DuckDB:duckdb 43000000 4.3e+07 1 ns
tpch_q17/DuckDB:duckdb 29000000 2.9e+07 1 ns
tpch_q18/DuckDB:duckdb 36000000 3.5e+07 1.02857 ns
tpch_q19/DuckDB:duckdb 38000000 3.6e+07 1.05556 ns
tpch_q20/DuckDB:duckdb 28000000 2.7e+07 1.03704 ns
tpch_q21/DuckDB:duckdb 60000000 6e+07 1 ns
tpch_q22/DuckDB:duckdb 25000000 2.5e+07 1 ns

@github-actions
Copy link
Contributor

github-actions bot commented Jun 20, 2025

Benchmarks: Clickbench on NVME

Table of Results
name PR d9b7c16 base 403729e ratio (PR/base) unit
clickbench_q00/DataFusion:parquet 14682374 1.2771e+07 1.14967 ns
clickbench_q01/DataFusion:parquet 25734586 2.4126e+07 1.06667 ns
clickbench_q02/DataFusion:parquet 60370947 5.81008e+07 1.03907 ns
clickbench_q03/DataFusion:parquet 55670288 5.29689e+07 1.051 ns
clickbench_q04/DataFusion:parquet 332767617 3.32057e+08 1.00214 ns
clickbench_q05/DataFusion:parquet 384567201 3.73665e+08 1.02918 ns
clickbench_q06/DataFusion:parquet 35598746 3.36166e+07 1.05896 ns
clickbench_q07/DataFusion:parquet 28803576 2.76675e+07 1.04106 ns
clickbench_q08/DataFusion:parquet 473022253 4.67436e+08 1.01195 ns
clickbench_q09/DataFusion:parquet 680269710 6.70473e+08 1.01461 ns
clickbench_q10/DataFusion:parquet 150259092 1.45973e+08 1.02936 ns
clickbench_q11/DataFusion:parquet 177124548 1.69332e+08 1.04602 ns
clickbench_q12/DataFusion:parquet 419793103 4.08643e+08 1.02728 ns
clickbench_q13/DataFusion:parquet 592764426 5.68104e+08 1.04341 ns
clickbench_q14/DataFusion:parquet 398452984 3.91221e+08 1.01849 ns
clickbench_q15/DataFusion:parquet 416710971 4.07961e+08 1.02145 ns
clickbench_q16/DataFusion:parquet 837440205 8.31583e+08 1.00704 ns
clickbench_q17/DataFusion:parquet 800331322 7.87537e+08 1.01625 ns
clickbench_q18/DataFusion:parquet 1527571367 1.52552e+09 1.00134 ns
clickbench_q19/DataFusion:parquet 41873546 4.1442e+07 1.01041 ns
clickbench_q20/DataFusion:parquet 662920450 6.53077e+08 1.01507 ns
clickbench_q21/DataFusion:parquet 765442934 7.46089e+08 1.02594 ns
clickbench_q22/DataFusion:parquet 1074519909 1.07772e+09 0.997032 ns
clickbench_q23/DataFusion:parquet 4857055461 4.80934e+09 1.00992 ns
clickbench_q24/DataFusion:parquet 251369153 2.48428e+08 1.01184 ns
clickbench_q25/DataFusion:parquet 214808904 2.09799e+08 1.02388 ns
clickbench_q26/DataFusion:parquet 284669418 2.74492e+08 1.03708 ns
clickbench_q27/DataFusion:parquet 1109740081 1.10874e+09 1.0009 ns
clickbench_q28/DataFusion:parquet 5904325669 5.83767e+09 1.01142 ns
clickbench_q29/DataFusion:parquet 247545509 2.44861e+08 1.01096 ns
clickbench_q30/DataFusion:parquet 393455218 3.88971e+08 1.01153 ns
clickbench_q31/DataFusion:parquet 440801897 4.31427e+08 1.02173 ns
clickbench_q32/DataFusion:parquet 1382754764 1.35403e+09 1.02122 ns
clickbench_q33/DataFusion:parquet 1707430735 1.70488e+09 1.0015 ns
clickbench_q34/DataFusion:parquet 1740280296 1.69505e+09 1.02668 ns
clickbench_q35/DataFusion:parquet 634871451 6.32541e+08 1.00368 ns
clickbench_q36/DataFusion:parquet 181147110 1.75714e+08 1.03092 ns
clickbench_q37/DataFusion:parquet 74913238 7.34852e+07 1.01943 ns
clickbench_q38/DataFusion:parquet 113020144 1.16174e+08 0.972848 ns
clickbench_q39/DataFusion:parquet 357368096 3.46225e+08 1.03218 ns
clickbench_q40/DataFusion:parquet 42155575 4.30572e+07 0.97906 ns
clickbench_q41/DataFusion:parquet 39325674 3.86984e+07 1.01621 ns
clickbench_q42/DataFusion:parquet 50984824 5.12631e+07 0.994572 ns
clickbench_q00/DataFusion:vortex-file-compressed 4059505 3.58706e+06 1.13171 ns
clickbench_q01/DataFusion:vortex-file-compressed 8021546 7.71512e+06 1.03972 ns
clickbench_q02/DataFusion:vortex-file-compressed 29011732 2.72635e+07 1.06412 ns
clickbench_q03/DataFusion:vortex-file-compressed 32524872 3.26597e+07 0.995872 ns
clickbench_q04/DataFusion:vortex-file-compressed 302089405 2.96593e+08 1.01853 ns
clickbench_q05/DataFusion:vortex-file-compressed 346079768 3.39116e+08 1.02053 ns
clickbench_q06/DataFusion:vortex-file-compressed 32838724 2.87536e+07 1.14207 ns
clickbench_q07/DataFusion:vortex-file-compressed 12720813 1.12469e+07 1.13105 ns
clickbench_q08/DataFusion:vortex-file-compressed 412842337 4.05137e+08 1.01902 ns
clickbench_q09/DataFusion:vortex-file-compressed 580804735 5.70635e+08 1.01782 ns
clickbench_q10/DataFusion:vortex-file-compressed 96123927 8.32414e+07 1.15476 ns
clickbench_q11/DataFusion:vortex-file-compressed 113374162 1.01005e+08 1.12246 ns
clickbench_q12/DataFusion:vortex-file-compressed 321901266 3.09466e+08 1.04018 ns
clickbench_q13/DataFusion:vortex-file-compressed 497193090 4.88635e+08 1.01752 ns
clickbench_q14/DataFusion:vortex-file-compressed 298361887 2.94933e+08 1.01163 ns
clickbench_q15/DataFusion:vortex-file-compressed 371895290 3.64004e+08 1.02168 ns
clickbench_q16/DataFusion:vortex-file-compressed 836051669 8.18804e+08 1.02106 ns
clickbench_q17/DataFusion:vortex-file-compressed 797997553 7.82782e+08 1.01944 ns
clickbench_q18/DataFusion:vortex-file-compressed 1535066070 1.49254e+09 1.02849 ns
clickbench_q19/DataFusion:vortex-file-compressed 18340992 1.62836e+07 1.12635 ns
clickbench_q20/DataFusion:vortex-file-compressed 410497309 4.06769e+08 1.00916 ns
clickbench_q21/DataFusion:vortex-file-compressed 505994376 4.96222e+08 1.01969 ns
clickbench_q22/DataFusion:vortex-file-compressed 1025264275 1.01577e+09 1.00935 ns
clickbench_q23/DataFusion:vortex-file-compressed 4166228486 4.03722e+09 1.03196 ns
clickbench_q24/DataFusion:vortex-file-compressed 152178442 1.36165e+08 1.1176 ns
clickbench_q25/DataFusion:vortex-file-compressed 127109129 1.19664e+08 1.06222 ns
clickbench_q26/DataFusion:vortex-file-compressed 181071718 1.71158e+08 1.05792 ns
clickbench_q27/DataFusion:vortex-file-compressed 853571505 8.24091e+08 1.03577 ns
clickbench_q28/DataFusion:vortex-file-compressed 6851794319 6.62751e+09 1.03384 ns
clickbench_q29/DataFusion:vortex-file-compressed 256581486 2.48456e+08 1.0327 ns
clickbench_q30/DataFusion:vortex-file-compressed 260818790 2.4808e+08 1.05135 ns
clickbench_q31/DataFusion:vortex-file-compressed 301479637 2.81113e+08 1.07245 ns
clickbench_q32/DataFusion:vortex-file-compressed 1345674380 1.28812e+09 1.04468 ns
clickbench_q33/DataFusion:vortex-file-compressed 1551407331 1.48517e+09 1.0446 ns
clickbench_q34/DataFusion:vortex-file-compressed 1506016943 1.5496e+09 0.971874 ns
clickbench_q35/DataFusion:vortex-file-compressed 592268312 5.65609e+08 1.04713 ns
clickbench_q36/DataFusion:vortex-file-compressed 127696772 1.25687e+08 1.01599 ns
clickbench_q37/DataFusion:vortex-file-compressed 58294916 5.26809e+07 1.10657 ns
clickbench_q38/DataFusion:vortex-file-compressed 62983225 6.07376e+07 1.03697 ns
clickbench_q39/DataFusion:vortex-file-compressed 295925139 2.97558e+08 0.994513 ns
clickbench_q40/DataFusion:vortex-file-compressed 24869595 2.17976e+07 1.14093 ns
clickbench_q41/DataFusion:vortex-file-compressed 27557115 2.34191e+07 1.17669 ns
clickbench_q42/DataFusion:vortex-file-compressed 38112070 3.50573e+07 1.08714 ns
clickbench_q00/DuckDB:parquet 122578267 1.17e+08 1.04768 ns
clickbench_q01/DuckDB:parquet 48868764 4.9e+07 0.997322 ns
clickbench_q02/DuckDB:parquet 63635669 6e+07 1.06059 ns
clickbench_q03/DuckDB:parquet 62195627 6e+07 1.03659 ns
clickbench_q04/DuckDB:parquet 217841964 2.03e+08 1.07311 ns
clickbench_q05/DuckDB:parquet 242375492 2.38e+08 1.01838 ns
clickbench_q06/DuckDB:parquet 66365973 5.7e+07 1.16432 ns
clickbench_q07/DuckDB:parquet 59190520 5.3e+07 1.1168 ns
clickbench_q08/DuckDB:parquet 282666155 2.48e+08 1.13978 ns
clickbench_q09/DuckDB:parquet 415142567 3.42e+08 1.21387 ns
clickbench_q10/DuckDB:parquet 103149295 9.1e+07 1.13351 ns
clickbench_q11/DuckDB:parquet 114202617 1.07e+08 1.06731 ns
clickbench_q12/DuckDB:parquet 251977490 2.49e+08 1.01196 ns
clickbench_q13/DuckDB:parquet 414239305 4.08e+08 1.01529 ns
clickbench_q14/DuckDB:parquet 284671127 2.77e+08 1.02769 ns
clickbench_q15/DuckDB:parquet 240885726 2.27e+08 1.06117 ns
clickbench_q16/DuckDB:parquet 573159789 5.44e+08 1.0536 ns
clickbench_q17/DuckDB:parquet 488131673 4.58e+08 1.06579 ns
clickbench_q18/DuckDB:parquet 966162784 9.03e+08 1.06995 ns
clickbench_q19/DuckDB:parquet 60182543 5.1e+07 1.18005 ns
clickbench_q20/DuckDB:parquet 380568527 3.32e+08 1.14629 ns
clickbench_q21/DuckDB:parquet 500253749 4.32e+08 1.15799 ns
clickbench_q22/DuckDB:parquet 857203414 7.33e+08 1.16945 ns
clickbench_q23/DuckDB:parquet 272677908 2.75e+08 0.991556 ns
clickbench_q24/DuckDB:parquet 106616718 9e+07 1.18463 ns
clickbench_q25/DuckDB:parquet 140192685 1.24e+08 1.13059 ns
clickbench_q26/DuckDB:parquet 60487163 6e+07 1.00812 ns
clickbench_q27/DuckDB:parquet 634391195 5.13e+08 1.23663 ns
clickbench_q28/DuckDB:parquet 5698649438 6.007e+09 0.948668 ns
clickbench_q29/DuckDB:parquet 69109994 5.7e+07 1.21246 ns
clickbench_q30/DuckDB:parquet 294613016 2.74e+08 1.07523 ns
clickbench_q31/DuckDB:parquet 340694208 3.28e+08 1.0387 ns
clickbench_q32/DuckDB:parquet 1031825591 1.042e+09 0.990236 ns
clickbench_q33/DuckDB:parquet 1048173393 1.037e+09 1.01077 ns
clickbench_q34/DuckDB:parquet 1122696234 1.084e+09 1.0357 ns
clickbench_q35/DuckDB:parquet 379138180 3.21e+08 1.18112 ns
clickbench_q36/DuckDB:parquet 61309679 5.6e+07 1.09482 ns
clickbench_q37/DuckDB:parquet 53257831 4.5e+07 1.18351 ns
clickbench_q38/DuckDB:parquet 62934858 4.8e+07 1.31114 ns
clickbench_q39/DuckDB:parquet 96928760 8.8e+07 1.10146 ns
clickbench_q40/DuckDB:parquet 58489557 4.6e+07 1.27151 ns
clickbench_q41/DuckDB:parquet 67286481 5.2e+07 1.29397 ns
clickbench_q42/DuckDB:parquet 52473029 4.1e+07 1.27983 ns
clickbench_q00/DuckDB:vortex-file-compressed 7675018 1.9e+07 0.403948 ns
clickbench_q01/DuckDB:vortex-file-compressed 13296965 3e+07 0.443232 ns
clickbench_q02/DuckDB:vortex-file-compressed 12483171 4.3e+07 0.290306 ns
clickbench_q03/DuckDB:vortex-file-compressed 19477668 5.2e+07 0.374571 ns
clickbench_q04/DuckDB:vortex-file-compressed 19310176 2.25e+08 0.085823 ns
clickbench_q05/DuckDB:vortex-file-compressed 24104709 3.31e+08 0.0728239 ns
clickbench_q06/DuckDB:vortex-file-compressed 12567479 5.2e+07 0.241682 ns
clickbench_q07/DuckDB:vortex-file-compressed 15928779 3.6e+07 0.442466 ns
clickbench_q08/DuckDB:vortex-file-compressed 24471361 2.88e+08 0.08497 ns
clickbench_q09/DuckDB:vortex-file-compressed 30730743 3.72e+08 0.0826095 ns
clickbench_q10/DuckDB:vortex-file-compressed 52283912 1.11e+08 0.471026 ns
clickbench_q11/DuckDB:vortex-file-compressed 59882183 1.23e+08 0.486847 ns
clickbench_q12/DuckDB:vortex-file-compressed 55418969 3.16e+08 0.175376 ns
clickbench_q13/DuckDB:vortex-file-compressed 74411712 5.04e+08 0.147642 ns
clickbench_q14/DuckDB:vortex-file-compressed 61603905 3.35e+08 0.183892 ns
clickbench_q15/DuckDB:vortex-file-compressed 18385259 2.44e+08 0.0753494 ns
clickbench_q16/DuckDB:vortex-file-compressed 32225700 6.47e+08 0.0498079 ns
clickbench_q17/DuckDB:vortex-file-compressed 30962602 5.73e+08 0.054036 ns
clickbench_q18/DuckDB:vortex-file-compressed 45472487 1.105e+09 0.0411516 ns
clickbench_q19/DuckDB:vortex-file-compressed 3433475 3.66e+08 0.00938108 ns
clickbench_q20/DuckDB:vortex-file-compressed 102154990 5.04e+08 0.202688 ns
clickbench_q21/DuckDB:vortex-file-compressed 317174092 5.68e+08 0.558405 ns
clickbench_q22/DuckDB:vortex-file-compressed 136508046 9.74e+08 0.140152 ns
clickbench_q23/DuckDB:vortex-file-compressed 358144987 3.01e+08 1.18985 ns
clickbench_q24/DuckDB:vortex-file-compressed 66815852 6.9e+07 0.968346 ns
clickbench_q25/DuckDB:vortex-file-compressed 50125388 1.35e+08 0.371299 ns
clickbench_q26/DuckDB:vortex-file-compressed 66166420 5.1e+07 1.29738 ns
clickbench_q27/DuckDB:vortex-file-compressed 58223192 7.55e+08 0.0771168 ns
clickbench_q28/DuckDB:vortex-file-compressed 80292764 7.325e+09 0.0109615 ns
clickbench_q29/DuckDB:vortex-file-compressed 17400737 4.5e+07 0.386683 ns
clickbench_q30/DuckDB:vortex-file-compressed 89915384 2.74e+08 0.328158 ns
clickbench_q31/DuckDB:vortex-file-compressed 91153912 3.77e+08 0.241788 ns
clickbench_q32/DuckDB:vortex-file-compressed 41259396 1.133e+09 0.0364161 ns
clickbench_q33/DuckDB:vortex-file-compressed 42890112 1.637e+09 0.0262004 ns
clickbench_q34/DuckDB:vortex-file-compressed 41198413 1.634e+09 0.0252132 ns
clickbench_q35/DuckDB:vortex-file-compressed 15073988 3.47e+08 0.0434409 ns
clickbench_q36/DuckDB:vortex-file-compressed 14851765 9.8e+07 0.151549 ns
clickbench_q37/DuckDB:vortex-file-compressed 14145413 5.1e+07 0.277361 ns
clickbench_q38/DuckDB:vortex-file-compressed 13539435 5.9e+07 0.229482 ns
clickbench_q39/DuckDB:vortex-file-compressed 21026826 1.79e+08 0.117468 ns
clickbench_q40/DuckDB:vortex-file-compressed 13586704 3.7e+07 0.367208 ns
clickbench_q41/DuckDB:vortex-file-compressed 15862910 3.5e+07 0.453226 ns
clickbench_q42/DuckDB:vortex-file-compressed 11642251 3.9e+07 0.298519 ns
clickbench_q00/DuckDB:duckdb 13476155 2e+07 0.673808 ns
clickbench_q01/DuckDB:duckdb 6530198 4.1e+07 0.159273 ns
clickbench_q02/DuckDB:duckdb 13389511 6.4e+07 0.209211 ns
clickbench_q03/DuckDB:duckdb 35775190 5.8e+07 0.616814 ns
clickbench_q04/DuckDB:duckdb 334350145 2.11e+08 1.5846 ns
clickbench_q05/DuckDB:duckdb 369512917 2.16e+08 1.71071 ns
clickbench_q06/DuckDB:duckdb 13664323 3.8e+07 0.359587 ns
clickbench_q07/DuckDB:duckdb 7430171 4.2e+07 0.176909 ns
clickbench_q08/DuckDB:duckdb 418497383 2.5e+08 1.67399 ns
clickbench_q09/DuckDB:duckdb 463787081 3.46e+08 1.34043 ns
clickbench_q10/DuckDB:duckdb 69498493 1.25e+08 0.555988 ns
clickbench_q11/DuckDB:duckdb 90223583 1.41e+08 0.639884 ns
clickbench_q12/DuckDB:duckdb 274222092 2.26e+08 1.21337 ns
clickbench_q13/DuckDB:duckdb 473024631 4e+08 1.18256 ns
clickbench_q14/DuckDB:duckdb 306805726 2.54e+08 1.2079 ns
clickbench_q15/DuckDB:duckdb 241767773 2.29e+08 1.05575 ns
clickbench_q16/DuckDB:duckdb 603527798 5.21e+08 1.1584 ns
clickbench_q17/DuckDB:duckdb 472436568 4.29e+08 1.10125 ns
clickbench_q18/DuckDB:duckdb 988830818 9.04e+08 1.09384 ns
clickbench_q19/DuckDB:duckdb 4323099 3.8e+07 0.113766 ns
clickbench_q20/DuckDB:duckdb 289901483 3.85e+08 0.752991 ns
clickbench_q21/DuckDB:duckdb 279337246 3.96e+08 0.705397 ns
clickbench_q22/DuckDB:duckdb 1602769812 6.27e+08 2.55625 ns
clickbench_q23/DuckDB:duckdb 50021489 9.5e+07 0.526542 ns
clickbench_q24/DuckDB:duckdb 8525703 4.9e+07 0.173994 ns
clickbench_q25/DuckDB:duckdb 85289178 7.3e+07 1.16834 ns
clickbench_q26/DuckDB:duckdb 7085030 4.6e+07 0.154022 ns
clickbench_q27/DuckDB:duckdb 625911564 4.51e+08 1.38783 ns
clickbench_q28/DuckDB:duckdb 5717980844 5.987e+09 0.955066 ns
clickbench_q29/DuckDB:duckdb 19876431 5.4e+07 0.368082 ns
clickbench_q30/DuckDB:duckdb 263460850 2.6e+08 1.01331 ns
clickbench_q31/DuckDB:duckdb 286351454 3.69e+08 0.77602 ns
clickbench_q32/DuckDB:duckdb 1199079090 1.083e+09 1.10718 ns
clickbench_q33/DuckDB:duckdb 1357318732 1.107e+09 1.22612 ns
clickbench_q34/DuckDB:duckdb 1362837520 1.13e+09 1.20605 ns
clickbench_q35/DuckDB:duckdb 345173431 2.9e+08 1.19025 ns
clickbench_q36/DuckDB:duckdb 23743262 4e+07 0.593582 ns
clickbench_q37/DuckDB:duckdb 12773794 3.3e+07 0.387085 ns
clickbench_q38/DuckDB:duckdb 6020537 3.4e+07 0.177075 ns
clickbench_q39/DuckDB:duckdb 36638660 6.2e+07 0.590946 ns
clickbench_q40/DuckDB:duckdb 4157817 3.3e+07 0.125994 ns
clickbench_q41/DuckDB:duckdb 5555377 3.4e+07 0.163393 ns
clickbench_q42/DuckDB:duckdb 7571288 3.3e+07 0.229433 ns

0ax1 added 2 commits June 20, 2025 22:16
@0ax1 0ax1 force-pushed the ad/wire-up-ddb-clickbench branch from d7e1d08 to 08351cd Compare June 20, 2025 21:40
@0ax1 0ax1 force-pushed the ad/wire-up-ddb-clickbench branch from 7f9fa78 to 247ca13 Compare June 20, 2025 21:56
Signed-off-by: Alexander Droste <[email protected]>
@0ax1 0ax1 force-pushed the ad/wire-up-ddb-clickbench branch from 247ca13 to d9b7c16 Compare June 20, 2025 22:14
@github-actions
Copy link
Contributor

Benchmarks: TPC-H on S3

Table of Results
name PR d9b7c16 base 403729e ratio (PR/base) unit
tpch_q01/DataFusion:parquet 187724603 1.90593e+08 0.984951 ns
tpch_q02/DataFusion:parquet 777363160 7.7935e+08 0.997451 ns
tpch_q03/DataFusion:parquet 340857731 3.39775e+08 1.00319 ns
tpch_q04/DataFusion:parquet 212047082 2.1696e+08 0.977354 ns
tpch_q05/DataFusion:parquet 552479025 5.61819e+08 0.983376 ns
tpch_q06/DataFusion:parquet 127170386 1.31975e+08 0.963592 ns
tpch_q07/DataFusion:parquet 598195778 6.18246e+08 0.967569 ns
tpch_q08/DataFusion:parquet 749446081 7.72864e+08 0.9697 ns
tpch_q09/DataFusion:parquet 620803186 6.22755e+08 0.996866 ns
tpch_q10/DataFusion:parquet 528295852 5.36842e+08 0.984081 ns
tpch_q11/DataFusion:parquet 265135004 2.67316e+08 0.991842 ns
tpch_q12/DataFusion:parquet 281160843 2.79593e+08 1.00561 ns
tpch_q13/DataFusion:parquet 211092131 2.07634e+08 1.01666 ns
tpch_q14/DataFusion:parquet 265299208 2.63819e+08 1.00561 ns
tpch_q15/DataFusion:parquet 362189171 3.67453e+08 0.985674 ns
tpch_q16/DataFusion:parquet 369867930 3.79024e+08 0.975844 ns
tpch_q17/DataFusion:parquet 530644681 5.18081e+08 1.02425 ns
tpch_q18/DataFusion:parquet 471059821 4.76639e+08 0.988295 ns
tpch_q19/DataFusion:parquet 367728372 3.63958e+08 1.01036 ns
tpch_q20/DataFusion:parquet 515116983 5.33028e+08 0.966397 ns
tpch_q21/DataFusion:parquet 742615227 7.65021e+08 0.970712 ns
tpch_q22/DataFusion:parquet 193745680 1.95761e+08 0.989706 ns
tpch_q01/DataFusion:vortex-file-compressed 156246584 1.63048e+08 0.958286 ns
tpch_q02/DataFusion:vortex-file-compressed 156096741 1.49799e+08 1.04204 ns
tpch_q03/DataFusion:vortex-file-compressed 237782364 2.31133e+08 1.02877 ns
tpch_q04/DataFusion:vortex-file-compressed 167979761 1.4997e+08 1.12009 ns
tpch_q05/DataFusion:vortex-file-compressed 238298930 2.35497e+08 1.0119 ns
tpch_q06/DataFusion:vortex-file-compressed 104977834 1.02011e+08 1.02908 ns
tpch_q07/DataFusion:vortex-file-compressed 294215689 2.92702e+08 1.00517 ns
tpch_q08/DataFusion:vortex-file-compressed 287084418 3.00714e+08 0.954677 ns
tpch_q09/DataFusion:vortex-file-compressed 321231794 3.19158e+08 1.0065 ns
tpch_q10/DataFusion:vortex-file-compressed 267036486 2.58413e+08 1.03337 ns
tpch_q11/DataFusion:vortex-file-compressed 85654848 8.2625e+07 1.03667 ns
tpch_q12/DataFusion:vortex-file-compressed 189916922 1.93297e+08 0.982515 ns
tpch_q13/DataFusion:vortex-file-compressed 137213023 1.35513e+08 1.01254 ns
tpch_q14/DataFusion:vortex-file-compressed 139800262 1.41018e+08 0.991364 ns
tpch_q15/DataFusion:vortex-file-compressed 214499768 2.07462e+08 1.03392 ns
tpch_q16/DataFusion:vortex-file-compressed 96802661 9.46439e+07 1.02281 ns
tpch_q17/DataFusion:vortex-file-compressed 252995699 2.60735e+08 0.970319 ns
tpch_q18/DataFusion:vortex-file-compressed 337095441 3.24091e+08 1.04013 ns
tpch_q19/DataFusion:vortex-file-compressed 169666103 1.65802e+08 1.0233 ns
tpch_q20/DataFusion:vortex-file-compressed 225143036 2.26633e+08 0.993426 ns
tpch_q21/DataFusion:vortex-file-compressed 393951326 3.84564e+08 1.02441 ns
tpch_q22/DataFusion:vortex-file-compressed 84167106 7.83937e+07 1.07365 ns
tpch_q01/DuckDB:parquet 420000000 4.24e+08 0.990566 ns
tpch_q02/DuckDB:parquet 487000000 5.52e+08 0.882246 ns
tpch_q03/DuckDB:parquet 535000000 5.6e+08 0.955357 ns
tpch_q04/DuckDB:parquet 370000000 3.62e+08 1.0221 ns
tpch_q05/DuckDB:parquet 664000000 6.21e+08 1.06924 ns
tpch_q06/DuckDB:parquet 257000000 2.62e+08 0.980916 ns
tpch_q07/DuckDB:parquet 601000000 6.17e+08 0.974068 ns
tpch_q08/DuckDB:parquet 646000000 6.46e+08 1 ns
tpch_q09/DuckDB:parquet 724000000 7.43e+08 0.974428 ns
tpch_q10/DuckDB:parquet 796000000 7.86e+08 1.01272 ns
tpch_q11/DuckDB:parquet 282000000 2.94e+08 0.959184 ns
tpch_q12/DuckDB:parquet 312000000 3.23e+08 0.965944 ns
tpch_q13/DuckDB:parquet 256000000 2.8e+08 0.914286 ns
tpch_q14/DuckDB:parquet 349000000 3.77e+08 0.925729 ns
tpch_q15/DuckDB:parquet 440000000 4.27e+08 1.03044 ns
tpch_q16/DuckDB:parquet 287000000 2.98e+08 0.963087 ns
tpch_q17/DuckDB:parquet 339000000 3.43e+08 0.988338 ns
tpch_q18/DuckDB:parquet 341000000 3.52e+08 0.96875 ns
tpch_q19/DuckDB:parquet 537000000 5.24e+08 1.02481 ns
tpch_q20/DuckDB:parquet 525000000 5.73e+08 0.91623 ns
tpch_q21/DuckDB:parquet 514000000 5.31e+08 0.967985 ns
tpch_q22/DuckDB:parquet 214000000 2.27e+08 0.942731 ns
tpch_q01/DuckDB:vortex-file-compressed 55000000 5.1e+07 1.07843 ns
tpch_q02/DuckDB:vortex-file-compressed 34000000 3.4e+07 1 ns
tpch_q03/DuckDB:vortex-file-compressed 55000000 5.2e+07 1.05769 ns
tpch_q04/DuckDB:vortex-file-compressed 45000000 4.3e+07 1.04651 ns
tpch_q05/DuckDB:vortex-file-compressed 58000000 5.5e+07 1.05455 ns
tpch_q06/DuckDB:vortex-file-compressed 4000000 4e+06 1 ns
tpch_q07/DuckDB:vortex-file-compressed 58000000 6e+07 0.966667 ns
tpch_q08/DuckDB:vortex-file-compressed 65000000 6.6e+07 0.984848 ns
tpch_q09/DuckDB:vortex-file-compressed 87000000 8.7e+07 1 ns
tpch_q10/DuckDB:vortex-file-compressed 83000000 8.3e+07 1 ns
tpch_q11/DuckDB:vortex-file-compressed 23000000 2.4e+07 0.958333 ns
tpch_q12/DuckDB:vortex-file-compressed 41000000 4.7e+07 0.87234 ns
tpch_q13/DuckDB:vortex-file-compressed 56000000 5.7e+07 0.982456 ns
tpch_q14/DuckDB:vortex-file-compressed 37000000 3.6e+07 1.02778 ns
tpch_q15/DuckDB:vortex-file-compressed 48000000 5.3e+07 0.90566 ns
tpch_q16/DuckDB:vortex-file-compressed 52000000 5.1e+07 1.01961 ns
tpch_q17/DuckDB:vortex-file-compressed 81000000 8.5e+07 0.952941 ns
tpch_q18/DuckDB:vortex-file-compressed 62000000 6.2e+07 1 ns
tpch_q19/DuckDB:vortex-file-compressed 43000000 4.2e+07 1.02381 ns
tpch_q20/DuckDB:vortex-file-compressed 49000000 4.7e+07 1.04255 ns
tpch_q21/DuckDB:vortex-file-compressed 124000000 1.29e+08 0.96124 ns
tpch_q22/DuckDB:vortex-file-compressed 32000000 3.2e+07 1 ns

Signed-off-by: Alexander Droste <[email protected]>
@0ax1 0ax1 enabled auto-merge (squash) June 21, 2025 09:26
Signed-off-by: Alexander Droste <[email protected]>
@0ax1 0ax1 force-pushed the ad/wire-up-ddb-clickbench branch from ec731d4 to 08d4cc0 Compare June 21, 2025 09:30
@0ax1 0ax1 disabled auto-merge June 21, 2025 09:38
@0ax1
Copy link
Contributor Author

0ax1 commented Jun 21, 2025

Some of the benchmarks for DuckDB:vortex-file-compressed look a little too good right now. So we'll follow up with double checking whether we do all the work there / the results are correct but land the current state as a baseline.

@0ax1 0ax1 merged commit e79b230 into develop Jun 21, 2025
33 checks passed
@0ax1 0ax1 deleted the ad/wire-up-ddb-clickbench branch June 21, 2025 09:49
mwlon pushed a commit to mwlon/vortex that referenced this pull request Jul 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

chore Release label indicating a trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants