Skip to content

Update datafusion-vortex-partitioned to use vortex 0.44.0 #563

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

joseph-isaacs
Copy link
Contributor

Thank You for Your Contribution!

We appreciate your effort and contribution to the project. To ensure that your Pull Request (PR) adheres to our guidelines, please ensure to review the rules mentioned in our contribution guidelines:

ClickHouse/ClickBench Contribution Rules

Thank you for your attention to these details and for helping us maintain the quality and integrity of the project.

@rschu1ze rschu1ze self-assigned this Aug 11, 2025
@rschu1ze
Copy link
Member

When I run datafusion-vortex/benchmark.sh, I get this error:

[...]
   Compiling datafusion-physical-optimizer v47.0.0
   Compiling datafusion-datasource v47.0.0
   Compiling datafusion-catalog v47.0.0
   Compiling datafusion-datasource-csv v47.0.0
   Compiling datafusion-functions-table v47.0.0
   Compiling datafusion-datasource-json v47.0.0
   Compiling datafusion-catalog-listing v47.0.0
   Compiling datafusion-datasource-parquet v47.0.0
   Compiling datafusion v47.0.0
   Compiling vortex-datafusion v0.1.0 (/data/ClickBench/datafusion-vortex/vortex/vortex-datafusion)
   Compiling bench-vortex v0.1.0 (/data/ClickBench/datafusion-vortex/vortex/bench-vortex)
    Finished `release` profile [optimized] target(s) in 3m 23s
Load time: 2025-08-11T05:59:54.866017Z  INFO bench_vortex::clickbench: bench-vortex/src/clickbench.rs:304: Downloading single clickbench file
2025-08-11T06:04:37.118526Z  INFO bench_vortex::clickbench: bench-vortex/src/clickbench.rs:177: Processing file 'hits'
2025-08-11T06:14:00.268159Z  INFO bench_vortex::clickbench: bench-vortex/src/clickbench.rs:214: Registering table from file:///data/ClickBench/datafusion-vortex/vortex/bench-vortex/data/clickbench_single/vortex/
2025-08-11T06:14:00.270655Z  INFO vortex_file::generic: /data/ClickBench/datafusion-vortex/vortex/vortex-file/src/generic.rs:172: Initial read from 17214591552 did not cover all footer segments, reading from 17211
885628
{"name":"clickbench_q00/DataFusion:vortex-file-compressed","storage":"nvme","unit":"ns","value":12594326,"target":{"engine":"datafusion","format":"vortex"},"time":null,"bytes":null,"commit_id":"882d64302af37181e2c
895d6c1c51a474607a84a"}
846.03
Running benchmark for single
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null, ./run.sh: line 37: query_bench: command not found
null],
[...]

Kindly fix it, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants