1B rides NYC taxi native benchmark

This repository reflects progress of performance and design study for 1B ride NYC taxi benchamarks.

Compilation

1. Install and activate miniconda
2. Create development environment: conda env create -n arrow-def -f conda/default-env.yml
3. Activate this environment: conda activate arrow-def
4. Configure: cmake -GNinja -DCMAKE_BUILD_TYPE=release -S . -B ../build
5. Build: cmake --build ../build
6. Allocate huge memory pages: sudo bash -c 'echo 30000 > /proc/sys/vm/nr_hugepages'
7. Download trips.xaa.csv.gz, gzip -d it
8. Run ../build/bench_all for a single run of all execution nodes.
9. Adjust and run bash run-aff-bsz.sh for collecting times of CSV reader in different modes.