add tpc-ds tests and property-based testing utilities (#231)

* add tpc-ds tests and property-based testing utilities

This change introduces a new `property_based.rs` test utility which lets us evaluate
correctness using properties. These are useful for evaluating correctness when
we do not know the expected output of a test (ex. if we were to fuzz the database
with randomized data or randomzed queries, then we can only verify the output using
properties). The two oracles are
- ResultSetOracle: Compares the result set between single node and distributed datafusion
- OrderingOracle: Uses plan properties to figure out the expected ordering and asserts it

This change does not introduce a fuzz test, but it introduces a TPC-DS test. This test
randomly generates data using the duckdb CLI and runs 99 queries on a distributed cluster.
The query outputs are validated against single-node datafusion using test utils in
`metamorphic.rs`. This test also randomizes the test cluster parameters - there's no harm
in doing so.

Next steps:
- Add fuzzing
  - Now that we have property-based testing utils, we can properly fuzz the project
    using SQLancer
  - SQLancer produces INSERT and SELECT statements which we could point at a datafusion
    distributed cluster and verify against single node datafusion
  - Although it doesn't support nested select statements, 70% of the queries were valid
    datafusion queries, meaning these are good test cases for us
- Add metrics oracle to validate output_rows metric / metrics propagation

* add tpcds-randomized-test to ci

This commit adds tpcds-randomized-test to ci. It relies on the duckdb cli for tpc-ds database generation. It also saves the artifacts if the test fails so we can reproduce issues.

Author: jayshrivastava

.github/actions/setup/action.yml

@@ -29,3 +29,4 @@ runs:
     - uses: Swatinem/rust-cache@v2
       with:
         key: ${{ runner.os }}-${{ inputs.targets }}-rust-cache
+        prefix-key: v1-rust

.github/workflows/ci.yml

@@ -9,6 +9,7 @@ on:
 env:
   CARGO_TERM_COLOR: always
   RUST_BACKTRACE: 1
+  TPCDS_SCALE_FACTOR: 0.5 # 0.5 scale factor produces a data dir which is 124MB
 
 concurrency:
   group: ${{ github.ref }}
@@ -40,6 +41,23 @@ jobs:
       - uses: ./.github/actions/setup
       - run: cargo test --features tpch --test 'tpch_*'
 
+  tpcds-test:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+        with:
+          lfs: true
+      - uses: ./.github/actions/setup
+      - name: Install DuckDB CLI
+        run: |
+          curl https://install.duckdb.org | sh
+          mkdir -p $HOME/.local/bin
+          mv /home/runner/.duckdb/cli/latest/duckdb $HOME/.local/bin/
+          echo "$HOME/.local/bin" >> $GITHUB_PATH
+      - name: Run TPC-DS test
+        id: test
+        run: cargo test --features tpcds --test tpcds_test
+
   format-check:
     runs-on: ubuntu-latest
     steps:

.gitignore

@@ -3,3 +3,4 @@
 /benchmarks/data/
 testdata/tpch/*
 !testdata/tpch/queries
+testdata/tpcds/data/