refactor: extract fuse compat test matrix into test_cases.yaml (#19441)

* refactor: rewrite test_compat_fuse

* refactor: extract fuse compat test matrix into test_cases.yaml

* docs: update compat_fuse README to match current implementation

* refactor: merge compat-stateless flashback tests into parameterized script and wire into CI

* fix: correct NEW_FMT_VER for v2 case and document stateless field in README

* fix: use current meta for reader phase in meta compression cases

* refactor: replace hand-rolled yaml parser with PyYAML

* fix: add intermediate meta upgrade steps for meta compression cases

* fix: restore original meta chains and download reader binary

* fix: bump meta versions to satisfy current query min-compatible-metasrv-version

* fix: remove V0 compat tests (1.0.56/1.1.30) dropped since ea91e06

* fix: add .test extension to sqllogictest files so runner actually executes them

The sqllogictest runner filters files by `.test` extension
(tests/sqllogictests/src/main.rs:308). Without it, `--run_file` never
matches and 0 tests are executed. This is a pre-existing bug on main
that affects all compat_fuse cases.

* fix: remove trailing commas in base/fuse_compat_write.test

Old query (1.2.46) does not support trailing commas in CREATE TABLE
column definitions or INSERT VALUES. This was never caught because
the test files were never actually executed (missing .test extension).

* fix: update expected show grants output in revoke/fuse_compat_read

Current query expands ALL into individual privilege names
(CREATE,SELECT,INSERT,...) instead of showing ALL.

* fix: split rbac tests into basic (1.2.311) and full (1.2.833) suites

rbac/ reverted to pre-54fceaa6b0 content compatible with writer 1.2.311.
rbac_all/ preserves the expanded test (procedure/sequence/connection/
warehouse) with writer 1.2.833 which supports all these features.

* fix: typo in rbac_all read test - access procedure, not access sequence

PR #18730 wrote "GRANT access sequence on procedure" which is
syntactically wrong. Should be "GRANT access procedure on procedure".
Never caught because the test was never executed.

* refactor: rename rbac test suites to include version context

rbac -> rbac_v1_2_311 (compatible with writer 1.2.311/1.2.318)
rbac_all -> rbac_current (requires current query features)

* fix: suppress noisy CI output from git advice and old binary backtraces

- Add -c advice.detachedHead=false to git clone in git_partial_clone()
- Capture --cmd ver output to suppress backtrace from old binaries

* refactor: improve version check output in CI logs

- Add context message before/after version checks
- Only print the "version:" line from --cmd ver output
- Use "checking metasrv/query" prefix for clarity

* fix: lazy-import PyYAML so single-case mode works without it

* docs: clarify procedure version comment in test_cases.yaml

* docs: fix sqllogictest filenames in README to include .test extension

* docs: fix docstring to cover both backward and forward compat

* fix: use explicit privilege list instead of ALL in revoke write test

Author: dantengsky

.github/actions/test_compat_fuse/action.yml

@@ -11,15 +11,8 @@ runs:
     - name: Test compatibility
       shell: bash
       run: |
-          bash ./tests/compat_fuse/test_compat_fuse.sh  --writer-version  1.2.46   --reader-version  current  --meta-versions  1.2.527  1.2.677  1.2.833  --logictest-path  base
-          bash ./tests/compat_fuse/test_compat_fuse.sh  --writer-version  1.2.241  --reader-version  current  --meta-versions  1.2.527  1.2.677  1.2.833  --logictest-path  revoke
-          bash ./tests/compat_fuse/test_compat_fuse.sh  --writer-version  1.2.311  --reader-version  current  --meta-versions  1.2.527  1.2.677  1.2.833  --logictest-path  rbac
-          bash ./tests/compat_fuse/test_compat_fuse.sh  --writer-version  1.2.318  --reader-version  current  --meta-versions  1.2.527  1.2.677  1.2.833  --logictest-path  rbac
-          bash ./tests/compat_fuse/test_compat_fuse.sh  --writer-version  1.2.680  --reader-version  current  --meta-versions           1.2.680  1.2.833  --logictest-path  udf
-
-          bash ./tests/compat_fuse/test_compat_fuse.sh  --writer-version  current  --reader-version  1.2.311  --meta-versions  1.2.770           --logictest-path  rbac
-          bash ./tests/compat_fuse/test_compat_fuse.sh  --writer-version  current  --reader-version  1.2.318  --meta-versions  1.2.770           --logictest-path  rbac
-          bash ./tests/compat_fuse/test_compat_fuse.sh  --writer-version  current  --reader-version  1.2.680  --meta-versions  1.2.770           --logictest-path  udf
+        pip install pyyaml -q
+        python3 ./tests/compat_fuse/test_compat_fuse.py --run-all
     - name: Upload failure
       if: failure()
       uses: ./.github/actions/artifact_failure

tests/compat_fuse/README.md

@@ -1,35 +1,68 @@
 # Fuse table compatibility test
 
-This script tests whether a newer version databend-query can read fuse table data written
-by a older version databend-query.
+Tests write-then-read compatibility of fuse-table format across databend-query versions.
+
+- **Backward compat**: old writer → current reader
+- **Forward compat**: current writer → old reader
+
+## Test matrix
+
+All test cases are defined in `test_cases.yaml`. Each entry specifies:
+
+| Field      | Description                                                        |
+|------------|--------------------------------------------------------------------|
+| `writer`   | Query version that writes data (`"current"` = latest build)       |
+| `reader`   | Query version that reads data (`"current"` = latest build)        |
+| `meta`     | Meta-service versions to run in order (upgrades on-disk meta data) |
+| `suite`    | sqllogictest sub-directory under `compat-logictest/`               |
+
+To add a test case, append an entry to `test_cases.yaml`.
 
 ## Usage
 
+Run all cases (CI mode):
+
 ```shell
-tests/compat_fuse/test_compat_fuse.sh <old_ver>
-tests/compat_fuse/test_compat_fuse_forward.sh <old_ver>
+python3 tests/compat_fuse/test_compat_fuse.py --run-all
 ```
 
-E.g. `tests/compat_fuse/test-compat_fuse.sh 0.7.151` tests if the fuse-table written
-by **databend-query-0.7.151** can be read by **current** version databend-query.
+Dry run (print cases without executing):
 
-`tests/compat_fuse/test-fuse-forward-compat.sh 1.2.307` tests if the fuse-table written
-by **current** can be read by **databend-query-0.7.151** version databend-query.
+```shell
+python3 tests/compat_fuse/test_compat_fuse.py --run-all --dry-run
+```
+
+Run a single case (local debugging):
+
+```shell
+python3 tests/compat_fuse/test_compat_fuse.py \
+    --writer-version 1.2.46 \
+    --reader-version current \
+    --meta-versions 1.2.527 1.2.677 1.2.833 \
+    --logictest-path base
+```
 
 ## Prerequisites
 
-- Current version of databend-query and databend-meta must reside in `./bins`:
-    - `./bins/current/databend-query`
-    - `./bins/current/databend-meta`
+Current version binaries must reside in `./bins/current/bin/`:
+
+- `databend-query`
+- `databend-meta`
+- `databend-sqllogictests`
+
+This is handled by the CI setup action. Old version binaries are downloaded automatically.
+
+## Test flow
 
-    Since building a binary takes several minutes,
-    this step is usually done by the calling process, e.g., the CI script.
+For each case, the script runs three phases:
 
+1. **Write** — start meta (first version) + query (writer version), run `fuse_compat_write.test`
+2. **Meta upgrade** — cycle through all meta versions to upgrade on-disk data
+3. **Read** — start meta (last version) + query (reader version), run `fuse_compat_read.test`
 
 ## Testing data
 
-- Suite `tests/compat_fuse/compat-logictest/fuse_compat_write` writes data into a fuse table via an old version query.
-- Suite `tests/compat_fuse/compat-logictest/fuse_compat_read` reads the data via current version query.
+Each suite under `compat-logictest/` contains two sqllogictest files:
 
-Fuse table maintainers update these two `logictest` scripts to let the write/read
-operations cover fuse-table features.
+- `fuse_compat_write.test` — creates tables and writes data
+- `fuse_compat_read.test` — reads and verifies the data