Skip to content

Comments

add 'dqx' as test engine for DQT tests within datacontract#1069

Draft
gkoenig wants to merge 3 commits intodatacontract:mainfrom
gkoenig:features/support-dqx-quality-checks-databricks
Draft

add 'dqx' as test engine for DQT tests within datacontract#1069
gkoenig wants to merge 3 commits intodatacontract:mainfrom
gkoenig:features/support-dqx-quality-checks-databricks

Conversation

@gkoenig
Copy link
Contributor

@gkoenig gkoenig commented Feb 22, 2026

Add an alternative test engine to Soda, by introducing Databricks' DQX framework ... which obviously requires Databricks as server_type. Since DQX is able to read datacontracts in ODCS format natively, no conversion is required.
Initial extension offers DQX as test_engine in programmatic mode.

  • [+] Tests pass
  • [+] ruff format
  • [+] README.md updated (if relevant)
  • [-] CHANGELOG.md entry added

@gkoenig gkoenig marked this pull request as draft February 22, 2026 16:39
@gkoenig
Copy link
Contributor Author

gkoenig commented Feb 22, 2026

Commit 0c53e35 adds the DQX test_engine also for the CLI mode of datacontract-cli.
Just to get the idea => I was running it with a sample datacontract including 8 checks, on a databricks unitcatalog table with 6 rows (yes, very little, indeed) produces:

image

the DataContract which I used for this test, you'll find here:
dqx-test-contract.yaml

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant