Can I use DQX for Data Reconciliation?

[mwojtyczka]

You can compare datasets using compare_datasets check: https://databrickslabs.github.io/dqx/docs/reference/quality_rules/#dataset-level-checks-reference

If you are looking at validating data across different systems you can also check LakeBridge.

You can also read the data from an external system as dataframe or table in Databricks and use the compare_datasets check.