Extend Quinn's Data Validation functionality #182
Description
Add to Quinn a tool to profile incoming data, check if it adheres to registered schema and do custom data quality checks.
At the end of it, a human readable report is autogenerated that can be saved separately.
- Config driven data profiling and schema validation
- Autogeneration of report after every run
- Integration with datadog monitoring system
- Extensible and highly customizable.
- Very little boiler plate code.
- Support for versioned schema validation.