Components

Check Runner

• Reads registry
• Runs checks from repos
• Writes results to Check Result Database
• Produces a simple report of results

Checks

• rule checks - test rows against a specific business rule. For example: case (lower, upper, mixed), max value, min value, type, foreign key, uniqueness, time since statistics last updated, etc.
• setup checks - gathers variables for the rest of the rule checks on the same table. Is primarily used to determine if there's new data for incremental checking.
• Reusable & reference checks available on this hadoopinspector_plugins

Registry

• JSON file that describes all tables and checks for a given run
• Also contains attributes for checks - these allow the user to turn checks on/off, to specify a test against and entire table or just an incremental test against a portion of the table, and provide essential info for more generic tests (like which column to apply a min/max/case/etc check against).

Check Result Database

• Check results are written to this sqlite database by the runner

Check Result Website

• Displays check results

Web API

• Provides check results