VED-789: Gen Validation Schema

[Akol125]

Summary

• ✨ New Feature

This marks the beginning of a new generic validation engine that is fully configurable through a Redis-based schema. The schema defines the metadata and expression rules required for the engine to accurately parse and validate both Batch and API resources in a dynamic, extensible manner.

The validation process leverages these schemas to apply field-level and rule-based checks, ensuring flexibility without requiring code changes when validation logic evolves.

In addition, the engine features an extensive error classification system, categorising issues by severity and category. Validation results are generated in two distinct report formats, one of which is automatically exported to an S3 bucket, providing structured data for the Data Quality Team to analyse and monitor data integrity across ingestion workflows.
Read more using docs here - https://nhsd-confluence.digital.nhs.uk/pages/viewpage.action?pageId=914071143&spaceKey=Vacc&title=Immunisation%2BFHIR%2BAPI%2B-%2BGeneric%2BValidation%2BCSV%2BFHIR

Reviews Required

• Dev
• Test
• Tech Author
• Product Owner

Review Checklist

ℹ️ This section is to be filled in by the reviewer.

• I have reviewed the changes in this PR and they fill all or part of the acceptance criteria of the ticket, and the code is in a mergeable state.
• If there were infrastructure, operational, or build changes, I have made sure there is sufficient evidence that the changes will work.
• I have ensured the changelog has been updated by the submitter, if necessary.

[sonarqubecloud]

Quality Gate passed

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
90.1% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud