Observability changes

[Shashankpgit]

The logic for retrieving connector-level metrics has been added.

[Copilot]

Pull Request Overview

This PR implements extensive observability changes across the dataset metrics system, enhancing monitoring capabilities with new downtime tracking, time-series granularity support, and improved data lineage components.

Key Changes:

• Added hourly and daily granularity support for metrics queries with time period-based processing
• Replaced data quality metrics with downtime monitoring functionality using Kubernetes and Prometheus metrics
• Enhanced data lineage tracking with new extractor success/duplicate counts and dataset mode support

Reviewed Changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 7 comments.

Show a summary per file

File	Description
DatasetMetricsService.ts	Major refactor adding time-based granularity, downtime monitoring, enhanced connector metrics, and Prometheus integration
queries.ts	Updated query functions to support time period granularity and added new Prometheus-based queries for extractors and dedup operations
DatasetMetricsController.ts	Added date range validation, downtime category support, and replaced data quality with downtime metrics
DatasetMetrics.json	Updated schema to support date ranges and downtime monitoring parameters
DataObsrvDefaults.ts	New configuration file defining container components for downtime monitoring

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}