Add OpenTelemetry Instrumentation

[tariqajyusuf]

Is your feature request related to a specific problem?

Since Fides in most cases will be run as an on-prem service, we would like to be able to monitor service health, performance, and other metrics that could be easily exported into a dashboard. OpenTelemetry has a Python integration that we could leverage here (and specifically supports FastAPI). Many monitoring services provide support for OpenTelemetry and this would make it easier to run DevOps.

Describe the solution you'd like

Optimally, adding the OpenTelemetry package and exporting basic web metrics. A stretch goal would be including basic metrics for data coverage that could be easily read without requiring additional API integration calls.

Describe alternatives you've considered, if any

Alternatives would likely involve manually instrumenting an endpoint for monitoring. It would likely be more brittle in integration and OpenTelemetry is already widely supported.

Additional context

Some other metrics that could be exported beyond OpenTelemetry:

• Number of registered systems, datasets, policies.
• Time of last scan.
• Number of privacy requests.
• Average time to close privacy requests.
• Longest open privacy request (for monitoring response SLAs)
• Error rates and call rates for third-party connectors.