rm prometheus

[remo87]

• initial definition of prometheus server
• update script to run containers
• fix config
• add common tags
• update configs
• format files
• remove zone as it can change
• add zone d
• comment creds
• add service accoutn key
• add service acc for discovery
• dynamically generate prometheus config file
• Update opensearch image to use exporter
• expose opensearch metrics
• add node exporter to clickhouse
• update metrics port
• update prometheus metrics to be more specific
• add node exporter to webapp
• update logs
• extend cooldown period
• add node_exporter to api
• update image names in documentation
• update profile to snapshots
• update author
• update prometheus profile
• add clickhouse metrics
• add node exporter to open ai api
• update health port
• configure datasource
• update datasource reference
• update random
• add dashboards
• add two grafana dashboards
• update dashboard provisioning
• test update datasource
• update dashboards datasource
• update datasource
• add var for git config
• bump api version update compose env variables
• update documentation variables and outputs
• update compose
• refactor compose api
• add node exporter param
• refactor compose
• refactor compose
• refactor docker compose
• rename docker compose
• update node exporter
• update api version to .8
• update api version to 25.0.2-prom.9
• replace images and add source
• refactor os image
• update infraestructure draw
• refactor prom from instance group to single instance per region
• add preemptible flag
• remove prometheus profile

[jdhayhurst]

Nice @remo87! This is big! I pointed out some small things. The main thing is I would globally define a version (not latest) of the node exporter image and use that across all the deployments

[javfg]

Great work overall Ricardo! 🎉

There are some things we need to look into to make it production-ready, but it's getting there. This was a huge undertaking and we'll have to iterate on it slowly until it is finished.

I've found some alternatives to switching away from COS into Debian images with Docker Compose. We can discuss them later on, see if they're worth it.

Let's address the changes James and I pointed for now and once those are in place we'll do another round of review.