Fix prometheus high cardinality due to tempo span_name (#1200)

* wip

* Add csi-s3 and have portainer use it

* Change request @Hrytsuk 1GB max portainer volume size

* Arch Linux Certificates Customization

* Fix pgsql exporter failure

* [Kubernetes] Introduce on-prem persistent Storage (Longhorn) 🎉  (#979)

* Introduce longhorn chart

* Further longhorn configuration

* Longhorn: further settings configuration

* Fix longhorn configuration bugs

Extra: introduce longhorn pv vales for portainer

* Add comment for deletion longhorn

* Further longhorn configuration

* Add README.md for Longhorn wit FAQ

* Update Longhorn readme

* Update readme

* Futher LH configuration

* Update LH's Readme

* Update Longhorn Readme

* Improve LH's Readme

* LH: Reduce reserved default disk space to 5%

Since we use a dedicated disk for LH, we can go ahead with 5%

* Use values to set Longhorn storage class

* Update LH's Readme

* LH Readme: add requirements reference

* PR Review: bring back portainer s3 pv

* LH: decrease portinaer volume size

* Experimental: Try to add tracing to simcore-traefik on master

* Fixes ITISFoundation/osparc-simcore#7363

* Arch Linux Certificates Customization - 2

* Remove span_name as high cardinality label from tempo remote write to Prometheus

* revert arch changes

---------

Co-authored-by: Dustin Kaiser <[email protected]>
Co-authored-by: YH <[email protected]>

Author: mrnicegyu11

services/monitoring/tempo_config.yaml.j2

@@ -21,6 +21,12 @@ compactor:
 # and via https://github.com/ITISFoundation/osparc-ops-environments/issues/1086
 metrics_generator:
   processor:
+    span_metrics:
+      dimensions:
+        - service
+        - span_kind
+        - status_code
+        # Intentionally exclude span_name to prevent high cardinality
     local_blocks:
       filter_server_spans: false
       flush_to_storage: true