Currently because the way we export metrics, we keep generating new timeseries labels that are never cleaned up even though they don't change. This should not be this way.
Instead we should keep track when we set up a metric and clean up the metric after some time has passed.