Change alertmanager sd behavior

[rodrigoscferraz]

Hello folks,
I'm trying to change the - role: endpoints to - role: services as described in documentation

alerting:
  alert_relabel_configs:
  - action: labeldrop
    regex: prometheus_replica
  alertmanagers:
  - path_prefix: /
    scheme: http
    kubernetes_sd_configs:
    - role: endpoints
      namespaces:
        names:
        - monitoring

There is a way to do this?

Thx in advance

[simonpasquier]

why do you want to do this?

[rodrigoscferraz]

Basically because i'm using Istio and it blocks the communication if you use the direct pod IP, so i intent to use the service IP.

[simonpasquier]

By definition, Prometheus must send alerts to all Alertmanager pods. If you use the service IP, it will load-balance the requests which would result in an inconsistent state.

[rodrigoscferraz]

Yes sir, i knew it. But it is not a big deal to us.By now we have just one alertmanager and if we need to scale it we also have some tools that handle with this problem.

[simonpasquier]

you'll have to use additionalAlertManagerConfigs then.

[rodrigoscferraz]

thx sir