Skip to content

Commit 31780cf

Browse files
committed
Make KubeClientCertificateExpiration less sensitive
I just got alerted with KubeClientCertificateExpiration alert because of our Mimir tmp outage (few minutes). I think this alert would deserve some `for` period which should avoid any such issues and since the nature of the alert I believe it is acceptable to receive the alert 5 minutes later in genuine cases.
1 parent 5e44626 commit 31780cf

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

alerts/kube_apiserver.libsonnet

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,7 @@ local utils = import '../lib/utils.libsonnet';
5151
expr: |||
5252
apiserver_client_certificate_expiration_seconds_count{%(kubeApiserverSelector)s} > 0 and on(job) histogram_quantile(0.01, sum by (job, le) (rate(apiserver_client_certificate_expiration_seconds_bucket{%(kubeApiserverSelector)s}[5m]))) < %(certExpirationWarningSeconds)s
5353
||| % $._config,
54+
'for': '5m',
5455
labels: {
5556
severity: 'warning',
5657
},
@@ -64,6 +65,7 @@ local utils = import '../lib/utils.libsonnet';
6465
expr: |||
6566
apiserver_client_certificate_expiration_seconds_count{%(kubeApiserverSelector)s} > 0 and on(job) histogram_quantile(0.01, sum by (job, le) (rate(apiserver_client_certificate_expiration_seconds_bucket{%(kubeApiserverSelector)s}[5m]))) < %(certExpirationCriticalSeconds)s
6667
||| % $._config,
68+
'for': '5m',
6769
labels: {
6870
severity: 'critical',
6971
},

0 commit comments

Comments
 (0)