Skip to content

Setup alerts for various billing cronjobs #1695

@naved001

Description

@naved001

We have kubernetes cronjobs running on 2 openshift clusters.

  1. nerc-shift-1: OpenStack, Storage, Daily Billing,
  2. nerc-ocp-prod openshift cluster: OpenShift metrics collection, OpenShift reporting.

We want to get alerts when a job fails.

Here are some options:

  1. The obs clusters alertmanager can be configured to send alerts to our own slack channel. However, the obs cluster only has metrics from the nerc-ocp-prod. We will need to connect it to nerc-shift-1 so we can get metrics for all our cronjobs.

  2. Configure the alertmanager in nerc-shift-1 to send alerts to our slack channel. Currently, we get alerts from the cluster about everything that go into p-nerc. Alerts for openshift reporting can still come from the obs cluster.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions