Aller au contenu

Inhibition of large number of alerts#

Principles#

The goal is to inhibit warning and critical alerts when their number exceeds a defined threshold.

Inhibited alerts can be visible in Karma with the filter below :

@inhibited=true

Alertmanager configuration#

Inhibit rules#

Alertmanager is configured so that when the InhibitorClusterAlerts alert is firing, severity warning and critical alerts are inhibited :

inhibit_rules:
- source_matchers:
  - alertname = InhibitorClusterAlerts
  target_matchers:
  - severity =~ ^(warning|critical)$

InhibitorClusterAlerts rule routing#

The InhibitorClusterAlerts alert should be routed to Karma, Rocketchat and Mail receiver :

  • to send notification about this alert;
  • to see this alert in Karma.