ThanosRuleNotConnectedToAlertmanagers

This alert is triggered when Thanos Ruler instances have no (or not enough) connections to Alertmanager.

Troubleshooting

Check Thanos Ruler configuration.

stagingproduction

kubectl exec -it -n monitoring-stack-corp-obs-corp-stg thanos-ruler-obs-corp-stg-thanos-ruler-0 -- cat /etc/thanos/config/alertmanager-config/alertmanager-configs.yaml

kubectl exec -it -n monitoring-stack-corp-obs-corp-prd thanos-ruler-obs-corp-prd-thanos-ruler-0 -- cat /etc/thanos/config/alertmanager-config/alertmanager-configs.yaml

Expected result:

alertmanagers:
  - api_version: "v2"
    static_configs: ["alertmanager-0.alertmanager-headless:9093", "alertmanager-1.alertmanager-headless:9093"]
    scheme:  "http"
    timeout: "10s"