ThanosRuleAlertmanagerHighDNSFailures#
This alert is trigerred when Thanos Ruler fails DNS resolution for Alertmanager.
Troubleshooting Hints#
-
Check if Alertmanager is deployed and is running.
kubectl get pod -n ${NAMESPACE} | grep alertmanager -
Check the correspondance between Thanos Ruler configuration and how Alertmanager is deployed. The configuration of alertmanagers can be found in a secret:
kubectl -n ${NAMESPACE} get secret thanosruler-alertmanager-config -o yaml kubectl -n ${NAMESPACE} get secret thanosruler-alertmanager-config -o jsonpath="{.data.alertmanager-configs\.yaml}" | base64 -d; echo -
Check the DNS resolution path (coredns...)