Aller au contenu

ThanosRuleQueryHighDNSFailures#

This alert is trigerred when Thanos Ruler fails DNS resolution for Thanos Querier.

Troubleshooting Hints#

Note

  • NAMESPACE=monitoring-stack-corp-obs-corp-stg
  • NAMESPACE=monitoring-stack-corp-obs-corp-prd

  • Check if the Thanos Querier is deployed and is running (see ThanosQueryIsDown).

    kubectl get pod -n ${NAMESPACE} | grep quer

  • Check the correspondance between Thanos Ruler configuration and how Thanos Querier is deployed.

    kubectl -n ${NAMESPACE} get secret thanosruler-alertmanager-config -o yaml
kubectl -n ${NAMESPACE} get secret thanosruler-alertmanager-config -o jsonpath="{.data.alertmanager-configs\.yaml}" | base64 -d; echo

  • Check the DNS resolution path (coredns...)