Aller au contenu

ThanosRuleNoEvaluationFor10Intervals#

This alert is trigerred when Thanos Ruler has failed to evaluate some rules groups for at least 10x of their expected interval.

Troubleshooting Hints#

Note

  • NAMESPACE=monitoring-stack-corp-obs-corp-stg
  • NAMESPACE=monitoring-stack-corp-obs-corp-prd

  • Check the logs of Thanos Ruler and find the failed rules groups. The logs may explain why they fail.

    kubectl get pods -n ${NAMESPACE}
kubectl logs -n ${NAMESPACE} -l app.kubernetes.io/name=thanos-ruler

  • Check the expression of the PrometheusRule by using Explore menu in Grafana staging or production.