Aller au contenu

ThanosReceiveHttpRequestErrorRateHigh#

This alert is triggered when Thanos Receive has more than 5% of http errors 5xx.

These http errors indicate that Thanos Receive fails to read data from the components it connects to.

Troubleshooting Hints#

Note

  • NAMESPACE=monitoring-stack-corp-obs-corp-stg
  • NAMESPACE=monitoring-stack-corp-obs-corp-prd

  • Check the logs of Thanos Receive. They will probably give some information about the requests that fail and the broken component.

    kubectl get pods -n ${NAMESPACE}
kubectl logs -n ${NAMESPACE} -l app.kubernetes.io/name=thanos