Aller au contenu

PromitorScraperRemainingRequestsTooLow#

This alert is triggered when the number of available requests on Azure API is approaching 0.

It is currently configured to trigger a warning if less than 2000 requests are available and less than 100 are predicted to remain in the next 24 hours, indicating an imminent risk of throttling.

Use promitor_ratelimit_arm metrics in Grafana in order to visualize how many calls are still available before Azure Resource Manager (ARM) is going to throttle us.

When there are no more requests available at all, the requests are in error and we have the alert : PromitorScraperThrottled.

Troubleshooting Hints#

  • The first thing to do is to delete the scraper pod and see if the alert is triggered again : 

    kubectl delete pod -n monitoring-stack-client-obs-${obs_client} -l app=promitor-scraper-tenant1 # obs_client is a label in the alert

  • If the alert is triggered again, see PromitorScraperThrottled troubleshooting hints