PromitorScraperThrottled#

Alert is triggered when promitor_ratelimit_arm_throttled is equal to one over a period of 10 minutes.

This alert either indicates that we reach the limit of the number of requests on the Azure API. It's a service interruption.

Throttling happens at two levels. Azure Resource Manager throttles requests for the subscription and tenant.

The limits are currently for :

To identify the tenant and the subscription for which we have reached the limit, several labels are available :

When the limit is reached, we receive the HTTP status code 429 Too many requests.

More explanations :

Troubleshooting Hints#

check the evolution of the number of available requests with promitor_ratelimit_arm{tenant_id="xxxx", subscription_id="yyyy"}
see if it is necessary to modify the generic scraping interval. Example :
```
metricDefaults:
...
  scraping:
    # Every minute
    schedule: "0 * * ? * *"
```
->
```
metricDefaults:
...
  scraping:
    # Every 2 minutes
    schedule: "0 */2 * ? * *"
```
This alert is automatically generated based on the number of calls over a 24-hour period. The only action is to wait — the alert will clear on its own once the conditions return to normal.

Note

If this incident happens, please note your investigation and update this documentation.