PromitorResourceDiscoveryThrottled

Alert is triggered when promitor_ratelimit_resource_graph_throttled is equal to one over a period of 10 minutes.

This alert either indicates that we reach the limit of the number of requests on the Azure API. It's a service interruption.

To identify the tenant for which we have reached the limit tenant_id label is available.

More explanations :

• learn.microsoft.com.
• docs.promitor.io

Troubleshooting Hints

• check the evolution of the number of available requests with promitor_ratelimit_resource_graph_remaining{tenant_id="xxxx"}

• see if it is necessary to modify the scraping interval in Scraper. Example :

  scraping:
    # Every minute
    schedule: "0 * * ? * *"
  

  ->

  scraping:
    # Every 2 minutes
    schedule: "0 */2 * ? * *"
  

• see if it is necessary to modify the cache.

  cache:
    durationInMinutes: 5
  

  ->

  cache:
    durationInMinutes: 10
  

Note

If this incident happens, please note your investigation and update this documentation.