azure-metrics-exporter: Automatic retry for SubscriptionRequestsThrottled errors.
Hi all,
i would like to ask if its possible to implement a automatic retry mechanism, if a SubscriptionRequestsThrottled answers appears.
Sometime, we get errors like this:
"GET https://management.azure.com/subscriptions/xxx/resourceGroups/xxxx/providers/Microsoft.Compute/virtualMachines/xxxx//providers/Microsoft.Insights/metrics\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of requests for subscription '6fb867d5-d552-4dbe-9f6a-7a151b6292aa' and operation 'GET/SUBSCRIPTIONS/RESOURCEGROUPS/PROVIDERS/MICROSOFT.COMPUTE/VIRTUALMACHINES/PROVIDERS/MICROSOFT.INSIGHTS/METRICS' exceeded the backend storage limit. Please try again after '0' seconds.\"\n }\n}\n--------------------------------------------------------------------------------\n"
About this issue
- Original URL
- State: closed
- Created 4 years ago
- Comments: 21 (21 by maintainers)
i tested it yesterday with the consumption api and can confirm that retry is working.
According to the documentation retry it built in (like in the old sdk version) and that matches the request count metrics when HTTP 429 are received (first a drop in requests and then later a spike)
One of our services run into throttling some days ago and didn’t reported any panics