Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can this exporter support azure batch API for getting metrics , if not in future releases can we expect this feature? #70

Open
tharun2258 opened this issue Dec 18, 2023 · 5 comments

Comments

@tharun2258
Copy link

tharun2258 commented Dec 18, 2023

Reference API :

POST /subscriptions//metrics:getBatch?metricNamespace=&api-version=2023-03-01-preview

Microsoft documentation for batch API to get metrics:

https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/migrate-to-batch-api

@tharun2258
Copy link
Author

@jkroepke Kindly update any updates on this issue and kindly ask any additional details required for this issue

@jkroepke
Copy link
Contributor

jkroepke commented Jan 5, 2024

Hi @tharun2258 is an reason mention me? I'm not an maintainer here.

@jkroepke
Copy link
Contributor

jkroepke commented Jan 5, 2024

@mblaschke The quest may solve some Rate limit issues that exists with azure-metrics-exports.

The batch API is already availble, but not in armmonitor SDK package. Instead there is an dedicated monitor/azquery package which seems to be optimized for fetching metrics. https://github.com/Azure/azure-sdk-for-go/tree/main/sdk/monitor/azquery.

@tharun2258
Copy link
Author

tharun2258 commented Jan 8, 2024

Hi @tharun2258 is an reason mention me? I'm not an maintainer here.

Hi , Okay thanks for the reference link and information shared.

@tharun2258
Copy link
Author

@mblaschke @jkroepke

We are currently using Azure Metric Exporter (Prometheus exporter), which is now part of Grafana agent for scraping Azure resource metrics. The Azure metric exporter is mainly based on Azure monitor REST API, which has a throttling limit of 12,000 per principal id and per subscription. Recently, Microsoft introduced the Batch API (Data Plane API), which has a throttling limit of 360,000. They recommend switching to the Batch API from the REST API (links provided below).

Do you have any plans to incorporate the Batch API in Azure Metric Exporter? If so, could you please provide a high-level timeline?"

Reference links:

https://techcommunity.microsoft.com/t5/azure-observability-blog/azure-monitor-announcing-public-preview-of-azure-metrics-data/ba-p/3805986

https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/migrate-to-batch-api?tabs=individual-response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants