-
Notifications
You must be signed in to change notification settings - Fork 25.3k
Add shard write-load to cluster info #131496
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Add shard write-load to cluster info #131496
Conversation
Pinging @elastic/es-distributed-coordination (Team:Distributed Coordination) |
@@ -527,8 +538,6 @@ public ClusterInfo getClusterInfo() { | |||
estimatedHeapUsages.put(nodeId, new EstimatedHeapUsage(nodeId, maxHeapSize.getBytes(), estimatedHeapUsage)); | |||
} | |||
}); | |||
final Map<String, NodeUsageStatsForThreadPools> nodeThreadPoolUsageStats = new HashMap<>(); | |||
nodeThreadPoolUsageStatsPerNode.forEach((nodeId, nodeWriteLoad) -> { nodeThreadPoolUsageStats.put(nodeId, nodeWriteLoad); }); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This appeared to be just a copy, which already happens in the ClusterInfo
constructor, I assume remnants of something that was since refactored away.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, nice
We already use
TransportIndicesStatsAction
to retrieve size on disk for the disk threshold decider.This PR just adds the
Indexing
stats to that request when the write load decider is enabled, and adds the returned shard write loads to theClusterInfo
.We should be able to feed these into the simulator to properly account for shard movement.
Relates: ES-12419 & ES-12420