Skip to content

[7.13] [ML] prevent accidentally asking for more resources when scaling down and improve scaling size estimations (#74691) #74782

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jul 1, 2021

Conversation

benwtrent
Copy link
Member

Backports the following commits to 7.13:

… and improve scaling size estimations (elastic#74691)

This commit addresses two problems:

 - Our memory estimations are not very exact. Consequently, its possible to request for too much or too little by a handful of KBs, while this is not a large issue in ESS, for custom tier sizes, it may be.
 - When scaling down, it was possible that part of the scale down was actually a scale up! This was due to some floating point rounding errors and poor estimations. Even though are estimations are better, it is best to NOT request higher resources in a scale down, no matter what.

One of the ways we improve the calculation is during JVM size calculations. Instead of having the knot point be `2gb` it has been changed to `1.2gb`. This accounts for the "window of uncertainty" for JVM sizes.

closes: elastic#74709
@benwtrent benwtrent added :ml Machine learning backport labels Jun 30, 2021
@elasticmachine elasticmachine added the Team:ML Meta label for the ML team label Jun 30, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@benwtrent
Copy link
Member Author

run elasticsearch-ci/part-2

@joegallo joegallo added v7.13.4 and removed v7.13.3 labels Jun 30, 2021
@benwtrent benwtrent merged commit e31d5f8 into elastic:7.13 Jul 1, 2021
@benwtrent benwtrent deleted the backport/7.13/pr-74691 branch July 1, 2021 11:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport :ml Machine learning Team:ML Meta label for the ML team v7.13.4
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants