Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Auto reload model when cluster rebooted/node rejoin #577

Open
ylwu-amzn opened this issue Nov 28, 2022 · 0 comments
Open

[FEATURE] Auto reload model when cluster rebooted/node rejoin #577

ylwu-amzn opened this issue Nov 28, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@ylwu-amzn
Copy link
Collaborator

ylwu-amzn commented Nov 28, 2022

Is your feature request related to a problem?
Refer to https://forum.opensearch.org/t/feedback-machine-learning-model-serving-framework-experimental-release/11439/19

I have noticed that models are not automatically loaded when the OpenSearch cluster is rebooted. Is there a way to do that? It would be impractical to manually reload models each time the cluster is rebooted, especially in a containerized setup.

What solution would you like?
We track each model's state in model index. When node restarted/rejoin cluster, check model state and reload model on corresponding ML node.

What alternatives have you considered?
NO

Do you have any additional context?
N/A

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant