Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

the dev of [FEATURE]Auto reload model when cluster rebooted/node rejoin #711

Merged
merged 30 commits into from
Feb 20, 2023
Merged
Changes from 1 commit
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
77a1ffb
[wjunshen] #N/A feat: fix after the latest rebase
wujunshen Jan 25, 2023
9f50458
[wjunshen] #N/A feat: fix after rebase
wujunshen Jan 25, 2023
ddfb117
[wjunshen] #N/A feat: fix after rebase
wujunshen Jan 25, 2023
0c235a6
[wjunshen] #N/A feat: fix after rebase
wujunshen Jan 25, 2023
35a3703
[wjunshen] #N/A feat: fix after the latest rebase
wujunshen Jan 25, 2023
350faed
Increment version to 2.6.0-SNAPSHOT (#671)
opensearch-trigger-bot[bot] Jan 25, 2023
5126aba
fix profile API in example doc (#712)
ylwu-amzn Jan 25, 2023
c22980c
change model url to public repo in text embedding model example doc (…
ylwu-amzn Jan 26, 2023
a0f1df5
Enhance profile API to add model centric result controlled by view pa…
zane-neo Jan 31, 2023
f62ad71
add planning work nodes to model (#715)
ylwu-amzn Jan 31, 2023
eaf794d
skip running syncup job if no model index (#717)
ylwu-amzn Jan 31, 2023
3f710da
refactor: add DL model class (#722)
ylwu-amzn Feb 6, 2023
da42086
tune model config: change pooling mode to optional (#724)
ylwu-amzn Feb 6, 2023
699e06a
[wjunshen] #N/A feat: make the log readable
wujunshen Feb 8, 2023
0365674
[wjunshen] #N/A feat: add error log
wujunshen Feb 8, 2023
d779f8c
[wjunshen] #N/A feat: Refer to PR #717,just checking if index exists …
wujunshen Feb 9, 2023
9fa1025
[wjunshen] #N/A feat: change RunTimeException to MLException
wujunshen Feb 9, 2023
beef20f
[wjunshen] #N/A feat: also consider COMPLETED_WITH_ERROR
wujunshen Feb 9, 2023
5f3c2cc
[wjunshen] #N/A feat: remove ML_MODEL_RELOAD_MAX_RETRY_TIMES in Commo…
wujunshen Feb 9, 2023
facc4a1
[wjunshen] #N/A feat: remove Result class
wujunshen Feb 9, 2023
7356a82
[wjunshen] #N/A feat: change "reload" and "retry" to a full word
wujunshen Feb 9, 2023
ddab41c
[wjunshen] #N/A feat: change log info sentence
wujunshen Feb 9, 2023
76fb7f0
[wjunshen] #N/A feat: code format
wujunshen Feb 9, 2023
c0b575e
Merge branch 'opensearch-project:2.x' into 2.x
wujunshen Feb 9, 2023
78ae922
[Signed-off-by: wjunshen<wjunshen@amazon.com>] #N/A feat:
wujunshen Feb 16, 2023
f169ec1
[Signed-off-by: wjunshen<wjunshen@amazon.com>] #N/A feat:
wujunshen Feb 17, 2023
5436e6d
[Signed-off-by: wjunshen<wjunshen@amazon.com>] #N/A feat:
wujunshen Feb 17, 2023
71e5645
[Signed-off-by: wjunshen<wjunshen@amazon.com>] #N/A feat:
wujunshen Feb 17, 2023
38bf342
[Signed-off-by: wjunshen<wjunshen@amazon.com>] #N/A feat:
wujunshen Feb 17, 2023
467250e
[Signed-off-by: wjunshen<wjunshen@amazon.com>] #N/A feat:
wujunshen Feb 17, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[wjunshen] #N/A feat: fix after rebase
Signed-off-by: wujunshen <frank_wjs@hotmail.com>
  • Loading branch information
wujunshen committed Feb 9, 2023
commit 0c235a67d29590543bd5c30d91f2057ce24a7753
Original file line number Diff line number Diff line change
Expand Up @@ -155,17 +155,6 @@ public void testAutoReLoadModel_Is_Not_ML_Node() {
mlModelAutoReLoader.autoReLoadModel();
}

public void testAutoReLoadModelByNodeId() throws IOException, ExecutionException, InterruptedException {
createIndex(ML_MODEL_RELOAD_INDEX);
initDataOfMlTask(localNodeId, modelId, MLTaskType.LOAD_MODEL, MLTaskState.COMPLETED);
initDataOfMlModel(modelId);

mlModelAutoReLoader.autoReLoadModelByNodeId(localNodeId);

StepListener<SearchResponse> getReTryTimesStep = new StepListener<>();
mlModelAutoReLoader.getReTryTimes(localNodeId, ActionListener.wrap(getReTryTimesStep::onResponse, getReTryTimesStep::onFailure));
}

public void testAutoReLoadModelByNodeId_ReTry() throws IOException, ExecutionException, InterruptedException {
createIndex(ML_MODEL_RELOAD_INDEX);
initDataOfMlTask(localNodeId, modelId, MLTaskType.LOAD_MODEL, MLTaskState.COMPLETED);
Expand Down Expand Up @@ -210,12 +199,6 @@ public void testAutoReLoadModelByNodeId_EmptyHits() throws ExecutionException, I
mlModelAutoReLoader.autoReLoadModelByNodeId(localNodeId);
}

public void testAutoReLoadModelByNodeAndModelId() throws IOException {
initDataOfMlTask(localNodeId, modelId, MLTaskType.LOAD_MODEL, MLTaskState.COMPLETED);
initDataOfMlModel(modelId);
mlModelAutoReLoader.autoReLoadModelByNodeAndModelId(localNodeId, modelId);
}

public void testAutoReLoadModelByNodeAndModelId_Exception() {
Throwable exception = Assert
.assertThrows(RuntimeException.class, () -> mlModelAutoReLoader.autoReLoadModelByNodeAndModelId(localNodeId, modelId));
Expand Down