Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GCS]Add gcs resource scheduler #13072

Merged
merged 32 commits into from
Jan 14, 2021
Merged

[GCS]Add gcs resource scheduler #13072

Changes from 1 commit
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
bd47564
add part code
Dec 10, 2020
b78c894
rebase master
Dec 12, 2020
4170043
add part code
Dec 10, 2020
8578907
add part code
Dec 11, 2020
58b5d85
fix code style
Dec 13, 2020
4897d7f
fix ut bug
Dec 13, 2020
c6333ce
add part code
Dec 9, 2020
600bd43
add part code
Dec 10, 2020
3a788e6
add part code
Dec 10, 2020
b07f369
add part code
Dec 14, 2020
003d6e2
add part code
Dec 14, 2020
d68e9df
rebase master
Dec 24, 2020
6cec27c
add part code
Dec 27, 2020
910d186
rebase master
Dec 27, 2020
b78a1d2
add part code
Dec 27, 2020
d5bc7ff
add part code
Dec 28, 2020
7dd33b9
add part code
Dec 28, 2020
71a8547
add part code
Dec 29, 2020
fcf4bab
add part code
Dec 29, 2020
1a003bc
add part code
Dec 30, 2020
368dab5
add part code
Dec 30, 2020
c13ebfe
add part code
Dec 30, 2020
6d77661
add part code
Dec 30, 2020
ff5bf3b
add part code
Dec 30, 2020
0cab178
fix review comments
Jan 5, 2021
9101161
fix review comments
Jan 7, 2021
3ce8e41
fix review comment
Jan 7, 2021
4d1bc9b
fix review comments
Jan 7, 2021
ec7667e
fix review comment
Jan 7, 2021
351d4ec
add testcase
Jan 7, 2021
d2f9c85
fix review comments
Jan 7, 2021
f58c95d
fix review comment
Jan 8, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add part code
  • Loading branch information
灵洵 committed Dec 28, 2020
commit 7dd33b9548971cb0682a0d60ff1859d3cba31bf9
24 changes: 15 additions & 9 deletions src/ray/gcs/gcs_server/gcs_resource_scheduler.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -124,9 +124,9 @@ void GcsResourceScheduler::StrictSpreadSchedule(

// There are nodes to meet the scheduling requirements.
if (!node_scores.empty() && node_scores.front().second > 0) {
const auto &highest_score_node = node_scores.front().first;
result->push_back(highest_score_node);
candidate_nodes_copy.erase(highest_score_node);
const auto &highest_score_node_id = node_scores.front().first;
result->push_back(highest_score_node_id);
candidate_nodes_copy.erase(highest_score_node_id);
} else {
// There is no node to meet the scheduling requirements.
break;
Expand All @@ -150,16 +150,18 @@ void GcsResourceScheduler::SpreadSchedule(

// There are nodes to meet the scheduling requirements.
if (!node_scores.empty() && node_scores.front().second > 0) {
const auto &highest_score_node = node_scores.front().first;
result->push_back(highest_score_node);
candidate_nodes_copy.erase(highest_score_node);
selected_nodes.insert(highest_score_node);
const auto &highest_score_node_id = node_scores.front().first;
result->push_back(highest_score_node_id);
RAY_CHECK(gcs_resource_manager_.AcquireResources(highest_score_node_id, iter));
candidate_nodes_copy.erase(highest_score_node_id);
selected_nodes.insert(highest_score_node_id);
} else {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

// Scheduling from selected nodes.
const auto &node_scores = ScoreNodes(iter, candidate_nodes_copy);
if (!node_scores.empty() && node_scores.front().second > 0) {
const auto &highest_score_node = node_scores.front().first;
result->push_back(highest_score_node);
const auto &highest_score_node_id = node_scores.front().first;
result->push_back(highest_score_node_id);
RAY_CHECK(gcs_resource_manager_.AcquireResources(highest_score_node_id, iter));
} else {
break;
}
Expand All @@ -169,6 +171,10 @@ void GcsResourceScheduler::SpreadSchedule(
if (result->size() != required_resources_list.size()) {
// Unable to meet the resources required for scheduling, scheduling failed.
result->clear();
} else {
// Scheduling succeeded, releasing the resources temporarily deducted from
// `gcs_resource_manager_`.
ReleaseTemporarilyDeductedResources(required_resources_list, *result);
}
}

Expand Down