Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added Queue design doc. #95

Merged
merged 1 commit into from
Apr 27, 2019
Merged

Added Queue design doc. #95

merged 1 commit into from
Apr 27, 2019

Conversation

k82cn
Copy link
Member

@k82cn k82cn commented Apr 18, 2019

Signed-off-by: Da K. Ma klaus1982.cn@gmail.com

Copy link
Contributor

@TommyLike TommyLike left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks :)

docs/design/queue.md Outdated Show resolved Hide resolved
docs/design/queue.md Outdated Show resolved Hide resolved

The admission controller will check `PodGroup`/`Job` 's queue when creation:

1. if the queue does not exist, the creation will be rejected
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we inject the default queue?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe reject it in the first version; we can refer to how prioirtyCass for such kind of default value.

docs/design/queue.md Outdated Show resolved Hide resolved
docs/design/queue.md Outdated Show resolved Hide resolved
docs/design/queue.md Outdated Show resolved Hide resolved
The admission controller will check `PodGroup`/`Job` 's queue when creation:

1. if the queue does not exist, the creation will be rejected
2. if the queue is releasing, the creation will be also rejected
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about the default weight in admission hook

docs/design/queue.md Show resolved Hide resolved
docs/design/queue.md Outdated Show resolved Hide resolved

type QueueSpec struct {
// The weight of queue to share the resources with each other.
Weight int32 `json:"weight,omitempty" protobuf:"bytes,1,opt,name=weight"`
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the meaning of the value? Should have a clear desc.

docs/design/queue.md Show resolved Hide resolved
docs/design/queue.md Outdated Show resolved Hide resolved

* Proportion plugin:

Proportion plugin is used to share resource between `Queue`s by weight. The deserved resource of a queue is `(weight/total-weight) * total-resource`. When allocating resources, it will not allocate resource more than its deserved resources.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIUC, it seems total-weight will sum up all the weight of the queues, as the queue increases, the (weight/total-weight) will change. How do scheduler adjust the proportion of resources an old queue occupies ? Let's say the queue resources are all used up, will this trigger a preemt?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Another case, cluster resources may also change

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Kube-batch will continue executing those actions every X period.

@k82cn k82cn force-pushed the queue_design branch 3 times, most recently from 8fc3cca to 279a266 Compare April 19, 2019 12:14
Signed-off-by: Da K. Ma <klaus1982.cn@gmail.com>
@k82cn k82cn changed the title WIP: Added Queue design doc. Added Queue design doc. Apr 19, 2019
@k82cn
Copy link
Member Author

k82cn commented Apr 27, 2019

/lgtm
/approve

@volcano-sh-bot volcano-sh-bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 27, 2019
@k82cn k82cn merged commit 51d0571 into volcano-sh:master Apr 27, 2019
@k82cn k82cn deleted the queue_design branch April 27, 2019 09:34
@TommyLike
Copy link
Contributor

@hzxuzhonghu would you please working on this ? thanks:)
/cc @k82cn

@hzxuzhonghu
Copy link
Collaborator

Sure, will do

kevin-wangzefeng pushed a commit to kevin-wangzefeng/volcano that referenced this pull request Apr 30, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants