Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for multi-node on CI #5955

Merged
merged 46 commits into from
Jul 9, 2024
Merged

Conversation

khluu
Copy link
Collaborator

@khluu khluu commented Jun 28, 2024

Add script to run multi-node tests on CI.

khluu added 24 commits June 28, 2024 10:43
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
Signed-off-by: kevin <kevin@anyscale.com>
@khluu khluu marked this pull request as ready for review July 1, 2024 18:21
@khluu khluu requested review from youkaichao and simon-mo July 1, 2024 18:21
@khluu khluu changed the title multinode test pr Add support for multi-node on CI Jul 1, 2024
@khluu khluu marked this pull request as draft July 1, 2024 18:26
p
Signed-off-by: kevin <kevin@anyscale.com>
khluu added 13 commits July 1, 2024 20:48
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
@khluu khluu marked this pull request as draft July 1, 2024 23:02
khluu added 5 commits July 1, 2024 23:03
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
p
Signed-off-by: kevin <kevin@anyscale.com>
@khluu khluu marked this pull request as ready for review July 1, 2024 23:38
@youkaichao
Copy link
Member

sorry for the late review. is it already in the ci now?

khluu added 2 commits July 9, 2024 00:04
p
Signed-off-by: kevin <kevin@anyscale.com>
Signed-off-by: kevin <kevin@anyscale.com>
@khluu
Copy link
Collaborator Author

khluu commented Jul 9, 2024

sorry for the late review. is it already in the ci now?

I added the multinode support to the template on buildkite-ci. After this PR is merged, you can start adding multi-node tests! cc: @simon-mo for merging

@simon-mo simon-mo merged commit a0550cb into vllm-project:main Jul 9, 2024
70 checks passed
adityagoel14 pushed a commit to adityagoel14/vllm-torchrun-test that referenced this pull request Jul 10, 2024
Signed-off-by: kevin <kevin@anyscale.com>
(cherry picked from commit a0550cb)
dtrifiro pushed a commit to opendatahub-io/vllm that referenced this pull request Jul 17, 2024
Signed-off-by: kevin <kevin@anyscale.com>
xjpang pushed a commit to xjpang/vllm that referenced this pull request Jul 24, 2024
Signed-off-by: kevin <kevin@anyscale.com>
Alvant pushed a commit to compressa-ai/vllm that referenced this pull request Oct 26, 2024
Signed-off-by: kevin <kevin@anyscale.com>
Signed-off-by: Alvant <alvasian@yandex.ru>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants