Skip to content

[llm] Upgrade vllm to 0.17.0 in ray-llm #61445

@hosonfung

Description

@hosonfung

Description

Qwen has released 3.5 and I would like to run on ray-llm on my k8s cluster.
We need newer vllm version in ray-llm.

Use case

Run qwen3.5 on k8s

Metadata

Metadata

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions