Skip to content

Update vLLM version to v0.9.1 #2061

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/env/_build_image.sh
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,5 @@
# Copyright (C) 2025 Intel Corporation
# SPDX-License-Identifier: Apache-2.0

export VLLM_VER=v0.9.0.1
export VLLM_VER=v0.9.1
export VLLM_FORK_VER=v0.6.6.post1+Gaudi-1.20.0
1 change: 1 addition & 0 deletions AudioQnA/docker_compose/intel/cpu/xeon/compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,7 @@ services:
LLM_MODEL_ID: ${LLM_MODEL_ID}
VLLM_TORCH_PROFILER_DIR: "/mnt"
LLM_SERVER_PORT: ${LLM_SERVER_PORT}
VLLM_CPU_OMP_THREADS_BIND: all
healthcheck:
test: ["CMD-SHELL", "curl -f http://$host_ip:${LLM_SERVER_PORT}/health || exit 1"]
interval: 10s
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,7 @@ services:
LLM_MODEL_ID: ${LLM_MODEL_ID}
VLLM_TORCH_PROFILER_DIR: "/mnt"
LLM_SERVER_PORT: ${LLM_SERVER_PORT}
VLLM_CPU_OMP_THREADS_BIND: all
healthcheck:
test: ["CMD-SHELL", "curl -f http://$host_ip:${LLM_SERVER_PORT}/health || exit 1"]
interval: 10s
Expand Down
2 changes: 1 addition & 1 deletion AudioQnA/tests/test_compose_multilang_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ function build_docker_images() {

git clone https://github.com/vllm-project/vllm.git
cd ./vllm/
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null && cd ../

Expand Down
2 changes: 1 addition & 1 deletion AudioQnA/tests/test_compose_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ function build_docker_images() {

git clone https://github.com/vllm-project/vllm.git
cd ./vllm/
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null && cd ../

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -83,6 +83,7 @@ services:
vllm-service:
image: ${REGISTRY:-opea}/vllm:${TAG:-latest}
container_name: vllm-server
privileged: true
ports:
- ${LLM_ENDPOINT_PORT:-9009}:80
volumes:
Expand Down
2 changes: 1 addition & 1 deletion ChatQnA/tests/test_compose_faqgen_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ function build_docker_images() {
docker build --no-cache -t ${REGISTRY}/comps-base:${TAG} --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile .
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null && cd ../

Expand Down
2 changes: 1 addition & 1 deletion ChatQnA/tests/test_compose_faqgen_tgi_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ function build_docker_images() {
docker build --no-cache -t ${REGISTRY}/comps-base:${TAG} --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile .
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null && cd ../

Expand Down
2 changes: 1 addition & 1 deletion ChatQnA/tests/test_compose_mariadb_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ function build_docker_images() {
docker build --no-cache -t ${REGISTRY}/comps-base:${TAG} --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile .
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
# make sure NOT change the pwd
Expand Down
2 changes: 1 addition & 1 deletion ChatQnA/tests/test_compose_milvus_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ function build_docker_images() {
docker build --no-cache -t ${REGISTRY}/comps-base:${TAG} --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile .
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
# make sure NOT change the pwd
Expand Down
2 changes: 1 addition & 1 deletion ChatQnA/tests/test_compose_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ function build_docker_images() {
docker build --no-cache -t ${REGISTRY}/comps-base:${TAG} --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile .
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
# make sure NOT change the pwd
Expand Down
2 changes: 1 addition & 1 deletion ChatQnA/tests/test_compose_pinecone_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ function build_docker_images() {
docker build --no-cache -t ${REGISTRY}/comps-base:${TAG} --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile .
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
# Not change the pwd
Expand Down
2 changes: 1 addition & 1 deletion ChatQnA/tests/test_compose_qdrant_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ function build_docker_images() {
docker build --no-cache -t ${REGISTRY}/comps-base:${TAG} --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile .
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
# Not change the pwd
Expand Down
2 changes: 1 addition & 1 deletion ChatQnA/tests/test_compose_without_rerank_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ function build_docker_images() {
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm

VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
# Not change the pwd
Expand Down
2 changes: 1 addition & 1 deletion CodeGen/tests/test_compose_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ function build_docker_images() {
popd && sleep 1s

git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
cd ../
Expand Down
2 changes: 1 addition & 1 deletion CodeTrans/tests/test_compose_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ function build_docker_images() {
popd && sleep 1s

git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
cd ../
Expand Down
2 changes: 1 addition & 1 deletion DocSum/tests/test_compose_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ function build_docker_images() {
popd && sleep 1s

git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
cd ../
Expand Down
3 changes: 2 additions & 1 deletion HybridRAG/tests/test_compose_on_gaudi.sh
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,8 @@ function build_docker_images() {
popd && sleep 1s

git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1

echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
# make sure NOT change the pwd
Expand Down
2 changes: 1 addition & 1 deletion VisualQnA/tests/test_compose_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ function build_docker_images() {
docker build --no-cache -t ${REGISTRY}/comps-base:${TAG} --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile .
popd && sleep 1s
git clone https://github.com/vllm-project/vllm.git && cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
cd ../
Expand Down
2 changes: 1 addition & 1 deletion WorkflowExecAgent/tests/2_start_vllm_service.sh
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ function build_vllm_docker_image() {
if [ ! -d "./vllm" ]; then
git clone https://github.com/vllm-project/vllm.git
cd vllm
VLLM_VER=v0.9.0.1
VLLM_VER=v0.9.1
echo "Check out vLLM tag ${VLLM_VER}"
git checkout ${VLLM_VER} &> /dev/null
git rev-parse HEAD
Expand Down
Loading