Skip to content

Commit d2a187a

Browse files
authored
Fixes Quickstart Script (#1388)
* Tooling: Fixes Conformance Path in Quickstart Script Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io> * Updates vLLM image to latest release quickstart.sh Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io> --------- Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
1 parent 310c2ee commit d2a187a

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

hack/release-quickstart.sh

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -30,12 +30,12 @@ else
3030
fi
3131

3232
# The vLLM image versions
33-
# The GPU image is from https://hub.docker.com/layers/vllm/vllm-openai
34-
VLLM_GPU="${VLLM_GPU:-0.9.1}"
33+
# The GPU image is from https://hub.docker.com/r/vllm/vllm-openai/tags
34+
VLLM_GPU="${VLLM_GPU:-0.10.0}"
3535
# The CPU image is from https://gallery.ecr.aws/q9t5s3a7/vllm-cpu-release-repo
36-
VLLM_CPU="${VLLM_CPU:-0.9.1}"
36+
VLLM_CPU="${VLLM_CPU:-0.10.0}"
3737
# The sim image is from https://github.com/llm-d/llm-d-inference-sim/pkgs/container/llm-d-inference-sim
38-
VLLM_SIM="${VLLM_SIM:-0.3.0}"
38+
VLLM_SIM="${VLLM_SIM:-0.3.2-fix}"
3939

4040
echo "Using release tag: ${RELEASE_TAG}"
4141
echo "Using vLLM GPU image version: ${VLLM_GPU}"
@@ -78,7 +78,7 @@ EPP="config/manifests/inferencepool-resources.yaml"
7878
#TODO: Put all helm values files into an array to loop over
7979
EPP_HELM="config/charts/inferencepool/values.yaml"
8080
BBR_HELM="config/charts/body-based-routing/values.yaml"
81-
CONFORMANCE_MANIFESTS="conformance/resources/manifests/manifests.yaml"
81+
CONFORMANCE_MANIFESTS="conformance/resources/base.yaml"
8282
echo "Updating ${EPP}, ${EPP_HELM}, ${BBR_HELM}, and ${CONFORMANCE_MANIFESTS} ..."
8383

8484
# Update the container tag.

0 commit comments

Comments
 (0)