Skip to content

Commit

Permalink
use vllm 0.3.1
Browse files Browse the repository at this point in the history
  • Loading branch information
pseudotensor committed Feb 16, 2024
1 parent c80f200 commit 73db8c9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docker_build_script_ubuntu.sh
Original file line number Diff line number Diff line change
Expand Up @@ -90,7 +90,7 @@ python -m venv vllm_env --system-site-packages
/h2ogpt_conda/vllm_env/bin/python -m pip install https://h2o-release.s3.amazonaws.com/h2ogpt/mosaicml_turbo-0.0.9-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
# below has issue that compiled on A100, doesn't seem to work on V100, go back to vllm's own build
#/h2ogpt_conda/vllm_env/bin/python -m pip install https://h2o-release.s3.amazonaws.com/h2ogpt/vllm-0.3.0-cp310-cp310-manylinux1_x86_64.whl
/h2ogpt_conda/vllm_env/bin/python -m pip install vllm==0.3.0
/h2ogpt_conda/vllm_env/bin/python -m pip install vllm==0.3.1
mkdir $VLLM_CACHE
chmod -R a+rwx /h2ogpt_conda

Expand Down

0 comments on commit 73db8c9

Please sign in to comment.