Skip to content

Commit

Permalink
Update vLLM install instructions
Browse files Browse the repository at this point in the history
I was hitting a cmake version issue - PyTorch only has 3.25 and some other part of the install wants >= 3.26. So switched to extra-index-url.
  • Loading branch information
c0g authored Sep 12, 2024
1 parent 5cff103 commit 976cb1e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -1084,7 +1084,7 @@ cd vllm
git checkout add_qwen2_vl_new
# Change to your CUDA version
CUDA_VERSION=cu121
pip install . --index-url https://download.pytorch.org/whl/${CUDA_VERSION}
pip install . --extra-index-url https://download.pytorch.org/whl/${CUDA_VERSION}
```
### Start an OpenAI API Service

Expand Down

0 comments on commit 976cb1e

Please sign in to comment.