Description
Your current environment
just pull the official docker v0.8.0. However the python is missing and all binaries are now located inside /opt/venv/bin/ instead of /usr/local/bin :
ls -l /opt/venv/bin/
total 1120
-rwxr-xr-x 1 root root 321 Mar 19 02:29 accelerate
-rwxr-xr-x 1 root root 313 Mar 19 02:29 accelerate-config
-rwxr-xr-x 1 root root 315 Mar 19 02:29 accelerate-estimate-memory
-rwxr-xr-x 1 root root 313 Mar 19 02:29 accelerate-launch
-rwxr-xr-x 1 root root 312 Mar 19 02:29 accelerate-merge-weights
-rw-r--r-- 1 root root 3685 Mar 19 02:09 activate
-rw-r--r-- 1 root root 2648 Mar 19 02:09 activate.bat
-rw-r--r-- 1 root root 2592 Mar 19 02:09 activate.csh
-rw-r--r-- 1 root root 4156 Mar 19 02:09 activate.fish
-rw-r--r-- 1 root root 3841 Mar 19 02:09 activate.nu
-rw-r--r-- 1 root root 2762 Mar 19 02:09 activate.ps1
-rw-r--r-- 1 root root 2383 Mar 19 02:09 activate_this.py
-rwxr-xr-x 1 root root 296 Mar 19 02:29 ccmake
-rwxr-xr-x 1 root root 294 Mar 19 02:29 cmake
-rwxr-xr-x 1 root root 294 Mar 19 02:29 cpack
-rwxr-xr-x 1 root root 294 Mar 19 02:27 cpuinfo
-rwxr-xr-x 1 root root 294 Mar 19 02:29 ctest
-rw-r--r-- 1 root root 1728 Mar 19 02:09 deactivate.bat
-rwxr-xr-x 1 root root 300 Mar 19 02:27 distro
-rwxr-xr-x 1 root root 300 Mar 19 02:27 dotenv
-rwxr-xr-x 1 root root 311 Mar 19 02:27 email_validator
-rwxr-xr-x 1 root root 304 Mar 19 02:27 f2py
-rwxr-xr-x 1 root root 302 Mar 19 02:27 fastapi
-rwxr-xr-x 1 root root 2462 Mar 19 02:27 get_gprof
-rwxr-xr-x 1 root root 1656 Mar 19 02:27 get_objgraph
-rwxr-xr-x 1 root root 346 Mar 19 02:27 gguf-convert-endian
-rwxr-xr-x 1 root root 326 Mar 19 02:27 gguf-dump
-rwxr-xr-x 1 root root 342 Mar 19 02:27 gguf-new-metadata
-rwxr-xr-x 1 root root 342 Mar 19 02:27 gguf-set-metadata
-rwxr-xr-x 1 root root 292 Mar 19 02:27 httpx
-rwxr-xr-x 1 root root 327 Mar 19 02:27 huggingface-cli
-rwxr-xr-x 1 root root 293 Mar 19 02:27 isympy
-rwxr-xr-x 1 root root 1700 Mar 19 02:29 jp.py
-rwxr-xr-x 1 root root 317 Mar 19 02:27 json-playground
-rwxr-xr-x 1 root root 301 Mar 19 02:27 jsonschema
-rwxr-xr-x 1 root root 308 Mar 19 02:27 markdown-it
-rwxr-xr-x 1 root root 311 Mar 19 02:29 modelscope
-rwxr-xr-x 1 root root 1085448 Mar 19 02:27 ninja
-rwxr-xr-x 1 root root 314 Mar 19 02:27 normalizer
-rwxr-xr-x 1 root root 193 Mar 19 02:27 numba
-rwxr-xr-x 1 root root 297 Mar 19 02:27 openai
-rwxr-xr-x 1 root root 308 Mar 19 02:09 pip
-rwxr-xr-x 1 root root 308 Mar 19 02:09 pip3
-rwxr-xr-x 1 root root 308 Mar 19 02:09 pip3.12
-rwxr-xr-x 1 root root 309 Mar 19 02:27 proton
-rwxr-xr-x 1 root root 309 Mar 19 02:27 proton-viewer
-rw-r--r-- 1 root root 1215 Mar 19 02:09 pydoc.bat
-rwxr-xr-x 1 root root 303 Mar 19 02:27 pygmentize
lrwxrwxrwx 1 root root 75 Mar 19 02:09 python -> /root/.local/share/uv/python/cpython-3.12.9-linux-x86_64-gnu/bin/python3.12
lrwxrwxrwx 1 root root 6 Mar 19 02:09 python3 -> python
lrwxrwxrwx 1 root root 6 Mar 19 02:09 python3.12 -> python
-rwxr-xr-x 1 root root 306 Mar 19 02:27 ray
-rwxr-xr-x 1 root root 302 Mar 19 02:27 serve
-rwxr-xr-x 1 root root 317 Mar 19 02:27 torchfrtrace
-rwxr-xr-x 1 root root 308 Mar 19 02:27 torchrun
-rwxr-xr-x 1 root root 295 Mar 19 02:27 tqdm
-rwxr-xr-x 1 root root 325 Mar 19 02:27 transformers-cli
-rwxr-xr-x 1 root root 305 Mar 19 02:27 tune
-rwxr-xr-x 1 root root 296 Mar 19 02:27 typer
-rwxr-xr-x 1 root root 592 Mar 19 02:27 undill
-rwxr-xr-x 1 root root 299 Mar 19 02:27 uvicorn
-rwxr-xr-x 1 root root 312 Mar 19 02:27 vllm
-rwxr-xr-x 1 root root 299 Mar 19 02:27 watchfiles
-rwxr-xr-x 1 root root 301 Mar 19 02:27 websockets
-rwxr-xr-x 1 root root 296 Mar 19 02:29 wheel
Very weird to see python is a soft link to nowhere.
How you are installing vllm
docker pull vllm/vllm-openai:v0.8.0Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.