[Installation]: Dockerfile.cpu installation problem vLLM

[ifoyil]

Your current environment

The output of `python collect_env.py`

Dockerfile.cpu installation I can't complete the build somehow, I want to use vLLM over CPU since I don't have a graphics card on my own server, but the installation gives an error as follows.
OS= rockylinux 9.4
ram 16gb
vCPU=> 24
Hypervisor= proxmox 8.2.7
docker version => Docker version 28.0.1, build 068a01e

errors messages;

docker build -f Dockerfile.cpu -t vllm-cpu-env --shm-size=4g .

Dockerfile.cpu:54

53 |
54 | >>> RUN --mount=type=cache,target=/root/.cache/pip
55 | >>> --mount=type=cache,target=/root/.cache/ccache
56 | >>> --mount=type=bind,source=.git,target=.git
57 | >>> VLLM_TARGET_DEVICE=cpu python3 setup.py bdist_wheel &&
58 | >>> pip install dist/*.whl &&
59 | >>> rm -rf dist
60 |

ERROR: failed to solve: process "/bin/sh -c VLLM_TARGET_DEVICE=cpu python3 setup.py bdist_wheel && pip install dist/*.whl && rm -rf dist" did not complete successfully: exit code: 1

How you are installing vllm

docker build -f Dockerfile.cpu -t vllm-cpu-env --shm-size=4g .

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[bigPYJ1151]

Please add --progress=plain when building the image and check the detail error message.

[ifoyil]

Thanks bigPYJ1151 for this response;

I run to command as below, the same error message it has been gave to me

docker build -f Dockerfile.cpu -t vllm-cpu-env --progress=plain --shm-size=4g .

#16 9.615 File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
#16 9.615 raise CalledProcessError(retcode, cmd)
#16 9.615 subprocess.CalledProcessError: Command '['cmake', '/workspace/vllm', '-G', 'Ninja', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DVLLM_TARGET_DEVICE=cpu', '-DCMAKE_C_COMPILER_LAUNCHER=ccache', '-DCMAKE_CXX_COMPILER_LAUNCHER=ccache', '-DCMAKE_CUDA_COMPILER_LAUNCHER=ccache', '-DCMAKE_HIP_COMPILER_LAUNCHER=ccache', '-DVLLM_PYTHON_EXECUTABLE=/usr/bin/python3', '-DVLLM_PYTHON_PATH=/workspace/vllm:/usr/lib/python310.zip:/usr/lib/python3.10:/usr/lib/python3.10/lib-dynload:/usr/local/lib/python3.10/dist-packages:/usr/lib/python3/dist-packages:/usr/local/lib/python3.10/dist-packages/setuptools/_vendor', '-DFETCHCONTENT_BASE_DIR=/workspace/vllm/.deps', '-DCMAKE_JOB_POOL_COMPILE:STRING=compile', '-DCMAKE_JOB_POOLS:STRING=compile=24']' returned non-zero exit status 1.
#16 ERROR: process "/bin/sh -c VLLM_TARGET_DEVICE=cpu python3 setup.py bdist_wheel && pip install dist/*.whl && rm -rf dist" did not complete successfully: exit code: 1

[build 5/8] RUN --mount=type=cache,target=/root/.cache/pip --mount=type=cache,target=/root/.cache/ccache --mount=type=bind,source=.git,target=.git VLLM_TARGET_DEVICE=cpu python3 setup.py bdist_wheel && pip install dist/*.whl && rm -rf dist:
9.615 _build_ext.run(self)
9.615 File "/usr/local/lib/python3.10/dist-packages/setuptools/_distutils/command/build_ext.py", line 365, in run
9.615 self.build_extensions()
9.615 File "/workspace/vllm/setup.py", line 214, in build_extensions
9.615 self.configure(ext)
9.615 File "/workspace/vllm/setup.py", line 192, in configure
9.615 subprocess.check_call(
9.615 File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
9.615 raise CalledProcessError(retcode, cmd)
9.615 subprocess.CalledProcessError: Command '['cmake', '/workspace/vllm', '-G', 'Ninja', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DVLLM_TARGET_DEVICE=cpu', '-DCMAKE_C_COMPILER_LAUNCHER=ccache', '-DCMAKE_CXX_COMPILER_LAUNCHER=ccache', '-DCMAKE_CUDA_COMPILER_LAUNCHER=ccache', '-DCMAKE_HIP_COMPILER_LAUNCHER=ccache', '-DVLLM_PYTHON_EXECUTABLE=/usr/bin/python3', '-DVLLM_PYTHON_PATH=/workspace/vllm:/usr/lib/python310.zip:/usr/lib/python3.10:/usr/lib/python3.10/lib-dynload:/usr/local/lib/python3.10/dist-packages:/usr/lib/python3/dist-packages:/usr/local/lib/python3.10/dist-packages/setuptools/_vendor', '-DFETCHCONTENT_BASE_DIR=/workspace/vllm/.deps', '-DCMAKE_JOB_POOL_COMPILE:STRING=compile', '-DCMAKE_JOB_POOLS:STRING=compile=24']' returned non-zero exit status 1.

---

Dockerfile.cpu:54

53 |
54 | >>> RUN --mount=type=cache,target=/root/.cache/pip
55 | >>> --mount=type=cache,target=/root/.cache/ccache
56 | >>> --mount=type=bind,source=.git,target=.git
57 | >>> VLLM_TARGET_DEVICE=cpu python3 setup.py bdist_wheel &&
58 | >>> pip install dist/*.whl &&
59 | >>> rm -rf dist
60 |

ERROR: failed to solve: process "/bin/sh -c VLLM_TARGET_DEVICE=cpu python3 setup.py bdist_wheel && pip install dist/*.whl && rm -rf dist" did not complete successfully: exit code: 1

[github-actions]

This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!

[github-actions]

This issue has been automatically closed due to inactivity. Please feel free to reopen if you feel it is still relevant. Thank you!