Skip to content

Commit 7ca5888

Browse files
committed
Add GPU device configuration instructions for vLLM OpenVINO backend
1 parent e25e321 commit 7ca5888

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/source/getting_started/openvino-installation.rst

+2
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,8 @@ Install from source
5959
6060
$ PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu https://storage.openvinotoolkit.org/simple/wheels/pre-release" VLLM_TARGET_DEVICE=openvino python -m pip install -v .
6161
62+
- [Optional] To use vLLM OpenVINO backend with a GPU device, ensure your system is properly set up. Follow the instructions provided here: `https://docs.openvino.ai/2024/get-started/configurations/configurations-intel-gpu.html <https://docs.openvino.ai/2024/get-started/configurations/configurations-intel-gpu.html>`_.
63+
6264
.. _openvino_backend_performance_tips:
6365

6466
Performance tips

0 commit comments

Comments
 (0)