From 1db83e31a2468cae37f326a642c0a4c4edbb5e4f Mon Sep 17 00:00:00 2001 From: Shivam Thakkar Date: Sat, 23 Dec 2023 12:50:02 +0530 Subject: [PATCH] [Docs] Update installation instructions to include CUDA 11.8 xFormers (#2246) --- docs/source/getting_started/installation.rst | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/docs/source/getting_started/installation.rst b/docs/source/getting_started/installation.rst index e7a2d0a6f0d03..911c3d8f9a4ab 100644 --- a/docs/source/getting_started/installation.rst +++ b/docs/source/getting_started/installation.rst @@ -42,6 +42,10 @@ You can install vLLM using pip: $ pip uninstall torch -y $ pip install torch --upgrade --index-url https://download.pytorch.org/whl/cu118 + $ # Re-install xFormers with CUDA 11.8. + $ pip uninstall xformers -y + $ pip install --upgrade xformers --index-url https://download.pytorch.org/whl/cu118 + .. _build_from_source: