Skip to content

Commit

Permalink
[Docs][TPU] Add installation tip for TPU (vllm-project#5761)
Browse files Browse the repository at this point in the history
  • Loading branch information
WoosukKwon authored Jun 22, 2024
1 parent e2ed4dd commit 780d291
Showing 1 changed file with 18 additions and 0 deletions.
18 changes: 18 additions & 0 deletions docs/source/getting_started/tpu-installation.rst
Original file line number Diff line number Diff line change
Expand Up @@ -73,3 +73,21 @@ Next, build vLLM from source. This will only take a few seconds:
.. code-block:: console
$ VLLM_TARGET_DEVICE="tpu" python setup.py develop
.. tip::

If you encounter the following error:

.. code-block:: console
from torch._C import * # noqa: F403
ImportError: libopenblas.so.0: cannot open shared object file: No such file or directory
You can install OpenBLAS with the following command:

.. code-block:: console
$ sudo apt-get install libopenblas-base libopenmpi-dev libomp-dev

0 comments on commit 780d291

Please sign in to comment.