[Docs][TPU] Add installation tip for TPU (#5761)

This commit is contained in:
Woosuk Kwon
2024-06-21 23:09:40 -07:00
committed by GitHub
parent 0cbc1d2b4f
commit 8c00f9c15d

View File

@ -73,3 +73,21 @@ Next, build vLLM from source. This will only take a few seconds:
.. code-block:: console
$ VLLM_TARGET_DEVICE="tpu" python setup.py develop
.. tip::
If you encounter the following error:
.. code-block:: console
from torch._C import * # noqa: F403
ImportError: libopenblas.so.0: cannot open shared object file: No such file or directory
You can install OpenBLAS with the following command:
.. code-block:: console
$ sudo apt-get install libopenblas-base libopenmpi-dev libomp-dev