Unable to find Punica extension issue during source code installation (#4494)

Co-authored-by: Simon Mo <simon.mo@hey.com>
This commit is contained in:
fuchen.ljl
2024-05-01 08:42:09 +08:00
committed by GitHub
parent 6ad58f42c5
commit ee37328da0

View File

@ -53,6 +53,7 @@ You can also build and install vLLM from source:
$ git clone https://github.com/vllm-project/vllm.git
$ cd vllm
$ # export VLLM_INSTALL_PUNICA_KERNELS=1 # optionally build for multi-LoRA capability
$ pip install -e . # This may take 5-10 minutes.
.. tip::