mirror of https://github.com/vllm-project/vllm-ascend.git synced 2025-10-20 13:43:53 +08:00

Files

Yikun Jiang eb189aac81 Followup fix on official doc update (#34 )

### What this PR does / why we need it?
- Fix typos: vllm-ascned --> vllm-ascend
- For version info

### Does this PR introduce _any_ user-facing change?
No


### How was this patch tested?
preview

Signed-off-by: Yikun Jiang <yikunkero@gmail.com>

2025-02-11 14:28:26 +08:00

2.1 KiB

Raw Blame History

Installation

1. Dependencies

Requirement	Supported version	Recommended version	Note
Python	>= 3.9	3.10	Required for vllm
CANN	>= 8.0.RC2	8.0.RC3	Required for vllm-ascend and torch-npu
torch-npu	>= 2.4.0	2.5.1rc1	Required for vllm-ascend
torch	>= 2.4.0	2.5.1	Required for torch-npu and vllm required

2. Prepare Ascend NPU environment

Below is a quick note to install recommended version software:

Containerized installation

You can use the container image directly with one line command:

docker run \
    --name vllm-ascend-env \
    --device /dev/davinci1 \
    --device /dev/davinci_manager \
    --device /dev/devmm_svm \
    --device /dev/hisi_hdc \
    -v /usr/local/dcmi:/usr/local/dcmi \
    -v /usr/local/bin/npu-smi:/usr/local/bin/npu-smi \
    -v /usr/local/Ascend/driver/lib64/:/usr/local/Ascend/driver/lib64/ \
    -v /usr/local/Ascend/driver/version.info:/usr/local/Ascend/driver/version.info \
    -v /etc/ascend_install.info:/etc/ascend_install.info \
    -it quay.io/ascend/cann:8.0.rc3.beta1-910b-ubuntu22.04-py3.10 bash

You do not need to install torch and torch_npu manually, they will be automatically installed as vllm-ascend dependencies.

Manual installation

Or follow the instructions provided in the Ascend Installation Guide to set up the environment.

3. Building

Build Python package from source

git clone https://github.com/vllm-project/vllm-ascend.git
cd vllm-ascend
pip install -e .

Build container image from source

git clone https://github.com/vllm-project/vllm-ascend.git
cd vllm-ascend
docker build -t vllm-ascend-dev-image -f ./Dockerfile .

2.1 KiB Raw Blame History