Skip to content

Commit 6565d9e

Browse files
authored
Update installation instruction for vLLM + CUDA 11.8 (#2086)
1 parent f375ec8 commit 6565d9e

File tree

1 file changed

+4
-3
lines changed

1 file changed

+4
-3
lines changed

docs/source/getting_started/installation.rst

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ You can install vLLM using pip:
2020
.. code-block:: console
2121
2222
$ # (Optional) Create a new conda environment.
23-
$ conda create -n myenv python=3.8 -y
23+
$ conda create -n myenv python=3.9 -y
2424
$ conda activate myenv
2525
2626
$ # Install vLLM with CUDA 12.1.
@@ -34,8 +34,9 @@ You can install vLLM using pip:
3434
.. code-block:: console
3535
3636
$ # Install vLLM with CUDA 11.8.
37-
$ # Replace `cp310` with your Python version (e.g., `cp38`, `cp39`, `cp311`).
38-
$ pip install https://github.com/vllm-project/vllm/releases/download/v0.2.2/vllm-0.2.2+cu118-cp310-cp310-manylinux1_x86_64.whl
37+
$ export VLLM_VERSION=0.2.4
38+
$ export PYTHON_VERSION=39
39+
$ pip install https://github.com/vllm-project/vllm/releases/download/v${VLLM_VERSION}/vllm-${VLLM_VERSION}+cu118-cp${PYTHON_VERSION}-cp${PYTHON_VERSION}-manylinux1_x86_64.whl
3940
4041
$ # Re-install PyTorch with CUDA 11.8.
4142
$ pip uninstall torch -y

0 commit comments

Comments
 (0)