Skip to content

Commit 4fbcb0f

Browse files
youkaichaoywang96
andauthored
[Doc][Build] update after removing vllm-nccl (#5103)
Co-authored-by: Roger Wang <[email protected]>
1 parent 7c3604f commit 4fbcb0f

File tree

2 files changed

+1
-7
lines changed

2 files changed

+1
-7
lines changed

Dockerfile

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -79,12 +79,6 @@ RUN --mount=type=cache,target=/root/.cache/ccache \
7979
COPY .buildkite/check-wheel-size.py check-wheel-size.py
8080
RUN python3 check-wheel-size.py dist
8181

82-
# the `vllm_nccl` package must be installed from source distribution
83-
# pip is too smart to store a wheel in the cache, and other CI jobs
84-
# will directly use the wheel from the cache, which is not what we want.
85-
# we need to remove it manually
86-
RUN --mount=type=cache,target=/root/.cache/pip \
87-
pip cache remove vllm_nccl*
8882
#################### EXTENSION Build IMAGE ####################
8983

9084
#################### vLLM installation IMAGE ####################

docs/source/serving/deploying_with_docker.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,4 +51,4 @@ To run vLLM:
5151
5252
.. note::
5353

54-
vLLM docker image is currently designed to be run under the root user (contribution welcomed for changing this!). It will try to load library at runtime under the root user's home directory, e.g. `/root/.config/vllm/nccl/cu12/libnccl.so.2.18.1` . If you are running the container under a different user, you may need to change the permissions of the library (and all the parent directories) to allow the user to access it. Then run vLLM with environment variable `VLLM_NCCL_SO_PATH=/root/.config/vllm/nccl/cu12/libnccl.so.2.18.1` .
54+
**For `v0.4.1` and `v0.4.2` only** - the vLLM docker images under these versions are supposed to be run under the root user since a library under the root user's home directory, i.e. ``/root/.config/vllm/nccl/cu12/libnccl.so.2.18.1`` is required to be loaded during runtime. If you are running the container under a different user, you may need to first change the permissions of the library (and all the parent directories) to allow the user to access it, then run vLLM with environment variable ``VLLM_NCCL_SO_PATH=/root/.config/vllm/nccl/cu12/libnccl.so.2.18.1`` .

0 commit comments

Comments
 (0)