We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
--ipc=host
1 parent f98b745 commit 7d7e3b7Copy full SHA for 7d7e3b7
docs/source/getting_started/installation.rst
@@ -46,4 +46,5 @@ You can also build and install vLLM from source:
46
.. code-block:: console
47
48
$ # Pull the Docker image with CUDA 11.8.
49
- $ docker run --gpus all -it --rm --shm-size=8g nvcr.io/nvidia/pytorch:22.12-py3
+ $ # Use `--ipc=host` to make sure the shared memory is large enough.
50
+ $ docker run --gpus all -it --rm --ipc=host nvcr.io/nvidia/pytorch:22.12-py3
0 commit comments