File tree Expand file tree Collapse file tree 5 files changed +1
-5
lines changed
Expand file tree Collapse file tree 5 files changed +1
-5
lines changed Original file line number Diff line number Diff line change @@ -89,7 +89,6 @@ export DOCKER_URI=vllm/vllm-tpu:latest
8989sudo docker run -it --rm --name $USER -vllm --privileged --net=host \
9090 -v /dev/shm:/dev/shm \
9191 --shm-size 150gb \
92- -p 8000:8000 \
9392 --entrypoint /bin/bash ${DOCKER_URI}
9493```
9594
Original file line number Diff line number Diff line change @@ -93,7 +93,6 @@ To use the latest nightly built image that has more recent features/improvements
9393sudo docker run -it --rm --name $USER -vllm --privileged --net=host \
9494 -v /dev/shm:/dev/shm \
9595 --shm-size 150gb \
96- -p 8000:8000 \
9796 --entrypoint /bin/bash ${DOCKER_URI}
9897```
9998
Original file line number Diff line number Diff line change @@ -42,7 +42,7 @@ export DOCKER_URI=vllm/vllm-tpu:latest
4242## Step 4: Run the docker container in the TPU instance
4343
4444``` bash
45- sudo docker run -t --rm --name $USER -vllm --privileged --net=host -v /dev/shm:/dev/shm --shm-size 10gb -p 8000:8000 - -entrypoint /bin/bash -it ${DOCKER_URI}
45+ sudo docker run -t --rm --name $USER -vllm --privileged --net=host -v /dev/shm:/dev/shm --shm-size 10gb --entrypoint /bin/bash -it ${DOCKER_URI}
4646```
4747
4848## Step 5: Set up env variables
Original file line number Diff line number Diff line change @@ -87,7 +87,6 @@ export DOCKER_URI=vllm/vllm-tpu:latest
8787sudo docker run -it --rm --name $USER -vllm --privileged --net=host \
8888 -v /dev/shm:/dev/shm \
8989 --shm-size 17gb \
90- -p 8000:8000 \
9190 --entrypoint /bin/bash ${DOCKER_URI}
9291```
9392
Original file line number Diff line number Diff line change @@ -78,7 +78,6 @@ export DOCKER_URI=vllm/vllm-tpu:latest
7878sudo docker run -it --rm --name $USER -vllm --privileged --net=host \
7979 -v /dev/shm:/dev/shm \
8080 --shm-size 100gb \
81- -p 8000:8000 \
8281 --entrypoint /bin/bash ${DOCKER_URI}
8382```
8483
You can’t perform that action at this time.
0 commit comments