Skip to content

Commit 7fbfaa9

Browse files
committed
Avoid publishing port when using host network mode
1 parent 95190af commit 7fbfaa9

File tree

5 files changed

+1
-5
lines changed

5 files changed

+1
-5
lines changed

inference/trillium/vLLM/Llama3.1/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,6 @@ export DOCKER_URI=vllm/vllm-tpu:latest
8989
sudo docker run -it --rm --name $USER-vllm --privileged --net=host \
9090
-v /dev/shm:/dev/shm \
9191
--shm-size 150gb \
92-
-p 8000:8000 \
9392
--entrypoint /bin/bash ${DOCKER_URI}
9493
```
9594

inference/trillium/vLLM/Llama3.3/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -93,7 +93,6 @@ To use the latest nightly built image that has more recent features/improvements
9393
sudo docker run -it --rm --name $USER-vllm --privileged --net=host \
9494
-v /dev/shm:/dev/shm \
9595
--shm-size 150gb \
96-
-p 8000:8000 \
9796
--entrypoint /bin/bash ${DOCKER_URI}
9897
```
9998

inference/trillium/vLLM/Qwen2.5-32B/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ export DOCKER_URI=vllm/vllm-tpu:latest
4242
## Step 4: Run the docker container in the TPU instance
4343

4444
```bash
45-
sudo docker run -t --rm --name $USER-vllm --privileged --net=host -v /dev/shm:/dev/shm --shm-size 10gb -p 8000:8000 --entrypoint /bin/bash -it ${DOCKER_URI}
45+
sudo docker run -t --rm --name $USER-vllm --privileged --net=host -v /dev/shm:/dev/shm --shm-size 10gb --entrypoint /bin/bash -it ${DOCKER_URI}
4646
```
4747

4848
## Step 5: Set up env variables

inference/trillium/vLLM/Qwen2.5-VL/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,6 @@ export DOCKER_URI=vllm/vllm-tpu:latest
8787
sudo docker run -it --rm --name $USER-vllm --privileged --net=host \
8888
-v /dev/shm:/dev/shm \
8989
--shm-size 17gb \
90-
-p 8000:8000 \
9190
--entrypoint /bin/bash ${DOCKER_URI}
9291
```
9392

inference/trillium/vLLM/Qwen3/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,6 @@ export DOCKER_URI=vllm/vllm-tpu:latest
7878
sudo docker run -it --rm --name $USER-vllm --privileged --net=host \
7979
-v /dev/shm:/dev/shm \
8080
--shm-size 100gb \
81-
-p 8000:8000 \
8281
--entrypoint /bin/bash ${DOCKER_URI}
8382
```
8483

0 commit comments

Comments
 (0)