Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

Commit 66dd025

Browse files
authored
Update distributed.md
1 parent 1ff7351 commit 66dd025

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/distributed.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -65,7 +65,9 @@ python3 torchchat.py server llama3.1 --distributed --tp 2 --pp 2
6565
```
6666
[skip default]: end
6767

68+
<!--
6869
[shell default]: python3 torchchat.py server llama3.1 --distributed --tp 2 --pp 2 & server_pid=$! ; sleep 180 # wait for server to be ready to accept requests
70+
-->
6971

7072
In another terminal, query the server using `curl`. Depending on the model configuration, this query might take a few minutes to respond.
7173

0 commit comments

Comments
 (0)