Skip to content

Commit 96d3f72

Browse files
authored
Updated readme (#281)
Signed-off-by: irar2 <[email protected]>
1 parent 83828d0 commit 96d3f72

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -244,7 +244,8 @@ For more details see the <a href="https://docs.vllm.ai/en/stable/getting_started
244244
**Example:**<br>
245245
--fake-metrics '{"running-requests":10,"waiting-requests":30,"kv-cache-usage":0.4,"loras":[{"running":"lora4,lora2","waiting":"lora3","timestamp":1257894567},{"running":"lora4,lora3","waiting":"","timestamp":1257894569}]}'
246246
---
247-
- `data-parallel-size`: number of ranks to run in Data Parallel deployment, from 1 to 8, default is 1. The ports will be assigned as follows: rank 0 will run on the configured `port`, rank 1 on `port`+1, etc.
247+
- `data-parallel-size`: number of ranks to run in Data Parallel deployment, from 1 to 8, default is 1. The ports will be assigned as follows: rank 0 will run on the configured `port`, rank 1 on `port`+1, etc.
248+
- `data-parallel-rank`: the rank of this instance, used only when running Data Parallel ranks as separate processes
248249
---
249250
- `dataset-path`: Optional local file path to the SQLite database file used for generating responses from a dataset.
250251
- If not set, hardcoded preset responses will be used.

0 commit comments

Comments
 (0)