Skip to content

Commit 4fd6152

Browse files
committed
[chore] align example router running script with main
new script will be mentioned in `tutorials/17-whisper-api-transcription.md` Signed-off-by: David Gao <[email protected]>
1 parent 95d12b0 commit 4fd6152

File tree

1 file changed

+13
-29
lines changed

1 file changed

+13
-29
lines changed

src/vllm_router/run-router.sh

Lines changed: 13 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/bin/bash
2-
if [[ $# -ne 2 ]]; then
3-
echo "Usage $0 <router port> <backend url>"
2+
if [[ $# -ne 1 ]]; then
3+
echo "Usage $0 <router port>"
44
exit 1
55
fi
66

@@ -15,17 +15,17 @@ fi
1515
# --log-stats
1616

1717
# Use this command when testing with static service discovery
18-
# python3 -m vllm_router.app --port "$1" \
19-
# --service-discovery static \
20-
# --static-backends "http://localhost:8000" \
21-
# --static-models "facebook/opt-125m" \
22-
# --static-model-types "chat" \
23-
# --log-stats \
24-
# --log-stats-interval 10 \
25-
# --engine-stats-interval 10 \
26-
# --request-stats-window 10 \
27-
# --request-stats-window 10 \
28-
# --routing-logic roundrobin
18+
python3 -m vllm_router.app --port "$1" \
19+
--service-discovery static \
20+
--static-backends "http://localhost:8000" \
21+
--static-models "facebook/opt-125m" \
22+
--static-model-types "chat" \
23+
--log-stats \
24+
--log-stats-interval 10 \
25+
--engine-stats-interval 10 \
26+
--request-stats-window 10 \
27+
--request-stats-window 10 \
28+
--routing-logic roundrobin
2929

3030
# Use this command when testing with roundrobin routing logic
3131
#python3 router.py --port "$1" \
@@ -35,19 +35,3 @@ fi
3535
# --engine-stats-interval 10 \
3636
# --log-stats
3737
#
38-
39-
# Use this command when testing with whisper transcription
40-
ROUTER_PORT=$1
41-
BACKEND_URL=$2
42-
43-
python3 -m vllm_router.app \
44-
--host 0.0.0.0 \
45-
--port "${ROUTER_PORT}" \
46-
--service-discovery static \
47-
--static-backends "${BACKEND_URL}" \
48-
--static-models "openai/whisper-small" \
49-
--static-model-types "transcription" \
50-
--routing-logic roundrobin \
51-
--log-stats \
52-
--engine-stats-interval 10 \
53-
--request-stats-window 10

0 commit comments

Comments
 (0)