Skip to content

Commit ab8efef

Browse files
committed
fix vllm healthcheck
1 parent 0d71d2a commit ab8efef

File tree

1 file changed

+2
-4
lines changed

1 file changed

+2
-4
lines changed

samples/vllm/compose.yaml

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -14,10 +14,8 @@ services:
1414
devices:
1515
- capabilities: ["gpu"]
1616
healthcheck:
17-
test: ["CMD", "curl", "http://localhost:8000/v1/models"]
18-
interval: 5m
19-
timeout: 30s
20-
retries: 10
17+
test: ["CMD", "python3", "-c", "import sys, urllib.request;urllib.request.urlopen(sys.argv[1]).read()", "http://localhost:8000/health"]
18+
interval: 1m
2119
environment:
2220
- HF_TOKEN
2321
ui:

0 commit comments

Comments
 (0)