Skip to content

Commit ff2186f

Browse files
specify gpu count in vllm sample
1 parent ca3fa83 commit ff2186f

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

samples/vllm/compose.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@ services:
1313
memory: 8192M
1414
devices:
1515
- capabilities: ["gpu"]
16+
count: 1
1617
healthcheck:
1718
test: ["CMD", "python3", "-c", "import sys, urllib.request;urllib.request.urlopen(sys.argv[1]).read()", "http://localhost:8000/health"]
1819
interval: 1m

0 commit comments

Comments
 (0)