We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent ca3fa83 commit ff2186fCopy full SHA for ff2186f
samples/vllm/compose.yaml
@@ -13,6 +13,7 @@ services:
13
memory: 8192M
14
devices:
15
- capabilities: ["gpu"]
16
+ count: 1
17
healthcheck:
18
test: ["CMD", "python3", "-c", "import sys, urllib.request;urllib.request.urlopen(sys.argv[1]).read()", "http://localhost:8000/health"]
19
interval: 1m
0 commit comments