Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,12 @@ ENV MODELS_PATH=/models
# Label the image so that it's hidden on cloud engines.
LABEL com.docker.desktop.service="model-runner"

EXPOSE ${MODEL_RUNNER_PORT}

# Override the healthcheck inherited from the upstream llama.cpp image.
HEALTHCHECK --interval=30s --timeout=10s --start-period=10s --retries=3 \
CMD curl -f "http://localhost:${MODEL_RUNNER_PORT}/engines/status" || exit 1
Comment thread
ilopezluna marked this conversation as resolved.

ENTRYPOINT ["/app/model-runner"]

# --- vLLM variant ---
Expand Down
Loading