File tree Expand file tree Collapse file tree 2 files changed +6
-10
lines changed
Expand file tree Collapse file tree 2 files changed +6
-10
lines changed Original file line number Diff line number Diff line change 11# Project variables
22APP_NAME := model-runner
33GO_VERSION := 1.23.7
4- LLAMA_SERVER_VERSION := v0.0.4
4+ LLAMA_SERVER_VERSION := latest
55LLAMA_SERVER_VARIANT := cpu
66BASE_IMAGE := ubuntu:24.04
7- TARGET_OS := linux
8- ACCEL := cpu
97DOCKER_IMAGE := docker/model-runner:latest
108PORT := 8080
119MODELS_PATH := $(shell pwd) /models
Original file line number Diff line number Diff line change @@ -54,19 +54,17 @@ The Docker image includes the llama.cpp server binary from the `docker/docker-mo
5454
5555``` sh
5656# Build with a specific llama.cpp server version
57- LLAMA_SERVER_VERSION=v0.0.4-rc2-cpu make docker-build
57+ make docker-build LLAMA_SERVER_VERSION=v0.0.4
5858
5959# Specify all parameters
60- LLAMA_SERVER_VERSION=v0.0.4-rc2-cpu TARGET_OS=linux TARGET_ARCH=amd64 ACCEL= cpu make docker-build
60+ make docker-build LLAMA_SERVER_VERSION=v0.0.4 LLAMA_SERVER_VARIANT= cpu
6161```
6262
6363Default values:
64- - ` LLAMA_SERVER_VERSION ` : v0.0.4-rc2-cpu
65- - ` TARGETOS ` : linux
66- - ` TARGETARCH ` : amd64
67- - ` ACCEL ` : cpu
64+ - ` LLAMA_SERVER_VERSION ` : latest
65+ - ` LLAMA_SERVER_VARIANT ` : cpu
6866
69- The binary path in the image follows this pattern: ` /com.docker.llama-server.native.${TARGETOS} .${ACCEL }.${TARGETARCH} `
67+ The binary path in the image follows this pattern: ` /com.docker.llama-server.native.linux .${LLAMA_SERVER_VARIANT }.${TARGETARCH} `
7068
7169## API Examples
7270
You can’t perform that action at this time.
0 commit comments