Skip to content

Commit f9a9cd3

Browse files
authored
Merge pull request #33 from doringeman/misc
Remove unused env vars from Makefile and update README
2 parents 342b160 + f826ff1 commit f9a9cd3

File tree

2 files changed

+6
-10
lines changed

2 files changed

+6
-10
lines changed

Makefile

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,9 @@
11
# Project variables
22
APP_NAME := model-runner
33
GO_VERSION := 1.23.7
4-
LLAMA_SERVER_VERSION := v0.0.4
4+
LLAMA_SERVER_VERSION := latest
55
LLAMA_SERVER_VARIANT := cpu
66
BASE_IMAGE := ubuntu:24.04
7-
TARGET_OS := linux
8-
ACCEL := cpu
97
DOCKER_IMAGE := docker/model-runner:latest
108
PORT := 8080
119
MODELS_PATH := $(shell pwd)/models

README.md

Lines changed: 5 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -54,19 +54,17 @@ The Docker image includes the llama.cpp server binary from the `docker/docker-mo
5454

5555
```sh
5656
# Build with a specific llama.cpp server version
57-
LLAMA_SERVER_VERSION=v0.0.4-rc2-cpu make docker-build
57+
make docker-build LLAMA_SERVER_VERSION=v0.0.4
5858

5959
# Specify all parameters
60-
LLAMA_SERVER_VERSION=v0.0.4-rc2-cpu TARGET_OS=linux TARGET_ARCH=amd64 ACCEL=cpu make docker-build
60+
make docker-build LLAMA_SERVER_VERSION=v0.0.4 LLAMA_SERVER_VARIANT=cpu
6161
```
6262

6363
Default values:
64-
- `LLAMA_SERVER_VERSION`: v0.0.4-rc2-cpu
65-
- `TARGETOS`: linux
66-
- `TARGETARCH`: amd64
67-
- `ACCEL`: cpu
64+
- `LLAMA_SERVER_VERSION`: latest
65+
- `LLAMA_SERVER_VARIANT`: cpu
6866

69-
The binary path in the image follows this pattern: `/com.docker.llama-server.native.${TARGETOS}.${ACCEL}.${TARGETARCH}`
67+
The binary path in the image follows this pattern: `/com.docker.llama-server.native.linux.${LLAMA_SERVER_VARIANT}.${TARGETARCH}`
7068

7169
## API Examples
7270

0 commit comments

Comments
 (0)