Skip to content

Commit 2cc72e5

Browse files
committed
Rewrite llama-run to use llama-server
llama-run works fine, but falls well behind llama-server functionality. Integrate llama-server with llama-run. Signed-off-by: Eric Curtin <[email protected]>
1 parent a812838 commit 2cc72e5

File tree

2 files changed

+340
-1212
lines changed

2 files changed

+340
-1212
lines changed

tools/run/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
The purpose of this example is to demonstrate a minimal usage of llama.cpp for running models.
44

55
```bash
6-
llama-run granite3-moe
6+
llama-run -hf llama.cpp/example/run
77
```
88

99
```bash

0 commit comments

Comments
 (0)