Skip to content

Commit 14ee03e

Browse files
authored
Merge branch 'ggml-org:master' into master
2 parents 58b8aee + 1d49ca3 commit 14ee03e

File tree

2 files changed

+1
-4
lines changed

2 files changed

+1
-4
lines changed

.devops/nix/package.nix

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -128,10 +128,6 @@ effectiveStdenv.mkDerivation (finalAttrs: {
128128
};
129129

130130
postPatch = ''
131-
substituteInPlace ./ggml/src/ggml-metal/ggml-metal.m \
132-
--replace '[bundle pathForResource:@"ggml-metal" ofType:@"metal"];' "@\"$out/bin/ggml-metal.metal\";"
133-
substituteInPlace ./ggml/src/ggml-metal/ggml-metal.m \
134-
--replace '[bundle pathForResource:@"default" ofType:@"metallib"];' "@\"$out/bin/default.metallib\";"
135131
'';
136132

137133
# With PR#6015 https://github.com/ggml-org/llama.cpp/pull/6015,

tools/server/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1045,6 +1045,7 @@ Available metrics:
10451045
- `llamacpp:kv_cache_tokens`: KV-cache tokens.
10461046
- `llamacpp:requests_processing`: Number of requests processing.
10471047
- `llamacpp:requests_deferred`: Number of requests deferred.
1048+
- `llamacpp:n_past_max`: High watermark of the context size observed.
10481049

10491050
### POST `/slots/{id_slot}?action=save`: Save the prompt cache of the specified slot to a file.
10501051

0 commit comments

Comments
 (0)