Skip to content

Commit b473e95

Browse files
authored
Add Nix and Flox install instructions (ggml-org#7899)
1 parent 99052cd commit b473e95

File tree

1 file changed

+24
-0
lines changed

1 file changed

+24
-0
lines changed

README.md

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -387,6 +387,30 @@ brew install llama.cpp
387387
```
388388
The formula is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggerganov/llama.cpp/discussions/7668
389389
390+
### Nix
391+
392+
On Mac and Linux, the Nix package manager can be used via
393+
```
394+
nix profile install nixpkgs#llama-cpp
395+
```
396+
For flake enabled installs.
397+
398+
Or
399+
```
400+
nix-env --file '<nixpkgs>' --install --attr llama-cpp
401+
```
402+
For non-flake enabled installs.
403+
404+
This expression is automatically updated within the [nixpkgs repo](https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/by-name/ll/llama-cpp/package.nix#L164).
405+
406+
#### Flox
407+
408+
On Mac and Linux, Flox can be used to install llama.cpp within a Flox environment via
409+
```
410+
flox install llama-cpp
411+
```
412+
Flox follows the nixpkgs build of llama.cpp.
413+
390414
### Metal Build
391415
392416
On MacOS, Metal is enabled by default. Using Metal makes the computation run on the GPU.

0 commit comments

Comments
 (0)