Skip to content

Commit 7742911

Browse files
mostlygeekNeoZhangJianyu
authored andcommitted
readme : add llama-swap to infrastructure section (ggml-org#11032)
* list llama-swap under tools in README * readme: add llama-swap to Infrastructure
1 parent 2eee766 commit 7742911

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -235,6 +235,7 @@ Instructions for adding support for new models: [HOWTO-add-model.md](docs/develo
235235
- [Paddler](https://github.com/distantmagic/paddler) - Stateful load balancer custom-tailored for llama.cpp
236236
- [GPUStack](https://github.com/gpustack/gpustack) - Manage GPU clusters for running LLMs
237237
- [llama_cpp_canister](https://github.com/onicai/llama_cpp_canister) - llama.cpp as a smart contract on the Internet Computer, using WebAssembly
238+
- [llama-swap](https://github.com/mostlygeek/llama-swap) - transparent proxy that adds automatic model switching with llama-server
238239

239240
</details>
240241

0 commit comments

Comments
 (0)