Skip to content

Commit c21c89e

Browse files
authored
Update README.md
1 parent 42f307e commit c21c89e

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

README.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,3 +12,8 @@ If you care, **please contribute to [this discussion](https://github.com/ggergan
1212
- Leave main.cpp UNTOUCHED, We want to be able to update the repo and pull any changes automatically.
1313
- No dynamic memory allocation! Setup structs with FIXED (known) shapes and sizes for ALL output fields. Python will ALWAYS provide the memory, we just write to it.
1414
- No external libraries or dependencies. That means no Flask, Pybind and whatever. All You Need Is Python.
15+
16+
## Usage
17+
- Windows binaries are provided in the form of **llamalib.dll** but if you feel worried go ahead and rebuild it yourself.
18+
- Weights are not included, you can use the llama.cpp quantize.exe to generate them from your official weight files (or download them from...places).
19+
- To run, simply clone the repo and run `llama_for_kobold.py [ggml_quant_model.bin] [port]`, and then connect with Kobold or Kobold Lite.

0 commit comments

Comments
 (0)