Skip to content

Commit dee3994

Browse files
authored
Merge pull request #2 from utilityai/update-readme-2
moved readme and added new ones
2 parents b491775 + 5015f18 commit dee3994

File tree

3 files changed

+29
-18
lines changed

3 files changed

+29
-18
lines changed

README.md

Lines changed: 5 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,21 +1,8 @@
1-
# llama-cpp-rs-2
1+
# llama-cpp-rs
22

3-
A wrapper around the [llama-cpp](https://github.com/ggerganov/llama.cpp/) library for rust.
3+
This contains two packages used internally at [Utility AI](https://utilityai.ca/):
44

5-
# Goals
5+
- llama-cpp-2
6+
- llama-cpp-sys-2
67

7-
- Safe
8-
- Up to date (llama-cpp-rs is out of date)
9-
- Abort free (llama.cpp will abort if you violate its invariants. This library will attempt to prevent that by ether
10-
ensuring the invariants are upheld statically or by checking them ourselves and returning an error)
11-
- Performant (no meaningful overhead over using llama-cpp-sys-2)
12-
- Well documented
13-
14-
# Non-goals
15-
16-
- Idiomatic rust (I will prioritize a more direct translation of the C++ API over a more idiomatic rust API due to
17-
maintenance burden)
18-
19-
# Contributing
20-
21-
Contributions are welcome. Please open an issue before starting work on a PR.
8+
See their respective READMEs for more information.

llama-cpp-2/README.md

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
# llama-cpp-rs-2
2+
3+
A wrapper around the [llama-cpp](https://github.com/ggerganov/llama.cpp/) library for rust.
4+
5+
# Goals
6+
7+
- Safe
8+
- Up to date (llama-cpp-rs is out of date)
9+
- Abort free (llama.cpp will abort if you violate its invariants. This library will attempt to prevent that by ether
10+
ensuring the invariants are upheld statically or by checking them ourselves and returning an error)
11+
- Performant (no meaningful overhead over using llama-cpp-sys-2)
12+
- Well documented
13+
14+
# Non-goals
15+
16+
- Idiomatic rust (I will prioritize a more direct translation of the C++ API over a more idiomatic rust API due to
17+
maintenance burden)
18+
19+
# Contributing
20+
21+
Contributions are welcome. Please open an issue before starting work on a PR.

llama-cpp-sys-2/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
# llama-cpp-sys
2+
3+
Raw bindings to llama.cpp with cublas support.

0 commit comments

Comments
 (0)