We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 407e967 commit 6d4d367Copy full SHA for 6d4d367
README.md
@@ -8,6 +8,18 @@ optillm is an OpenAI API compatible optimizing inference proxy which implements
8
9
## Installation
10
11
+### Using pip
12
+
13
+```bash
14
+pip install optillm
15
+optillm
16
+2024-10-22 07:45:05,612 - INFO - Loaded plugin: privacy
17
+2024-10-22 07:45:06,293 - INFO - Loaded plugin: memory
18
+2024-10-22 07:45:06,293 - INFO - Starting server with approach: auto
19
+```
20
21
+### Install from source
22
23
Clone the repository with `git` and use `pip install` to setup the dependencies.
24
25
```bash
0 commit comments