@@ -55,6 +55,17 @@ Our mission is to make prompt crafting dynamic, prompt management safe, and prom
55
55
- ** OpenAI Compatible API** : Use with existing OpenAI client libraries
56
56
- ** Provider Integration** : Support for multiple LLM providers with a unified API
57
57
58
+ ## Supported Providers
59
+
60
+ Llmkit supports the following LLM providers:
61
+
62
+ - ** OpenRouter** : Access to 100+ models through a unified API
63
+ - ** OpenAI** : Direct integration with OpenAI's GPT models
64
+ - ** Anthropic** : Claude models (coming soon)
65
+ - ** Azure OpenAI** : Microsoft's Azure-hosted OpenAI models (coming soon)
66
+ - ** Google Gemini** : Google's Gemini models (coming soon)
67
+ - ** DeepSeek** : DeepSeek's models (coming soon)
68
+
58
69
## How It Works
59
70
60
71
### Prompt Architecture
@@ -180,7 +191,9 @@ Every LLM call has a detailed trace that you can view. directly in the llmkit UI
180
191
### Required
181
192
182
193
- ** Rust Toolchain** : Latest stable version of Rust and Cargo
183
- - ** OpenRouter API Key** : You must have an OpenRouter API key to use Llmkit
194
+ - ** API Keys** : You need API keys for the providers you want to use:
195
+ - ** OpenRouter** : Required if using OpenRouter provider
196
+ - ** OpenAI** : Required if using OpenAI or OpenRouter provider (set via ` OPENAI_API_KEY ` )
184
197
- ** SQLite** : For database functionality
185
198
186
199
### Optional Dependencies
@@ -209,11 +222,14 @@ cp .env.example .env
209
222
3 . Edit the ` .env ` file with your API keys and a secure JWT secret:
210
223
``` bash
211
224
# Required
212
- OPENROUTER_API_KEY=your_openrouter_key_here
213
225
JWT_SECRET=your_secure_random_string
214
226
DATABASE_URL=sqlite:/app/data/llmkit.db
215
227
API_BASE_URL=http://backend:8000
216
228
USE_SECURE_COOKIE=false # Set to true for HTTPS deployments
229
+
230
+ # Provider API Keys (add the ones you need)
231
+ OPENROUTER_API_KEY=your_openrouter_key_here
232
+ OPENAI_API_KEY=your_openai_key_here # Required for OpenAI and OpenRouter providers
217
233
```
218
234
219
235
4 . Build and start the containers:
@@ -234,15 +250,20 @@ If you prefer to set things up manually, follow these steps:
234
250
cp .env.example backend/.env
235
251
```
236
252
237
- 2 . Edit the ` .env ` file with your OpenRouter API key and other settings:
253
+ 2 . Edit the ` .env ` file with your API keys and other settings:
238
254
``` bash
239
255
RUST_LOG=info
240
256
DATABASE_URL=" sqlite:absolute/path/to/backend/llmkit.db"
241
- OPENROUTER_API_KEY=your_openrouter_key_here
242
257
JWT_SECRET=your_secure_random_string
243
258
USE_SECURE_COOKIE=false # Set to true for HTTPS deployments
259
+
260
+ # Provider API Keys (add the ones you need)
261
+ OPENROUTER_API_KEY=your_openrouter_key_here
262
+ OPENAI_API_KEY=your_openai_key_here # Required for OpenAI and OpenRouter providers
244
263
```
245
264
265
+ ** Note** : If you don't set the required API keys for a provider, the backend will fail when you try to use that provider.
266
+
246
267
3 . Start the server:
247
268
``` bash
248
269
cd backend
0 commit comments