Skip to content

Commit fe4008a

Browse files
committed
Ease LiteLLM setup for examples
1 parent 9addfdf commit fe4008a

File tree

2 files changed

+12
-0
lines changed

2 files changed

+12
-0
lines changed

examples/compose.yaml

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -196,8 +196,16 @@ services:
196196
- ./litellm/config.yaml:/app/config.yaml
197197
env_file:
198198
- .env
199+
- .env.local
199200
command: [ "--config", "/app/config.yaml", "--port", "4000", "--num_workers", "8" ]
200201

202+
litellm-db:
203+
image: pgvector/pgvector:0.8.0-pg17
204+
environment:
205+
POSTGRES_DB: litellm
206+
POSTGRES_USER: litellm
207+
POSTGRES_PASSWORD: litellm
208+
201209
volumes:
202210
typesense_data:
203211
etcd_vlm:

examples/litellm/config.yaml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,3 +3,7 @@ model_list:
33
litellm_params:
44
model: mistral/mistral-small-latest
55
api_key: "os.environ/MISTRAL_API_KEY"
6+
7+
general_settings:
8+
master_key: sk-1234
9+
database_url: "postgresql://litellm:litellm@litellm-db:5432/litellm"

0 commit comments

Comments
 (0)