Skip to content

Commit eeedbc6

Browse files
committed
Merge branch 'main' of ssh://github.com/envoyproxy/ai-gateway
2 parents 3a9e1d3 + 8d3310e commit eeedbc6

37 files changed

+2543
-977
lines changed

cmd/aigw/README.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,14 @@
88
- **aigw** (port 1975): Envoy AI Gateway CLI (standalone mode)
99
- **chat-completion**: curl command making a simple chat completion
1010

11+
The simplest way to get started is to have `aigw` generate a configuration for
12+
your OpenAI-compatible backend. This happens when there is no configuration
13+
file and at least the `OPENAI_API_KEY` environment variable is set.
14+
15+
Here are values we use for Ollama:
16+
- `OPENAI_API_KEY=unused` (Ollama does not require an API key)
17+
- `OPENAI_BASE_URL=http://localhost:11434/v1` (host.docker.internal in Docker)
18+
1119
1. **Start Ollama** on your host machine:
1220

1321
Start Ollama on all interfaces, with a large context. This allows it to be

0 commit comments

Comments
 (0)