Skip to content

Commit 229b6b9

Browse files
committed
doc: added ollama API env variable
Signed-off-by: Eloy Coto <[email protected]>
1 parent ae37f8b commit 229b6b9

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

docs/tutorial.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -668,6 +668,7 @@ text:
668668
decoding_method: greedy
669669
```
670670

671+
If you want to use an external Ollama instance, the env variable `OLLAMA_API_BASE` should be defined, by default is `http://localhost:11434`.
671672

672673
Alternatively, one could also use Ollama's OpenAI-style endpoint using the `openai/` prefix instead of `ollama_chat/`. In this case, set the `OPENAI_API_BASE`, `OPENAI_API_KEY`, and `OPENAI_ORGANIZATION` (if necessary) environment variables. If you were using the official OpenAI API, you would only have to set the api key and possibly the organization. For local use e.g., using Ollama, this could look like so:
673674

0 commit comments

Comments
 (0)