Skip to content

Commit f9db514

Browse files
authored
doc: added ollama API env variable (#175)
Signed-off-by: Eloy Coto <[email protected]>
1 parent 48ff0de commit f9db514

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

docs/tutorial.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -668,6 +668,7 @@ text:
668668
decoding_method: greedy
669669
```
670670

671+
If you want to use an external Ollama instance, the env variable `OLLAMA_API_BASE` should be defined, by default is `http://localhost:11434`.
671672

672673
Alternatively, one could also use Ollama's OpenAI-style endpoint using the `openai/` prefix instead of `ollama_chat/`. In this case, set the `OPENAI_API_BASE`, `OPENAI_API_KEY`, and `OPENAI_ORGANIZATION` (if necessary) environment variables. If you were using the official OpenAI API, you would only have to set the api key and possibly the organization. For local use e.g., using Ollama, this could look like so:
673674

0 commit comments

Comments
 (0)