From 229b6b9584ccfa685b8867e75bc6130455c4142f Mon Sep 17 00:00:00 2001 From: Eloy Coto Date: Thu, 7 Nov 2024 17:38:30 +0100 Subject: [PATCH] doc: added ollama API env variable Signed-off-by: Eloy Coto --- docs/tutorial.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/tutorial.md b/docs/tutorial.md index 973824137..bd7313edc 100644 --- a/docs/tutorial.md +++ b/docs/tutorial.md @@ -668,6 +668,7 @@ text: decoding_method: greedy ``` +If you want to use an external Ollama instance, the env variable `OLLAMA_API_BASE` should be defined, by default is `http://localhost:11434`. Alternatively, one could also use Ollama's OpenAI-style endpoint using the `openai/` prefix instead of `ollama_chat/`. In this case, set the `OPENAI_API_BASE`, `OPENAI_API_KEY`, and `OPENAI_ORGANIZATION` (if necessary) environment variables. If you were using the official OpenAI API, you would only have to set the api key and possibly the organization. For local use e.g., using Ollama, this could look like so: