Expose ollama-with-open-webui ollama api

[lucasdidur]

I'm using Ollama With Open Webui and I whant to expose the http://ollama-api:11434 to use with my aplications. How can I do this?

This is the original service

# documentation: https://docs.openwebui.com
# slogan: Ollama with Open Web UI integrates AI model deployment with a user-friendly interface.
# tags: ollama,ai,models,deployment,open-web-ui,integration
# logo: svgs/ollama.svg

services:
  ollama-api:
    image: "ollama/ollama:latest"
    volumes:
      - "ollama:/root/.ollama"
    healthcheck:
      test: ["CMD", "ollama", "list"]
      interval: 5s
      timeout: 30s
      retries: 10

  open-webui:
    image: "ghcr.io/open-webui/open-webui:main"
    volumes:
      - "open-webui:/app/backend/data"
    depends_on:
      - ollama-api
    environment:
      - SERVICE_FQDN_OLLAMA_8080
      - OLLAMA_BASE_URL=http://ollama-api:11434
    healthcheck:
      test:
        - CMD
        - curl
        - "-f"
        - "http://127.0.0.1:8080"
      interval: 5s
      timeout: 30s
      retries: 10

[djsisson]

add this to open-webui

ENABLE_OLLAMA_API=true

then you can either make api calls using your url /api/xxxx
https://docs.openwebui.com/getting-started/api-endpoints#-retrieve-all-models

or you can pass through to ollama
with /ollama/xxxx where you use ollama api endpoints
https://docs.openwebui.com/getting-started/api-endpoints#-ollama-api-proxy-support

if you havent already i would recommend you setting up an api key

https://docs.openwebui.com/getting-started/env-configuration#api-key-endpoint-restrictions

[djsisson]

also if you are only making backend api calls to ollama, then as long as your app is in same docker network you can just use ollama-api:11434 directly from your backend

since you cant make calls directly from your front end without exposing your api keys

[viksha-labs-in]

Hello @djsisson, @lucasdidur,
I have same issue, were you able fix it. I know its a year ago but wanted check if you have any fix

Today when i use Ollama with WebUI service on Coolify. I dont see the API Key option under Account