ChatOllama's base_url doesn't support that behind a proxy

[orcahmlee]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

The packages version:

langchain                 0.2.11
langchain-community       0.2.10
langchain-core            0.2.24
langchain-ollama          0.1.1
langchain-openai          0.1.19
langchain-text-splitters  0.2.2

I hosted a Ollama server on a K8s using Helm Charts and I add a proxy server(APISix) for this deployment. Therefore, I can access the Ollama service via a host with path instead of using port-forwording.

For example, the url for the Ollama service is https://MY_HOST/ollama. I can access the Ollama API and get the response using curl:

curl https://MY_HOST/ollama/api/chat -d '{
  "model": "llama3",
  "stream": "false",
  "messages": [
    {
      "role": "user",
      "content": "who are you?"
    }
  ]
}'

However, I couldn't set the https://MY_HOST/ollama to the ChatOllama. The final url alway be parsed to https://MY_HOST:443 without the path ollama, no mater I set OLLAMA_HOST in the environment variable or base_url in the ChatOllama constructor.

Motivation

I knew this PR(#24719) was already add the support of base_url for ChatOllama. Is it possible add support the base_url that is behind a proxy?

Proposal (If applicable)

No response

[haowaiwai]

Support adding this function.

[orcahmlee]

Since the ollama-python support the base_url behind a proxy. I think this could be close.

REF:

• https://github.com/ollama/ollama-python/releases/tag/v0.3.2
• Client's host doesn't work when the host is behind a proxy server ollama/ollama-python#244
• Client fails to query resources behind reverse proxy path ollama/ollama-python#113