ChatOllama Not Respecting baseUrl Configuration: Converts localhost to 127.0.0.1

[bajrangCoder]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

import { ChatOllama } from "@langchain/community/chat_models/ollama";

let modelInstance = new ChatOllama({
    baseUrl: "http://localhost:11434",
    model: "phi3"
});

const prompt = ChatPromptTemplate.fromMessages([
    ["system", "You are an AI assistant."],
    ["placeholder", "{chat_history}"],
    ["human", "{input}"]
]);

const parser = new StringOutputParser();
const chain = prompt.pipe(modelInstance).pipe(parser);

const withMessageHistory = new RunnableWithMessageHistory({
    runnable: chain,
    getMessageHistory: (sessionId) => {
        if (this.messageHistories[sessionId] === undefined) {
            messageHistories[sessionId] = new InMemoryChatMessageHistory();
        }
        return messageHistories[sessionId];
    },
    inputMessagesKey: "input",
    historyMessagesKey: "chat_history"
});

const stream = await withMessageHistory.stream(
    {
        input: question,
    },
    messageSessionConfig,
);

Description

I am encountering an issue with LangChain when specifying the base URL to localhost. Despite setting the base URL to http://localhost:11434, LangChain internally uses 127.0.0.1. My application is configured to disable requests to IP addresses, allowing only hostname-based requests, which causes the requests to fail.

Issue Details:

• Base URL Configuration: http://localhost:11434
• LangChain Behavior: Converts localhost to 127.0.0.1 internally.
• Application Configuration: Requests to IP addresses are disabled; only hostname-based requests are allowed.
• Error Encountered: Requests fail due to the conversion to 127.0.0.1.

LangChain should respect the base URL specified as localhost without converting it to 127.0.0.1.

Is there a configuration or workaround to prevent LangChain from converting localhost to 127.0.0.1, or to ensure it makes requests using the hostname?

Any guidance or suggestions to resolve this issue would be greatly appreciated. Thank you!

System Info

@langchain/community: "^0.2.5",
@langchain/core: "^0.2.5",

[dosubot[bot]]

Hey @bajrangCoder! I'm here to help you with any bugs, questions, or contributions you have for the repository. Let's tackle this issue together!

To prevent LangChain from converting localhost to 127.0.0.1, you can set the baseUrl parameter to a value that does not start with http://localhost:. For example, you can use http://127.0.0.1: directly or any other hostname that you prefer.

Here is an example of how you can configure the baseUrl:

import { ChatOllama } from "@langchain/community/chat_models/ollama";

let modelInstance = new ChatOllama({
    baseUrl: "http://your-preferred-hostname:11434",
    model: "phi3"
});

This will ensure that the baseUrl is not converted to 127.0.0.1 ^[1][2].

To continue talking to Dosu, mention @dosu.

[bajrangCoder]

That's just useless, langchain just converts localhost to 127.0.0.1

But I don't want that conversion.

[thedan158]

@bajrangCoder you can check the createOllamaStream in node_modules, theres a line automatically change localhost to 127.0.0.1 due to Nodejs 18 problem , if you dont want this to happen you can modify that line inside node_modules