How to customize ChatOpenAI's API base ?

[MicleMing]

Example Code

new ChatOpenAI({
  model: "glm-4",
  temperature: 1,
  openAIApiKey: 'xxx',
  // @ts-ignore
  // customize the api base for another llm
  openAIApiBase: 'https://open.bigmodel.cn/api/paas/v4/',
})

Description

I'm trying to use ChatOpenAI to connect GLM which compatible with OpenAI API, so I need change api base from openai to GML. but it seems not support to change api base now.

System Info

Node

[dosubot[bot]]

Hello @MicleMing! 👋 I'm here to help you with any bugs, questions, and becoming a contributor. Let's tackle this together!

To customize the API base for ChatOpenAI to connect to GLM, which is compatible with the OpenAI API, you can set the baseURL in the configuration. Here is an example:

import { OpenAI } from "@langchain/openai";

const model = new OpenAI(
  { temperature: 1, openAIApiKey: 'xxx', modelName: 'glm-4' },
  { baseURL: "https://open.bigmodel.cn/api/paas/v4/" }
);

const message = await model.invoke("Hi there!");

console.log(message);

/*
  AIMessage {
    content: 'Hello! How can I assist you today?',
    additional_kwargs: { function_call: undefined }
  }
*/

Replace "https://open.bigmodel.cn/api/paas/v4/" with the URL of your GLM API. You can also pass other ClientOptions parameters accepted by the official SDK ^[1][2][3].

To continue talking to Dosu, mention @dosu.