How can I use Claude 3 models with ChatAnthropic?

[soutot]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

import {ChatAnthropic} from 'langchain/chat_models/anthropic'

(...)

const model = new ChatAnthropic({
    temperature: 0.9,
    modelName: 'claude-3-sonnet-20240229',
    anthropicApiKey: process.env.ANTHROPIC_API_KEY,
  })

  const res = await model.invoke('Why is the sky blue?')

  console.log(res)

Description

Hi, I'm trying to use "ChatAnthropic" with claude-3 models, but I'm getting the following error message:
'"claude-3-sonnet-20240229" is not supported on this API. Please use the Messages API instead.'

I tried the same example provided in the docs here: https://js.langchain.com/docs/integrations/chat/anthropic/#usage
But no success

I found this issue mentioning a similar error message but using BedrockChat instead. I'm wondering if I should be using it instead of ChatAnthropic?

I found this issue in the Python repo mentioning the langchain/community does not support claude 3 anymore (see this). I don't know if there's something similar with the JS repo (however, I'm not importing it from @langchain/community, so it should not be related)

I'm able to use it by installing the Anthropic SDK and using it directly. But I'd like to use it with LangChain

import Anthropic from '@anthropic-ai/sdk'

const anthropic = new Anthropic({
  apiKey: process.env.ANTHROPIC_API_KEY,
})

const res = await anthropic.messages.create({
    model: 'claude-3-sonnet-20240229',
    max_tokens: 1024,
    temperature: 0.9,
    messages: [
      {
        role: 'user',
        content: 'Why is the sky blue?',
      },
    ],
  })

console.log(res)

Does anyone know how to work with this?

package.json

"@langchain/anthropic": "^0.1.5",
"@langchain/community": "^0.0.36",
"@langchain/core": "^0.1.44",
"langchain": "^0.1.26",

Also, not kinda related, but how can I use Haiku instead of Sonnet? Tried this claude-3-haiku-20240229 and I got a not found error.

Thanks in advance

System Info

[email protected] | MIT | deps: 18 | versions: 256
Typescript bindings for langchain
https://github.com/langchain-ai/langchainjs/tree/main/langchain/

keywords: llm, ai, gpt3, chain, prompt, prompt engineering, chatgpt, machine learning, ml, openai, embeddings, vectorstores

dist
.tarball: https://registry.npmjs.org/langchain/-/langchain-0.1.26.tgz
.shasum: 1901db427565498b3b2316037deedcfdda5bb3c0
.integrity: sha512-2hCXDev/KkBKNHCrxqq7XQxAp/kpjMtwlIuKBzaSW8gM+BOrh8q6B9PM3ItbvG4s29JCW7xlJtIEO3LaWChwkQ==
.unpackedSize: 4.0 MB

dependencies:
@anthropic-ai/sdk: ^0.9.1 langchainhub: ~0.0.8
@langchain/community: ~0.0.36 langsmith: ~0.1.7
@langchain/core: ~0.1.44 ml-distance: ^4.0.0
@langchain/openai: ~0.0.19 openapi-types: ^12.1.3
binary-extensions: ^2.2.0 p-retry: 4
expr-eval: ^2.0.2 uuid: ^9.0.0
js-tiktoken: ^1.0.7 yaml: ^2.2.1
js-yaml: ^4.1.0 zod-to-json-schema: ^3.22.3
jsonpointer: ^5.0.1 zod: ^3.22.4

maintainers:

• nfcampos [email protected]
• jacoblee93 [email protected]
• davidduong [email protected]
• hwchase17 [email protected]
• basproul [email protected]

dist-tags:
latest: 0.1.26 next: 0.1.19-rc.2

published 13 hours ago by jacoblee93 [email protected]

[dosubot[bot]]

Hey @soutot, great to see you back with another interesting question! Hope you've been doing well.

Based on the context provided, it seems like the model you're trying to use (claude-3-sonnet-20240229) is not supported by the API you're using. This could be due to an incorrect model name or an attempt to use a model that isn't available or compatible with the API's current configuration.

If you want to switch to using Haiku instead of Sonnet, you'll need to ensure that a Haiku version of the Claude 3 model exists and is supported by the API. The model name typically follows a pattern that includes the model version, the configuration (e.g., Sonnet, Haiku), and possibly a date or version number. For example, if a Haiku version of Claude 3 is available, it might be named following a similar pattern, such as claude-3-haiku-<date/version>.

Here's how you might adjust your code if such a model exists:

import { ChatAnthropic } from "@langchain/anthropic";

// Assuming 'claude-3-haiku-20240229' is a valid model name
const model = new ChatAnthropic({
  modelName: "claude-3-haiku-20240229", // Adjusted to use a hypothetical Haiku model
  maxTokens: 1024,
  clientOptions: {
    defaultHeaders: {
      "X-Api-Key": process.env.ANTHROPIC_API_KEY,
    },
  },
});

const res = await model.invoke("Why is the sky blue?");

console.log(res);

In this adjustment, "claude-3-sonnet-20240229" is replaced with "claude-3-haiku-20240229", assuming that's the correct model name for a Haiku version. Remember, the actual model name depends on the naming conventions and the models available through the API you're using. Always refer to the API's documentation or model listing to find the correct model names and ensure they are supported.

As for the supported models for the ChatAnthropic class in the LangChain JS codebase, the provided context indicates that the supported model is "claude-3-sonnet-20240229". You can find this information in the examples/src/models/chat/anthropic_tools/extraction.ts file in the LangChain JS repository.

I hope this helps! If you have any other questions or need further clarification, feel free to ask.

Sources

• examples/src/models/chat/integration_anthropic_custom_headers.ts
• examples/src/models/chat/anthropic_tools/extraction.ts

About Dosu

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.