Issues when using AWS Bedrock in EU for Anthropic

[lezgin-zilan-qred]

What happened?

Hi,

To start with, I totally love the project and big thanks for the effort on building it, but i'm having some issues with aws bedrock running in eu regions,

I have spent numeros days now to try to troubleshoot the problem of using AWS Bedrock in EU for anthropic models. To start with, i'm using the latest version and docker with the following compose.

The relevant .env is:

ENDPOINTS=bedrock,agents,google
BEDROCK_AWS_DEFAULT_REGION=eu-west-1
BEDROCK_AWS_ACCESS_KEY_ID=xxxxxx
BEDROCK_AWS_SECRET_ACCESS_KEY=xxxxxxxx

This is one part of librechat.yaml

modelSpecs:
  enforce: false
  prioritize: true
  addedEndpoints: ["agents"]
  list:
    - name: "Bedrock Claude 3.5 Sonnet"
      label: "Anthropic Claude 3.5 Sonnet"
      iconURL: "anthropic"
      description: "Routes requests to Anthropic Claude 3.5 Sonnet in eu-central-1, eu-west-1 and eu-west-3."
      default: true
      preset:
        endpoint: "bedrock"
        model: "eu.anthropic.claude-3-5-sonnet-20240620-v1:0" # <-- Now using the Inference Profile ID
        modelLabel: "Anthropic Claude 3.5 Sonnet"

    - name: "Bedrock Claude 3 Sonnet"
      label: "Anthropic Claude 3 Sonnet"
      iconURL: "anthropic"
      description: "Routes requests to Anthropic Claude 3 Sonnet in eu-central-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        model: "anthropic.claude-3-sonnet-20240229-v1:0"
        modelLabel: "Anthropic Claude 3 Sonnet"

    - name: "Bedrock Claude 3 Haiku"
      label: "Anthropic Claude 3 Haiku"
      iconURL: "anthropic"
      description: "Routes requests to Anthropic Claude 3 Haiku in eu-central-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        model: "anthropic.claude-3-haiku-20240307-v1:0"
        modelLabel: "Anthropic Claude 3 Haiku"

    - name: "Bedrock Claude 3.7 Sonnet"
      label: "Anthropic Claude 3.7 Sonnet"
      iconURL: "anthropic"
      description: "Routes requests to Anthropic Claude 3.7 Sonnet in eu-central-1, eu-north-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        model: "eu.anthropic.claude-3-7-sonnet-20250219-v1:0"
        modelLabel: "Anthropic Claude 3.7 Sonnet"

    - name: "Bedrock Claude Sonnet 4"
      label: "Anthropic Claude Sonnet 4"
      iconURL: "anthropic"
      description: "Routes requests to Claude Sonnet 4 in multiple EU regions."
      preset:
        endpoint: "bedrock"
        model: "eu.anthropic.claude-sonnet-4-20250514-v1:0"
        modelLabel: "Anthropic Claude Sonnet 4"

    - name: "Bedrock Llama 3.2 3B"
      label: "Meta Llama 3.2 3B Instruct"
      iconURL: "meta"
      description: "Routes requests to Meta Llama 3.2 3B Instruct in eu-central-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        model: "meta.llama3-2-3b-instruct-v1:0"
        modelLabel: "Meta Llama 3.2 3B Instruct"

    - name: "Bedrock Llama 3.2 1B"
      label: "Meta Llama 3.2 1B Instruct"
      iconURL: "meta"
      description: "Routes requests to Meta Llama 3.2 1B Instruct in eu-central-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        model: "meta.llama3-2-1b-instruct-v1:0"
        modelLabel: "Meta Llama 3.2 1B Instruct"

    - name: "Bedrock Nova Micro"
      label: "Amazon Nova Micro"
      iconURL: "amazon"
      description: "Routes requests to Nova Micro in eu-west-3, eu-west-1, eu-central-1 and eu-north-1."
      preset:
        endpoint: "bedrock"
        model: "amazon.nova-micro-v1:0"
        modelLabel: "Amazon Nova Micro"

    - name: "Bedrock Nova Lite"
      label: "Amazon Nova Lite"
      iconURL: "amazon"
      description: "Routes requests to Nova Lite in eu-west-3, eu-west-1, eu-central-1 and eu-north-1."
      preset:
        endpoint: "bedrock"
        model: "amazon.nova-lite-v1:0"
        modelLabel: "Amazon Nova Lite"

    - name: "Bedrock Nova Pro"
      label: "Amazon Nova Pro"
      iconURL: "amazon"
      description: "Routes requests to Nova Pro in eu-west-3, eu-west-1, eu-central-1 and eu-north-1."
      preset:
        endpoint: "bedrock"
        model: "amazon.nova-pro-v1:0"
        modelLabel: "Amazon Nova Pro"

    - name: "Bedrock Pixtral Large"
      label: "Mistral Pixtral Large 25.02"
      iconURL: "mistral"
      description: "Routes requests to Mistral Pixtral Large 25.02 in eu-central-1, eu-north-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        model: "mistral.pixtral-large-2502-v1:0"
        modelLabel: "Mistral Pixtral Large 25.02"

The only two that works is Claude 3 sonnet and haiku

This is the debug log of when running

2025-07-07T07:11:11.150Z debug: [BaseClient] Loading history:
{
  conversationId: "3640cfb3-2eff-496f-b18f-506ab05b06dd",
  parentMessageId: "0a343e3b-ad97-429c-ac1f-7a7fb5560d07",
}
2025-07-07T07:11:11.154Z debug: [BaseClient] Context Count (1/2)
{
  remainingContextTokens: 179795,
  maxContextTokens: 180000,
}
2025-07-07T07:11:11.154Z debug: [BaseClient] Context Count (2/2)
{
  remainingContextTokens: 179795,
  maxContextTokens: 180000,
}
2025-07-07T07:11:11.155Z debug: [BaseClient] tokenCountMap:
{
  0e26497f-x: 5,
  0ad2a585-x: 4,
  d203e2f2-x: 5,
  33b9a1cd-x: 4,
  87b2b7a2-x: 5,
  0596bb61-x: 4,
  cd7c9303-x: 5,
  556ec797-x: 4,
  60c94e5c-x: 6,
  51248b76-x: 4,
  947d1a16-x: 5,
  2bc3d92c-x: 4,
  3a1bcf39-x: 5,
  516b6b19-x: 78,
  d7389d3c-x: 5,
  0a343e3b-x: 54,
  24580934-x: 5,
}
2025-07-07T07:11:11.155Z debug: [BaseClient]
{
  promptTokens: 205,
  remainingContextTokens: 179795,
  payloadSize: 17,
  maxContextTokens: 180000,
}
2025-07-07T07:11:11.155Z debug: [BaseClient] tokenCountMap
{
  0e26497f-x: 5,
  0ad2a585-x: 4,
  d203e2f2-x: 5,
  33b9a1cd-x: 4,
  87b2b7a2-x: 5,
  0596bb61-x: 4,
  cd7c9303-x: 5,
  556ec797-x: 4,
  60c94e5c-x: 6,
  51248b76-x: 4,
  947d1a16-x: 5,
  2bc3d92c-x: 4,
  3a1bcf39-x: 5,
  516b6b19-x: 78,
  d7389d3c-x: 5,
  0a343e3b-x: 54,
  24580934-x: 5,
}
2025-07-07T07:11:11.156Z debug: [BaseClient] userMessage
{
  messageId: "24580934-x",
  parentMessageId: "0a343e3b-x",
  conversationId: "3640cfb3-x",
  sender: "User",
  text: "hi",
  isCreatedByUser: true,
  tokenCount: 5,
}
2025-07-07T07:11:11.183Z debug: [saveConvo] api/app/clients/BaseClient.js - saveMessageToDatabase #saveConvo
2025-07-07T07:11:11.220Z error: [api/server/controllers/agents/client.js #sendCompletion] Operation aborted The provided model identifier is invalid.
2025-07-07T07:11:11.221Z error: [api/server/controllers/agents/client.js #sendCompletion] Unhandled error type The provided model identifier is invalid.
2025-07-07T07:11:11.229Z debug: [saveConvo] api/app/clients/BaseClient.js - saveMessageToDatabase #saveConvo
2025-07-07T07:11:11.243Z debug: [AgentController] Request closed
2025-07-07T07:11:11.251Z debug: [AgentController] Performing cleanup
2025-07-07T07:11:11.251Z debug: [AgentController] Cleaning up abort controller
2025-07-07T07:11:11.252Z debug: [AgentController] Cleanup completed

And the following error in the web ui: Something went wrong. Here's the specific error message we encountered: An error occurred while processing the request: The provided model identifier is invalid.

I have tried numerous different configurations based on the past issues I seen but nothing have helped, my guess is that it have to do with requests routed to other regions outside of the default eu-west-1 and yes, I have allowed the other regions and confirmed I have gotten the models to work with other tools (eg Sonnet 4 with claude code).

Any idea on what could be wrong? What else should I collect?

Version Information

ghcr.io/danny-avila/librechat-dev latest 789ccee68a87 4 days ago 1.11GB
ghcr.io/danny-avila/librechat-dev-api latest d536c685a0df 10 days ago 1.19GB
ghcr.io/danny-avila/librechat-dev-api 39587eae1dea 11 days ago 1.19GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite latest 6a1dfa1c7fe0 2 weeks ago 1.47GB

Steps to Reproduce

See relevant parts of config and use eu-west-1 and activate the relevant models in aws

What browsers are you seeing the problem on?

Chrome

Relevant log output

I shared the relevant logs in the description

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

Thanks for the kind words!

The provided model identifier is invalid

The issue is clear, and you need to verify the correct identifier to use, likely needing a specific cross-region inference profile ID.

Check this tab in AWS Bedrock Page:

[lezgin-zilan-qred]

Hi mate,

It was one of the states I tried with the prefix of eu.$model but to ensure its more clear I did ensure all of them was using the model names from cross-region inference as you can see in the screenshot bellow together with some logs and config

Console logs of the librechat-api container:

2025-07-08T12:53:38.312Z debug: [BaseClient] Loading history:
{
  conversationId: "18cd77c5-x",
  parentMessageId: "4203cc5c-x",
}
2025-07-08T12:53:38.316Z debug: [BaseClient] Context Count (1/2)
{
  remainingContextTokens: 179983,
  maxContextTokens: 180000,
}
2025-07-08T12:53:38.316Z debug: [BaseClient] Context Count (2/2)
{
  remainingContextTokens: 179983,
  maxContextTokens: 180000,
}
2025-07-08T12:53:38.316Z debug: [BaseClient] tokenCountMap:
{
  9f29c44e-x: 5,
  4203cc5c-x: 4,
  cc3821f3-x: 5,
}
2025-07-08T12:53:38.317Z debug: [BaseClient]
{
  promptTokens: 17,
  remainingContextTokens: 179983,
  payloadSize: 3,
  maxContextTokens: 180000,
}
2025-07-08T12:53:38.318Z debug: [BaseClient] tokenCountMap
{
  9f29c44e-x 5,
  4203cc5c-x: 4,
  cc3821f3-x: 5,
}
2025-07-08T12:53:38.318Z debug: [BaseClient] userMessage
{
  messageId: "cc3821f3-x",
  parentMessageId: "4203cc5c-x",
  conversationId: "18cd77c5-x",
  sender: "User",
  text: "hi",
  isCreatedByUser: true,
  tokenCount: 5,
}
2025-07-08T12:53:38.348Z debug: [saveConvo] api/app/clients/BaseClient.js - saveMessageToDatabase #saveConvo
2025-07-08T12:53:38.374Z error: [api/server/controllers/agents/client.js #sendCompletion] Operation aborted The provided model identifier is invalid.
2025-07-08T12:53:38.375Z error: [api/server/controllers/agents/client.js #sendCompletion] Unhandled error type The provided model identifier is invalid.
2025-07-08T12:53:38.382Z debug: [saveConvo] api/app/clients/BaseClient.js - saveMessageToDatabase #saveConvo
2025-07-08T12:53:38.402Z debug: [AgentController] Request closed
2025-07-08T12:53:38.411Z debug: [AgentController] Performing cleanup
2025-07-08T12:53:38.412Z debug: [AgentController] Cleaning up abort controller
2025-07-08T12:53:38.412Z debug: [AgentController] Cleanup completed

Output from the webui:
Something went wrong. Here's the specific error message we encountered: An error occurred while processing the request: The provided model identifier is invalid.

Relevant parts of the librechat.yaml config:

endpoints:
  anthropic:
    disabled: true # Corrected from 'disable'

  assistants:
    disableBuilder: false # Disable Assistants Builder Interface by setting to `true`
    pollIntervalMs: 3000  # Polling interval for checking assistant updates
    timeoutMs: 180000  # Timeout for assistant operations
    # Should only be one or the other, either `supportedIds` or `excludedIds`
    supportedIds: ["asst_supportedAssistantId1", "asst_supportedAssistantId2"]
    # excludedIds: ["asst_excludedAssistantId"]
    # Only show assistants that the user created or that were created externally (e.g. in Assistants playground).
    # privateAssistants: false # Does not work with `supportedIds` or `excludedIds`
    # (optional) Models that support retrieval, will default to latest known OpenAI models that support the feature
    retrievalModels: ["gpt-4-turbo-preview"]
    # (optional) Assistant Capabilities available to all users. Omit the ones you wish to exclude. Defaults to list below.
    capabilities: ["code_interpreter", "retrieval", "actions", "tools", "image_vision"]
  agents:
    # (optional) Default recursion depth for agents, defaults to 25
    recursionLimit: 50
    # (optional) Max recursion depth for agents, defaults to 25
    maxRecursionLimit: 100
    # (optional) Disable the builder interface for agents
    disableBuilder: false
    # (optional) Agent Capabilities available to all users. Omit the ones you wish to exclude. Defaults to list below.
    #capabilities: ["execute_code", "file_search", "actions", "tools"]
    capabilities: ["file_search", "actions", "tools"]

modelSpecs:
  enforce: false
  prioritize: true
  addedEndpoints:
    - agents
    - bedrock
    - google
  list:
    - name: "Bedrock Claude 3.5 Sonnet"
      label: "Anthropic Claude 3.5 Sonnet"
      iconURL: "anthropic"
      description: "Routes requests to Anthropic Claude 3.5 Sonnet in eu-central-1, eu-west-1 and eu-west-3."
      default: true
      preset:
        endpoint: "bedrock"
        model: "eu.anthropic.claude-3-5-sonnet-20240620-v1:0" # <-- Now using the Inference Profile ID
        modelLabel: "Anthropic Claude 3.5 Sonnet"

    - name: "Bedrock Claude 3 Sonnet"
      label: "Anthropic Claude 3 Sonnet"
      iconURL: "anthropic"
      description: "Routes requests to Anthropic Claude 3 Sonnet in eu-central-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        #model: "anthropic.claude-3-sonnet-20240229-v1:0"
        model: "eu.anthropic.claude-3-sonnet-20240229-v1:0"
        modelLabel: "Anthropic Claude 3 Sonnet"

    - name: "Bedrock Claude 3 Haiku"
      label: "Anthropic Claude 3 Haiku"
      iconURL: "anthropic"
      description: "Routes requests to Anthropic Claude 3 Haiku in eu-central-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        #model: "anthropic.claude-3-haiku-20240307-v1:0"
        model: "eu.anthropic.claude-3-haiku-20240307-v1:0"
        modelLabel: "Anthropic Claude 3 Haiku"

    - name: "Bedrock Claude 3.7 Sonnet"
      label: "Anthropic Claude 3.7 Sonnet"
      iconURL: "anthropic"
      description: "Routes requests to Anthropic Claude 3.7 Sonnet in eu-central-1, eu-north-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        #model: "eu.anthropic.claude-3-7-sonnet-20250219-v1:0"
        model: "eu.anthropic.claude-3-7-sonnet-20250219-v1:0"
        modelLabel: "Anthropic Claude 3.7 Sonnet"

    - name: "Bedrock Claude Sonnet 4"
      label: "Anthropic Claude Sonnet 4"
      iconURL: "anthropic"
      description: "Routes requests to Claude Sonnet 4 in multiple EU regions."
      preset:
        endpoint: "bedrock"
        #model: "eu.anthropic.claude-sonnet-4-20250514-v1:0"
        model: "eu.anthropic.claude-sonnet-4-20250514-v1:0"
        modelLabel: "Anthropic Claude Sonnet 4"

    - name: "Bedrock Llama 3.2 3B"
      label: "Meta Llama 3.2 3B Instruct"
      iconURL: "meta"
      description: "Routes requests to Meta Llama 3.2 3B Instruct in eu-central-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        #model: "meta.llama3-2-3b-instruct-v1:0"
        model: "eu.meta.llama3-2-3b-instruct-v1:0"
        modelLabel: "Meta Llama 3.2 3B Instruct"

    - name: "Bedrock Llama 3.2 1B"
      label: "Meta Llama 3.2 1B Instruct"
      iconURL: "meta"
      description: "Routes requests to Meta Llama 3.2 1B Instruct in eu-central-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        model: "eu.meta.llama3-2-1b-instruct-v1:0"
        modelLabel: "Meta Llama 3.2 1B Instruct"

    - name: "Bedrock Nova Micro"
      label: "Amazon Nova Micro"
      iconURL: "amazon"
      description: "Routes requests to Nova Micro in eu-west-3, eu-west-1, eu-central-1 and eu-north-1."
      preset:
        endpoint: "bedrock"
        #model: "amazon.nova-micro-v1:0"
        model: "eu.amazon.nova-micro-v1:0"
        modelLabel: "Amazon Nova Micro"

    - name: "Bedrock Nova Lite"
      label: "Amazon Nova Lite"
      iconURL: "amazon"
      description: "Routes requests to Nova Lite in eu-west-3, eu-west-1, eu-central-1 and eu-north-1."
      preset:
        endpoint: "bedrock"
        #model: "amazon.nova-lite-v1:0"
        model: "eu.amazon.nova-lite-v1:0"
        modelLabel: "Amazon Nova Lite"

    - name: "Bedrock Nova Pro"
      label: "Amazon Nova Pro"
      iconURL: "amazon"
      description: "Routes requests to Nova Pro in eu-west-3, eu-west-1, eu-central-1 and eu-north-1."
      preset:
        endpoint: "bedrock"
        #model: "amazon.nova-pro-v1:0"
        model: "eu.amazon.nova-pro-v1:0"
        modelLabel: "Amazon Nova Pro"

    - name: "Bedrock Pixtral Large"
      label: "Mistral Pixtral Large 25.02"
      iconURL: "mistral"
      description: "Routes requests to Mistral Pixtral Large 25.02 in eu-central-1, eu-north-1, eu-west-1 and eu-west-3."
      preset:
        endpoint: "bedrock"
        #model: "mistral.pixtral-large-2502-v1:0"
        model: "eu.mistral.pixtral-large-2502-v1:0"
        modelLabel: "Mistral Pixtral Large 25.02"

the relevant parts from .env:

ENDPOINTS=bedrock,agents,google
BEDROCK_AWS_DEFAULT_REGION=eu-west-1 # A default region must be provided
BEDROCK_AWS_ACCESS_KEY_ID=x
BEDROCK_AWS_SECRET_ACCESS_KEY=x

I have also tried with and without BEDROCK_AWS_MODELS=eu.anthropic.claude-3-sonnet-20240229-v1:0,eu.anthropic.claude-3-haiku-20240307-v1:0,eu.anthropic.claude-3-5-sonnet-20240620-v1:0,eu.meta.llama3-2-3b-instruct-v1:0,eu.mistral.pixtral-large-2502-v1:0,eu.anthropic.claude-3-7-sonnet-20250219-v1:0,eu.amazon.nova-pro-v1:0,eu.anthropic.claude-sonnet-4-20250514-v1:0 in the .env file

Any suggestions?