Problem: LibreChat ignores multiple aws regions for bedrock models

[andreaswittmann]

[2025-03-29 Sat 08:51] I want to use aws bedrock models in two different regions. I have successully configured and testet access to models in the eu-central-1 region via .env file using the property
BEDROCK_AWS_DEFAULT_REGION=eu-central-1. I can also use models from the region us-east-1 if I reconfigure the default region with BEDROCK_AWS_DEFAULT_REGION=us-east-1

But I cannot use multiple regions to choose from.

The docs at https://www.librechat.ai/docs/configuration/pre_configured_ai/bedrock#additional-configuration mention a drop-down list to choose the region, but it doesn't appear in the UI.

# Listing: my configuration from the .env file
BEDROCK_AWS_DEFAULT_REGION=eu-central-1 
BEDROCK_AWS_ACCESS_KEY_ID=xxxxxxxxxxxxxxxxx
BEDROCK_AWS_SECRET_ACCESS_KEY=xxxxxxxxxxxxxxxxx
# BEDROCK_AWS_SESSION_TOKEN=
BEDROCK_AWS_MODELS=us.deepseek.r1-v1:0,anthropic.claude-3-sonnet-20240229-v1:0,anthropic.claude-3-haiku-20240307-v1:0,anthropic.claude-3-5-sonnet-20240620-v1:

# Listing: my configuration from the  librechat.yaml file
version: '1.0.0'

endpoints:
  bedrock:
    availableRegions:
      - "us-east-1"
      - "eu-central-1"
    streamRate: 35
    titleModel: 'anthropic.claude-3-haiku-20240307-v1:0'


# Listing: Container Log showing the accepted configuration from the librechat.yaml
2025-03-29 09:15:33 2025-03-29 08:15:33 info: Custom config file loaded:
2025-03-29 09:15:33 2025-03-29 08:15:33 info: {
2025-03-29 09:15:33   "version": "1.2.3",
2025-03-29 09:15:33   "endpoints": {
2025-03-29 09:15:33     "bedrock": {
2025-03-29 09:15:33       "availableRegions": [
2025-03-29 09:15:33         "us-east-1",
2025-03-29 09:15:33         "eu-central-1"
2025-03-29 09:15:33       ],
2025-03-29 09:15:33       "streamRate": 35,
2025-03-29 09:15:33       "titleModel": "anthropic.claude-3-haiku-20240307-v1:0"
2025-03-29 09:15:33     }
2025-03-29 09:15:33   }
2025-03-29 09:15:33 }
2025-03-29 09:15:33 2025-03-29 08:15:33 info: Server listening on all interfaces at port 3080. Use http://localhost:3080 to access it

The following image shows the problem. I can choose the bedrock models, however I cannot choose the region.

Can anybody confirm this issue? Or is there a workaround to use multiple regions?

[dvejsada]

You can use agents set as modelSpec. Within agent settings, you can set the region for the model to be used. We are using both Claude 3.5 in EU and Haiku 3.5 in US.

[andreaswittmann]

@dvejsada: Do you have a sample snippet?

[danny-avila]

The dropdown for region is in the right side panel, in the parameters.

[danny-avila]

As mentioned, you can also configure an agent which has the same parameters.

[andreaswittmann]

Thank you, now I found the drop down list. Everything is working perfect now.