AWS Bedrock error: Retry with the ID or ARN of an inference profile that contains this model.

[jtviolet]

My .env for Bedrock (sensitive details removed):

BEDROCK_AWS_DEFAULT_REGION=us-east-2
BEDROCK_AWS_ACCESS_KEY_ID=XXXXXXXXXXXXXXXXXXXX
BEDROCK_AWS_SECRET_ACCESS_KEY=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
#BEDROCK_AWS_SESSION_TOKEN=someSessionToken

I have confirmed that the access key id and secret are correct and working.

My librechat.yaml endpoint information:

  bedrock:
    titleModel: "anthropic.claude-3-haiku-20240307-v1:0"
    streamRate: 35

[danny-avila]

Check these posts for more information:
https://github.com/danny-avila/LibreChat/discussions?discussions_q=is%3Aopen+Invocation+of+model+ID+

[jtviolet]

Unfortunately I went through all of those posts to no avail. I've also tried using the us. options, e.g. us.anthropic.claude-3-5-sonnet-20241022-v2:0 and did a string compare to one of the posts in your link...but to no avail.

[danny-avila]

Are you getting the same error every time? It should be different when prefixing the cross-inference region. Also, there could be permission issues, all of which would show up in the error message.

[jtviolet]

Should I need to create an inference profile on AWS before using it here?