How to use Bedrock using AWS STS authentication (AssumeRole)?

[aswny]

I'm using LibreChat + LiteLLM, both hosted on AWS EC2 instance.

I access LLMs through AWS Bedrock using a corporate account and I use AWS STS authentication method to create temporary AssumeRole
credentials. So far I've been using LiteLLM which supports passing AWS Role Name and AWS Session Name.

However, I keep facing UX issues due to network latency on hosted LiteLLM instance.

Is there a way to directly use AWS Role Name in LibreChat to access Bedrock models?

[danny-avila]

Yes, I recommend using AWS directly instead of through LiteLLM.

Have you read the documentation on this? Particular starting from here:

Note: You can also omit the access keys in order to use the default AWS credentials chain but you must set the default region:

https://www.librechat.ai/docs/configuration/pre_configured_ai/bedrock

Let me know if that's helpful.