[Enhancement]: AWS Bedrock support for FIPS endpoint specification and ca_bundle

[matthill33]

What features would you like to see added?

Hello all, thank you for the work on librechat, this is a great open source application!

It would be very useful for my org if there was enhanced support for the AWS Bedrock implementation. More specifically, if there was a way to implement the AWS env vars AWS_USE_FIPS_ENDPOINT and AWS_CA_BUNDLE. I have been trying to figure out which files to edit to include these values, but haven't been able to figure it out yet.

AWS Docs on FIPS for SDK - https://docs.aws.amazon.com/sdkref/latest/guide/feature-endpoints.html

AWS Docs on general config (includes AWS_CA_BUNDLE) for SDK - https://docs.aws.amazon.com/sdkref/latest/guide/feature-gen-config.html

More details

Thanks!

Which components are impacted by your request?

Endpoints

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[matthill33]

I figured out how to edit the repo to use the AWS credentials profile correctly and set these values.

1. Add a credentials file with your desired configuration to the repo. I set use_fips_endpoint=true and ca_bundle=<CA_BUNDLE_LOCATION> in mine

2. Edit the Dockerfile to copy the certificate and credentials file.
   COPY ca_bundle.cer /root/.aws/ca_bundle.cer
   COPY credentials /root/.aws/credentials

3. Add the right ENV values right before 'CMD ["npm", "run", "backend"]'
   ENV NODE_EXTRA_CA_CERTS=/root/.aws/ca_bundle.cer
   ENV AWS_SHARED_CREDENTIALS_FILE=/root/.aws/credentials
   ENV AWS_PROFILE=<CONFIG_PROFILE_DEFINED>