AWS Bedrock: Claude Sonnet 4 - 1M Context

[dirkpetersen]

What happened?

The new beta header for Claude Sonnet 4 to allow a 1M Context window ( #9093 ) does not seem to to work with RAG api

I am uploading
https://pve.proxmox.com/pve-docs/pve-admin-guide.pdf
which has 1113736 characters after converting to markdown which should be well above the original token window of 200k

and am getting this:

when i use other web interfaces that set the header context-1m-2025-08-07 such as https://github.com/dirkpetersen/bedbot I can successfully process this large file even without vector store

Version Information

docker images | grep librechat
ghcr.io/danny-avila/librechat-dev-api latest 7f4380191ff6 21 hours ago 1.27GB
ghcr.io/danny-avila/librechat-rag-api-dev latest df907f9efe75 2 weeks ago 9.61GB

Steps to Reproduce

see above

What browsers are you seeing the problem on?

Chrome

Relevant log output

2025-09-13 14:15:20 info: Updated role 'ADMIN' and removed old schema fields
2025-09-13 14:15:20 info: Updated 'ADMIN' role permissions
2025-09-13 14:15:20 info: Server listening on all interfaces at port 3080. Use http://localhost:3080 to access it
2025-09-13 14:15:20 info: [indexSync] Messages are fully synced: 2841/2841
2025-09-13 14:15:20 info: [indexSync] Conversations are fully synced: 1129/1129
2025-09-13 14:15:50 error: [api/server/controllers/agents/client.js #sendCompletion] Operation aborted The model returned the following errors: Input is too long for requested model.
2025-09-13 14:15:50 error: [api/server/controllers/agents/client.js #sendCompletion] Unhandled error type The model returned the following errors: Input is too long for requested model.

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

1M Context window support is not yet added for Bedrock, will add it soon

[dirkpetersen]

Ah sorry, i missed that, just saw the pull request had been closed. Absolutely vital for RAG application at work as they have only AWS and claude is really so much better than everything else in AWS ........closing