Erroneous error messages with Bedrock : A conversation must start with a user message.

[dirkpetersen]

What happened?

When using AWS Bedrock with certain models (Deepseek, Claude) and using RAG API with several attachments I am getting the error message "A conversation must start with a user message. Try again with a conversation that starts with a user message." . I assume this happens because the attachments and plus prompt do not fit the context window but it seems the attachments are added first and then the prompt so that perahps the prompt is ignored ? It should show the typical errro message:
The model returned the following errors: Input is too long for requested model.

Version Information

ochat@peters-chat:~/LibreChat$ docker images | grep librechat
ghcr.io/danny-avila/librechat-dev-api latest cd3432a5c3f6 57 minutes ago 1.18GB
ghcr.io/danny-avila/librechat-dev-api 70065060a0ed 3 days ago 1.19GB
ghcr.io/danny-avila/librechat-dev-api b87bbe4049a3 8 days ago 1.18GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite latest 8858d2bd9ff5 9 days ago 1.48GB
ghcr.io/danny-avila/librechat-dev-api 03a5fd399ee9 2 weeks ago 1.18GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite 13e75a2c0e7a 2 weeks ago 1.48GB
ghcr.io/danny-avila/librechat-dev-api 6e5bce386b73 2 weeks ago 1.19GB
ghcr.io/danny-avila/librechat-dev-api ec732384bd62 6 weeks ago 1.12GB
ghcr.io/danny-avila/librechat-dev-api 506e43540118 8 weeks ago 1.1GB
ghcr.io/danny-avila/librechat-dev-api 44c1aef1f791 2 months ago 1.1GB
ghcr.io/danny-avila/librechat-dev-api 80d5028342c5 2 months ago 1.09GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite e7da8e6aca0f 2 months ago 1.31GB
ghcr.io/danny-avila/librechat-dev-api 65526bf57a1d 2 months ago 1.09GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite 817faebddae9 3 months ago 1.31GB

Steps to Reproduce

• use AWS Bedrock
• select deepseek or claude
• 3-10 attachments
• add a prompt

What browsers are you seeing the problem on?

Chrome

Relevant log output

4-465c-bd8c-758e2be80324/context - 200
rag_api-1         | 2025-07-19 19:46:31,172 - root - INFO - Request GET http://rag_api:8000/documents/51f164c5-e40f-4c49-8aa7-0a348d49cb3c/context - 200
rag_api-1         | 2025-07-19 19:46:31,206 - root - INFO - Request GET http://rag_api:8000/documents/832dd9f1-d0ba-4f63-841c-94719bf4f9a9/context - 200
rag_api-1         | 2025-07-19 19:46:31,206 - root - INFO - Request GET http://rag_api:8000/documents/74d6b6eb-bb2b-4302-870a-369126fb7542/context - 200
rag_api-1         | 2025-07-19 19:46:31,222 - root - INFO - Request GET http://rag_api:8000/documents/9da06e15-4f42-47ed-b41a-14d3eaa7e930/context - 200
LibreChat-NGINX   | 97.113.86.216 - - [19/Jul/2025:19:46:31 +0000] "GET /c/297f698a-54d0-4334-8716-c1384fc92373 HTTP/2.0" 200 4821 "https://peters-chat.r.internetchen.de/c/297f698a-54d0-4334-8716-c1384fc92373" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
rag_api-1         | 2025-07-19 19:46:31,263 - root - INFO - Request GET http://rag_api:8000/documents/a3b297a3-e9b6-4ea6-8ab7-4bdb5ac4cc8a/context - 200
rag_api-1         | 2025-07-19 19:46:31,267 - root - INFO - Request GET http://rag_api:8000/documents/ad73bed3-33d2-459b-a8e4-03672739ac42/context - 200
rag_api-1         | 2025-07-19 19:46:31,278 - root - INFO - Request GET http://rag_api:8000/documents/959205e9-6719-4688-9555-8fe6600f456d/context - 200
rag_api-1         | 2025-07-19 19:46:31,287 - root - INFO - Request GET http://rag_api:8000/documents/ba30bd64-553d-41fe-a6f6-80dd439b6b43/context - 200
rag_api-1         | 2025-07-19 19:46:31,295 - root - INFO - Request GET http://rag_api:8000/documents/d4b1fe89-ad66-4b7d-af57-dd7cee85df54/context - 200
rag_api-1         | 2025-07-19 19:46:31,299 - root - INFO - Request GET http://rag_api:8000/documents/d5d12b22-807a-466c-a1a7-0ba3ff1a647c/context - 200
rag_api-1         | 2025-07-19 19:46:31,315 - root - INFO - Request GET http://rag_api:8000/documents/e717a123-9847-41c5-b7d5-90c98500f71e/context - 200
rag_api-1         | 2025-07-19 19:46:31,317 - root - INFO - Request GET http://rag_api:8000/documents/fe6a5f70-e50c-4797-8c12-21f0af083996/context - 200
chat-meilisearch  | 2025-07-19T19:46:31.698166Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=4.51ms time.idle=6.97ms
chat-meilisearch  | 2025-07-19T19:46:31.708254Z  INFO HTTP request{method=GET host="meilisearch:7700" route=/indexes/convos/documents/297f698a-54d0-4334-8716-c1384fc92373 query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=1.26ms time.idle=96.6µs
LibreChat-API     | 2025-07-19 19:46:31 error: [api/server/controllers/agents/client.js #sendCompletion] Operation aborted A conversation must start with a user message. Try again with a conversation that starts with a user message.
LibreChat-API     | 2025-07-19 19:46:31 error: [api/server/controllers/agents/client.js #sendCompletion] Unhandled error type A conversation must start with a user message. Try again with a conversation that starts with a user message.
chat-meilisearch  | 2025-07-19T19:46:31.854791Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=401µs time.idle=2.80ms
chat-meilisearch  | 2025-07-19T19:46:31.864171Z  INFO HTTP request{method=GET host="meilisearch:7700" route=/indexes/convos/documents/297f698a-54d0-4334-8716-c1384fc92373 query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=180µs time.idle=149µs
LibreChat-NGINX   | 97.113.86.216 - - [19/Jul/2025:19:46:31 +0000] "POST /api/agents/chat/bedrock HTTP/2.0" 200 2623 "https://peters-chat.r.internetchen.de/c/297f698a-54d0-4334-8716-c1384fc92373" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
chat-meilisearch  | 2025-07-19T19:46:31.876223Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=329µs time.idle=1.97ms
LibreChat-NGINX   | 97.113.86.216 - - [19/Jul/2025:19:46:31 +0000] "GET /c/297f698a-54d0-4334-8716-c1384fc92373 HTTP/2.0" 200 4821 "https://peters-chat.r.internetchen.de/c/297f698a-54d0-4334-8716-c1384fc92373" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
chat-meilisearch  | 2025-07-19T19:46:32.441574Z  INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 4014 }

Screenshots

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

I assume this happens because the attachments and plus prompt do not fit the context window but it seems the attachments are added first and then the prompt so that perahps the prompt is ignored ? It should show the typical errro message:
The model returned the following errors: Input is too long for requested model.

Context is indeed getting exceeded, but I agree the error message could be better. Are you at liberty to share the conversation from export (top-right "share" button)?

[dirkpetersen]

here is an example with 2 large cybersec docs, in this case the context window of Claude is still big enough but Deepseek complains with the message