Chat Comparison Azure & Bedrock

[reramjiawan]

What happened?

When doing a chat comparison with Azure Open AI and Bedrock. Bedrock fails to generate a response.

Steps to Reproduce

1.) Select Bedrock
2.) Move to Azure Open AI Chat
3.) Ask to write a poem
4.) Fails to generate a poem in Bedrock

What browsers are you seeing the problem on?

No response

Relevant log output

{"$fault":"server","$metadata":{},"level":"error","message":"[api/server/controllers/agents/client.js #sendCompletion] Unhandled error type Bedrock is unable to process your request.","name":"ServiceUnavailableException","stack":"ServiceUnavailableException: Bedrock is unable to process your request.\n    at de_ServiceUnavailableExceptionRes (/app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1170:21)\n    at de_ServiceUnavailableException_event (/app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1382:10)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async /app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1259:38\n    at async Object.deserializer (/app/node_modules/@smithy/eventstream-serde-universal/dist-cjs/index.js:127:37)\n    at async _SmithyMessageDecoderStream.asyncIterator (/app/node_modules/@smithy/eventstream-serde-universal/node_modules/@smithy/eventstream-codec/dist-cjs/index.js:430:28)\n    at async ChatBedrockConverse._streamResponseChunks (/app/node_modules/@langchain/aws/dist/chat_models.cjs:697:30)\n    at async ChatBedrockConverse._generateUncached (/app/node_modules/@langchain/aws/node_modules/@langchain/core/dist/language_models/chat_models.cjs:157:34)\n    at async ChatBedrockConverse.invoke (/app/node_modules/@langchain/aws/node_modules/@langchain/core/dist/language_models/chat_models.cjs:60:24)\n    at async RunnableLambda.func (/app/node_modules/@librechat/agents/dist/cjs/graphs/Graph.cjs:214:34)"}
{"$fault":"server","$metadata":{},"level":"error","message":"[handleAbortError] AI response error; aborting request: Bedrock is unable to process your request.","name":"ServiceUnavailableException","stack":"ServiceUnavailableException: Bedrock is unable to process your request.\n    at de_ServiceUnavailableExceptionRes (/app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1170:21)\n    at de_ServiceUnavailableException_event (/app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1382:10)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async /app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1259:38\n    at async Object.deserializer (/app/node_modules/@smithy/eventstream-serde-universal/dist-cjs/index.js:127:37)\n    at async _SmithyMessageDecoderStream.asyncIterator (/app/node_modules/@smithy/eventstream-serde-universal/node_modules/@smithy/eventstream-codec/dist-cjs/index.js:430:28)\n    at async ChatBedrockConverse._streamResponseChunks (/app/node_modules/@langchain/aws/dist/chat_models.cjs:697:30)\n    at async ChatBedrockConverse._generateUncached (/app/node_modules/@langchain/aws/node_modules/@langchain/core/dist/language_models/chat_models.cjs:157:34)\n    at async ChatBedrockConverse.invoke (/app/node_modules/@langchain/aws/node_modules/@langchain/core/dist/language_models/chat_models.cjs:60:24)\n    at async RunnableLambda.func (/app/node_modules/@librechat/agents/dist/cjs/graphs/Graph.cjs:214:34)"}

Screenshots

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

I don’t get this error, it’s something to do with your bedrock configuration, or perhaps the exact parameters being used.

in any case, this endpoint doesn’t support chat comparison yet, it’s something I’m addressing this week.