Support reponse_format #162
Description
Is your feature request related to a problem? Please describe.
Currently, Bedrock Access Gateway does not support the response_format parameter (e.g., response_format={"type": "json_object"}), which is increasingly important for applications that rely on structured model output. Without this support, clients cannot utilize model features such as returning structured JSON objects, which limits integration with tools or systems expecting machine-readable responses.
Describe the feature you'd like
Add support for the response_format parameter in the request payload, especially for models that support structured output (such as OpenAI-compatible or Claude models that return JSON via response_format={"type": "json_object"}). This would allow clients to specify that the model should return a JSON object instead of plain text, enabling safer and more predictable downstream parsing.
Additional context
This feature is already supported in OpenAI's API and by some Claude models via Anthropic. Adding it to Bedrock Access Gateway would increase compatibility and enable broader use cases like structured agents, code generation, and JSON-based automation workflows.
Reference