Skip to content

Investigate structured outputs support in OpenAI-based integrations #9761

@Amnah199

Description

@Amnah199

With this PR , we introduced support for structured outputs in OpenAIChatGenerator and AzureOpenAIChatGenerator. We should now investigate whether other chat generators that inherit from OpenAIChatGenerator also support structured outputs via response_format using pydantic models or schema.

If support exists (or can be added), we should:

  • Document this clearly in the component docstrings.
  • Add tests to ensure structured output is handled properly.

Integrations to explore:

  • MistralChatGenerator
  • OpenRouterChatGenerator
  • NvidiaChatGenerator
  • MetaLlamaChatGenerator
  • LlamaStackChatGenerator
  • STACKITChatGenerator
  • TogetherAIChatGenerator

Metadata

Metadata

Assignees

Labels

P1High priority, add to the next sprint

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions