Skip to content

Magistral: support reasoning #395

@adubovik

Description

@adubovik

The latest Migstral models (magistral-small-latest and magistral-medium-latest) return a list instead of a string in choices[*].delta.content.

This isn't compatible with Chat Completions API, where choices[*].delta.content is a string and only the string.

We need to support this feature in the Mistral adapter.
See for the reference the official doc.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

Status

No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions