Skip to content

DevstralMedium Claimed to Not Support Documents, But Does #1482

@commonsguy

Description

@commonsguy

In Koog 0.6.2, the DevstralMedium model is defined as:

        public val DevstralMedium: LLModel = LLModel(
            provider = LLMProvider.MistralAI,
            id = "devstral-medium-latest",
            capabilities = listOf(
                LLMCapability.Temperature,
                LLMCapability.Completion,
                LLMCapability.Tools,
                LLMCapability.ToolChoice,
                LLMCapability.Schema.JSON.Basic,
                LLMCapability.Schema.JSON.Standard
            ),
            contextLength = 128_000
        )

The capabilities collection lacks LLMCapability.Document. However, Devstral seems to support it. I tried augmenting the pre-defined LLModel to add it:

MistralAIModels.Chat.DevstralMedium.copy(
      capabilities =
        MistralAIModels.Chat.DevstralMedium.capabilities +
          LLMCapability.Document
    )

I then used the augmented model to review a Kotlin source file using textFile() (MIME type of text/x-kotlin), and it worked fine. If I tried using textFile() with the original DevstralMedium, I got an error complaining that documents are not supported with that model.

Is there a reason why DevstralMedium lacks LLMCapability.Document in its capabilities? If this is just an oversight, I can prepare a PR to add LLMCapability.Document in, if you would like.

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions