Azure Mistral - Error 422

[THByte]

Hi everyone,

we face an issue with Mistral hosted serverless on MS Azure.
If we are using presets in a chat we get the following error message:

Something went wrong. Here's the specific error message we encountered: 422 {"detail":[{"type":"extra_forbidden","loc":["body","messages",0,"system","name"],"msg":"Extra inputs are not permitted","input":"instructions"}]}

I could pin the error down the body of the HTTP POST request to the Azure API:

    "messages": [
    {
        "role": "system",
        "name": "instructions",  // If this is dropped the request works 
        "content": "You are a helpful assistant"
    },
    {
        "role": "user",
        "content": "Explain Riemann's conjecture in 1 paragraph"
    }
    ],
    "temperature": 0,
    "top_p": 1,
    "response_format": { "type": "text" },
    "safe_prompt": true
}

If the objects in the messages body only contain the keys role and content the request works.
I tried to use extra-parameters: drop as described in the Azure API description. However this doesn't fix the issue.

Is there any possibility to drop the parameter on Librechat side? I saw the dropParams configuration but I think it does not work on nested objects in messages array.

Thanks a lot for the help.

Our configuration:

- group: "mistral-large-inference"
            apiKey: "..."
            baseURL: ".../v1/chat/completions"
            serverless: true
            headers:
              extra-parameters: "drop"
            modelDisplayLabel: "Mistral"
            dropParams: ["stop", "user", "frequency_penalty", "presence_penalty"]
            # Model-level configuration
            models:
              mistral-large: true

[fbaeumer]

Same Situation here!

Something went wrong. Here's the specific error message we encountered: 422 {"detail":[{"type":"extra_forbidden","loc":["body","messages",0,"system","name"],"msg":"Extra inputs are not permitted","input":"instructions"}]}

- name: 'Mistral AI' # ForapiKeyandbaseURL, you can use environment variables that you define. # recommended environment variables: # Known issue: you should not use OPENROUTER_API_KEYas it will then override theopenAI endpoint to use OpenRouter as well. apiKey: 'xxxx' baseURL: "xxxx.swedencentral.models.ai.azure.com/v1/chat/completions" models: default: ['Large'] fetch: false titleConvo: true titleModel: XXXX # Recommended: Drop the stop parameter from the request as Openrouter models use a variety of stop tokens. dropParams: ['instructions', 'body', 'user', 'name'] modelDisplayLabel: 'Mistral AI' iconURL: XXXX

[iwgth]

Hi!
The problem is that dropParams does not work on nested lists that are simply attached, and in order to take all the necessary parameters from the request, you need to change api/app/clients/OpenAIClient.js.
In the original code in the chatCompletion method:

if (this.options.dropParams && Array.isArray(this.options.dropParams)) {
    this.options.dropParams.forEach((param) => {
        delete modelOptions[param];
    });
}

should be replaced with this code:

if (this.options.dropParams && Array.isArray(this.options.dropParams)) {
    this.options.dropParams.forEach((param) => {
        delete modelOptions[param];
        // Additional check to remove "name" in nested "messages"
        if (param === 'name' && modelOptions.messages) {
            modelOptions.messages.forEach((message) => {
                if (message.role === 'system' && message.name) {
                    delete message.name;
                }
            });
        }
    });
    logger.debug('[OpenAIClient] chatCompletion: dropped params', {
        dropParams: this.options.dropParams,
        modelOptions,
    });
}