Support for grok-3 in Azure OpenAI

[taurit]

What features would you like to see added?

Hey! Microsoft recently added grok-3 model to its Azure AI Foundry offering.

Do you know if this model can be already used right now in LibreChat with proper config, or a support needs to be explicitly added to LibreChat code first? My attempt to use it failed with an error.

More details

I attempted to set it up similarly to other models (which work for me):

endpoints:
  azureOpenAI:
    groups:
      - group: "somethingSomething-eastus2"
        apiKey: "${AZURE_API_KEY}"
        instanceName: "${AZURE_INSTANCE_NAME}"
        assistants: false
        models:
          gpt-4.1:
            deploymentName: gpt-4.1
            version: "2025-01-01-preview"

          # (...)

          grok-3:
            deploymentName: grok-3
            version: "2025-01-01-preview"

When I try to use the prompt I see error in logs:

 2025-05-22T16:23:11.488Z debug: [AskController]
 {
   text: "hey, what model are you?",
   conversationId: "43e00e22-29ff-4cb3-9c60-24743da9ef68",
   endpoint: "azureOpenAI",
   resendFiles: true,
   modelOptions.model: "grok-3",
   modelsConfig: "exists",
 }
 
 2025-05-22T16:23:11.672Z error: [AskController] Error handling request Failed to send message. HTTP 400 - Unsupported data type
 2025-05-22T16:23:11.673Z error: [handleAbortError] AI response error; aborting request: Failed to send message. HTTP 400 - Unsupported data type

Which components are impacted by your request?

No response

Pictures

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

You can add it already:

      - group: "serverless-example"
        apiKey: "${AZURE_SERVERLESS_API_KEY}"
        baseURL: "https://aoai-syourendpoint.services.ai.azure.com/models/"
        version: "2024-05-01-preview"
        serverless: true
        models:
          grok-3: true

More info:

https://www.librechat.ai/docs/configuration/azure#serverless-inference-endpoints

[taurit]

Works indeed, thanks! Librechat is awesome 😊

[danny-avila]

For the record, you can also use Grok 3 (from Azure) as a custom endpoint:

    - name: "azure_xai"
      apiKey: "$AZURE_OAI_API_KEY}"
      baseURL: "https://your-endpoint.ai.azure.com/models/"
      models:
        default: ["grok-3"]
        fetch: true
      titleConvo: true
      titleMethod: "completion"
      titleModel: "grok-beta"
      summarize: false
      summaryModel: "grok-beta"
      forcePrompt: false
      modelDisplayLabel: "Grok"
      headers:
        "api-version": "2024-05-01-preview"