Azure Foundry endpoint not working

[loureirodnl]

What happened?

Hello

Did Azure AI Foundry changed anything recently ?

Because I'm following exactly the explanations on discussion #5924 but I'm having the following error :

Version: LibreChat v0.7.7 using docker compose and @rubentalstra suggested librechat.yml config in #5924

error: [OpenAIClient.chatCompletion] Unhandled error type Invalid URL
error: [handleAbortError] AI response error; aborting request: Invalid URL

I tried everything that is explained in this discussion but nothing worked

My Azure AI Foundry setup :

Thank you for your help

Linked to discussion: #5924

Version Information

docker images | grep librechat
ghcr.io/danny-avila/librechat-dev                                                                latest             2947f02d5e16   2 weeks ago     876MB

Steps to Reproduce

Put the following config in librechat.yaml

endpoints:
  azureOpenAI:
    groups:
      - group: "DeepSeek-R1"
        apiKey: "${AZURE_DEEPSEEK_API_KEY}"
        baseURL: "https://XXXX.services.ai.azure.com/models/"
        version: "2024-05-01-preview"
        serverless: true
        models:
          DeepSeek-R1: true

Relevant log output

error: [OpenAIClient.chatCompletion] Unhandled error type Invalid URL
error: [handleAbortError] AI response error; aborting request: Invalid URL

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

For me, it works with the v1 endpoint they give:

    - group: "Azure AI Foundry"
      assistants: false 
      apiKey: "${AZURE_DEEPSEEK_API_KEY}"
      baseURL: "https://my-private-endpoint.models.ai.azure.com/v1/"
      version: "2024-08-01-preview"
      serverless: true
      models:
        DeepSeek-R1:
          deploymentName: "DeepSeek-R1"

[loureirodnl]

Hello @danny-avila
Thank you very much for helping me on that !
I mimicked exactly your configuration and I still have the same error :

Is it possible that .models.ai.azure.com/v1/ endpoint is outdated ? Because I created the DeepSeek endpoint few days ago and I don't have the choice to use this endpoint. They display me only the /models endpoint :

Could it be possible that the Deepseek endpoint you have created on your side is an older one than mine and is still implementing older API ?

Thanks