Use endpoints from Infomaniak llm

[Alexconquer]

Hello,

I have a problem. I have not found a solution for running LibreChat.

I tested many variations in the setting. There was no result... only one code response : 422

2024-09-27T22:12:11.597Z` warn: [OpenAIClient.chatCompletion][create] API error

2024-09-27T22:12:11.598Z error: [OpenAIClient.chatCompletion] Unhandled error type Error: 422 {"code":"validation_failed","description":"Validation failed","errors":[{"code":"validat... [truncated]

2024-09-27T22:12:11.598Z error: [handleAbortError] AI response error; aborting request: Error: 422 {"code":"validation_failed","description":"Validation failed","errors":[{"code":"va... [truncated]

My custom endpoints :

custom:
    - name: 'Infomaniak'
      apiKey: '${INFOMANIAK_API_KEY}'
      baseURL: 'https://api.infomaniak.com/1/ai/XXXXXX/openai'
      models:
        default:
          [
            'llama3',
            'mixtral',
            'mixtral8x22b',
          ]
        fetch: false
      titleConvo: true
      titleModel: 'Infomaniak'

https://developer.infomaniak.com/docs/api/post/1/ai/%7Bproduct_id%7D/openai/chat/completions

I don't understand why... help ? Thanks.

[fuegovic]

try with directEndpoint: true

see: https://www.librechat.ai/docs/configuration/librechat_yaml/object_structure/custom_endpoint#directendpoint

[Alexconquer]

Thank you for your answers but, the same error.

With this :

custom:
    - name: 'Infomaniak'
      apiKey: 'MY_API_KEY'
      baseURL: 'https://api.infomaniak.com/1/ai/XXXXXX/openai/chat/completions'
      models:
        default:
          [
            'llama3',
            'mixtral',
            'mixtral8x22b',
          ]
        fetch: false
      titleConvo: true
      titleModel: 'Infomaniak'
      directEndpoint: true

Or with baseURL: 'https://api.infomaniak.com/1/ai/XXXXXX/openai'

Same error 422

Debug log

2024-09-28T09:57:18.258Z debug: [OpenAIClient] chatCompletion

{

  baseURL: "https://api.infomaniak.com/1/ai/XXXXXX/openai/chat/completions",

    modelOptions.model: "mixtral",

    modelOptions.user: "XXXXXXXXXXXXXXXXXX",

    modelOptions.stream: true,

    // 2 message(s)

    modelOptions.messages: [{"role":"system","name":"instructions","content":"Instructions:\nThe assistant can create and refere... [truncated],{"role":"user","content":"coucou"}],

}

2024-09-28T09:57:18.263Z debug: Making request to https://api.infomaniak.com/1/ai/XXXXXX/openai/chat/completions

2024-09-28T09:57:18.273Z debug: [saveConvo] api/app/clients/BaseClient.js - saveMessageToDatabase #saveConvo

2024-09-28T09:57:18.522Z warn: [OpenAIClient.chatCompletion][stream] API error

2024-09-28T09:57:18.523Z error: [handleAbortError] AI response error; aborting request: 422 {"code":"validation_failed","description":"Validation failed","errors":[{"code":"validatio... [truncated]

2024-09-28T09:57:18.530Z debug: [AskController] Request closed

XXXXXX is my product_id from admin dashboard and a good api key.

I tested these parameters on direct HTTP request. All is good, not in Librechat.

Could this error be from the body's content?

[Alexconquer]

Hello, does anyone have any ideas?

[Alexconquer]

Hello, this is solved with V0.7.6. Thanks