[Question]: How to configure your own data source

[gercograndia]

What is your question?

Hi,

We have an Azure Open AI service which we want to query with our own data that resides in AI Search.

I have tried a lot of things trying to get the same with librechat but at no avail yet. For clarity: connecting to Azure OpenAI works, but our own data does not show up.

Can you advise please?

More Details

Using the (python) SDK we would use the extra_body for this, something as follows:

    completion = client.chat.completions.create(
        model=deployment,
        response_format={ "type": "json_object" },
        messages=[
            {
                "role": "system",
                "content": system_prompt
            },
            {
                "role": "user",
                "content": user_prompt,
            },
        ],
        extra_body={
            "dataSources": [
                {
                    "type": "AzureCognitiveSearch",
                    "parameters": {
                        "endpoint": os.environ["AZURE_AI_SEARCH_ENDPOINT"],
                        "key": os.environ["AZURE_AI_SEARCH_API_KEY"],
                        "indexName": os.environ["AZURE_AI_SEARCH_INDEX"]
                    }
                }
            ]
        },
        temperature=0,
        max_tokens=800,
        frequency_penalty=0.1,
        presence_penalty=0
    )

What is the main subject of your question?

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct