Support for other AI providers (e.g. Azure)

[vernondegoede]

Hi team,

This tool looks super promising and is exactly what we were looking for in our company to get a good understanding of the # of events we are sending + document them.

However, since we are a regulated company, we cannot send our data to OpenAI and we are relying on Azure OpenAI.

Any plans to support other providers soon?

[skarim]

Hey @vernondegoede!

We use the structured outputs functionality from OpenAI, which isn't supported by all providers. It does look like Azure OpenAI recently added support for structured outputs in gpt-4o. OpenAI supports this functionality for gpt-4o-mini, which is faster and more cost-efficient, but if you're ok with the increased cost we can definitely add support for Azure OpenAI's gpt-4o.

Would authentication using an Azure OpenAI API key work for you? I do also see that using Microsoft Entra ID for authentication is recommended, but that looks like it will be harder to integrate into a cli tool like this.