How to implement AzureOpenAI instead of OpenAI?

[2000calories]

OpenAI api key is not working in Hong Kong, AzureOpenAI does. How to implement AzureOpenAI instead of OpenAI?

[szymondudycz]

You can use LiteLLM, which supports Azure OpenAI. For that you'd configure app.yaml with

$llm: !pw.xpacks.llm.llms.LiteLLMChat
  model: "azure/<your deployment name>"

and set environmental variables AZURE_API_KEY, AZURE_API_BASE and AZURE_API_VERSION.

You can also provide these values as arguments to LiteLLM rather than env variables, more information in LiteLLM docs: https://docs.litellm.ai/docs/providers/azure

[2000calories]

thanks