You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The AKS Agent uses YAML configuration files to define LLM connections. Each configuration contains a provider specification and the required environment variables for that provider.
The LiteLLM provider route that determines which LLM service to use. This follows the LiteLLM provider specification from https://docs.litellm.ai/docs/providers.
62
+
63
+
Common values:
64
+
65
+
* ``azure`` - Azure OpenAI Service
66
+
* ``openai`` - OpenAI API and OpenAI-compatible APIs (e.g., local models, other services)
67
+
* ``anthropic`` - Anthropic Claude
68
+
* ``gemini`` - Google's Gemini
69
+
* ``openai_compatible`` - OpenAI-compatible APIs (e.g., local models, other services)
70
+
71
+
**MODEL_NAME**
72
+
The specific model or deployment name to use. This varies by provider:
73
+
74
+
* For Azure OpenAI: Your deployment name (e.g., ``gpt-4.1``, ``gpt-35-turbo``)
75
+
* For OpenAI: Model name (e.g., ``gpt-4``, ``gpt-3.5-turbo``)
76
+
* For other providers: Check the specific model names in LiteLLM documentation
77
+
78
+
**Environment Variables by Provider**
79
+
80
+
The remaining fields are environment variables required by each provider. These correspond to the authentication and configuration requirements of each LLM service:
81
+
82
+
**Azure OpenAI (provider: azure)**
83
+
* ``AZURE_API_KEY`` - Your Azure OpenAI API key
84
+
* ``AZURE_API_BASE`` - Your Azure OpenAI endpoint URL (e.g., https://your-resource.openai.azure.com/)
85
+
* ``AZURE_API_VERSION`` - API version (e.g., 2024-02-01, 2025-04-01-preview)
86
+
87
+
**OpenAI (provider: openai)**
88
+
* ``OPENAI_API_KEY`` - Your OpenAI API key (starts with sk-)
89
+
90
+
**Gemini (provider: gemini)**
91
+
* ``GOOGLE_API_KEY`` - Your Google Cloud API key
92
+
* ``GOOGLE_API_ENDPOINT`` - Base URL for the Gemini API endpoint
0 commit comments