You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
## Changes
Add more model serving examples
## Tests
<!--
How is this tested? Please see the checklist below and also describe any
other relevant tests
-->
- [x] relevant change in `docs/` folder
@@ -67,7 +141,7 @@ The following arguments are supported:
67
141
*`config` - The config for the external model, which must match the provider. *Note that API keys could be provided either as a reference to the Databricks Secret (parameters without `_plaintext` suffix) or in plain text (parameters with `_plaintext` suffix)!*
68
142
*`ai21labs_config` - AI21Labs Config
69
143
*`ai21labs_api_key` - The Databricks secret key reference for an AI21Labs API key.
70
-
*`ai21labs_api_key_plaintext` - An AI21 Labs API key provided as a plaintext string.
144
+
*`ai21labs_api_key_plaintext` - An AI21 Labs API key provided as a plaintext string.
71
145
*`anthropic_config` - Anthropic Config
72
146
*`anthropic_api_key` - The Databricks secret key reference for an Anthropic API key.
73
147
*`anthropic_api_key_plaintext` - The Anthropic API key provided as a plaintext string.
@@ -108,7 +182,7 @@ The following arguments are supported:
108
182
*`microsoft_entra_client_secret` - The Databricks secret key reference for a client secret used for Microsoft Entra ID authentication.
109
183
*`microsoft_entra_client_secret_plaintext` - The client secret used for Microsoft Entra ID authentication provided as a plaintext string.
110
184
*`microsoft_entra_tenant_id` - This field is only required for Azure AD OpenAI and is the Microsoft Entra Tenant ID.
111
-
*`openai_api_base` - This is the base URL for the OpenAI API (default: "https://api.openai.com/v1"). For Azure OpenAI, this field is required and is the base URL for the Azure OpenAI API service provided by Azure.
185
+
*`openai_api_base` - This is the base URL for the OpenAI API (default: "<https://api.openai.com/v1>"). For Azure OpenAI, this field is required and is the base URL for the Azure OpenAI API service provided by Azure.
112
186
*`openai_api_version` - This is an optional field to specify the OpenAI API version. For Azure OpenAI, this field is required and is the version of the Azure OpenAI service to utilize, specified by a date.
113
187
*`openai_organization` - This is an optional field to specify the organization in OpenAI or Azure OpenAI.
114
188
*`openai_deployment_name` - This field is only required for Azure OpenAI and is the name of the deployment resource for the Azure OpenAI service.
@@ -172,7 +246,7 @@ The following arguments are supported:
172
246
*`valid_topics` - The list of allowed topics. Given a chat request, this guardrail flags the request if its topic is not in the allowed topics.
173
247
*`safety` - the boolean flag that indicates whether the safety filter is enabled.
174
248
*`pii` - Block with configuration for guardrail PII filter:
175
-
*`behavior` - a string that describes the behavior for PII filter. Currently only `BLOCK` value is supported.
249
+
*`behavior` - a string that describes the behavior for PII filter. Currently only `BLOCK` value is supported.
176
250
*`output` - A block with configuration for output guardrail filters. Has the same structure as `input` block.
177
251
*`rate_limits` - (Optional) Block describing rate limits for AI gateway. For details see the description of `rate_limits` block above.
178
252
*`usage_tracking_config` - (Optional) Block with configuration for payload logging using inference tables. For details see the description of `auto_capture_config` block above.
@@ -219,5 +293,3 @@ The following resources are often used in the same context:
219
293
*[databricks_notebook](notebook.md) to manage [Databricks Notebooks](https://docs.databricks.com/notebooks/index.html).
220
294
*[databricks_notebook](../data-sources/notebook.md) data to export a notebook from Databricks Workspace.
221
295
*[databricks_repo](repo.md) to manage [Databricks Repos](https://docs.databricks.com/repos.html).
0 commit comments