You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/resources/model_serving.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -58,7 +58,7 @@ The following arguments are supported:
58
58
59
59
*`name` - The name of a served entity. It must be unique across an endpoint. A served entity name can consist of alphanumeric characters, dashes, and underscores. If not specified for an external model, this field defaults to `external_model.name`, with '.' and ':' replaced with '-', and if not specified for other entities, it defaults to -.
60
60
*`external_model` - The external model to be served. NOTE: Only one of `external_model` and (`entity_name`, `entity_version`, `workload_size`, `workload_type`, and `scale_to_zero_enabled`) can be specified with the latter set being used for custom model serving for a Databricks registered model. When an `external_model` is present, the served entities list can only have one `served_entity` object. For an existing endpoint with `external_model`, it can not be updated to an endpoint without `external_model`. If the endpoint is created without `external_model`, users cannot update it to add `external_model` later.
61
-
*`provider` - (Required) The name of the provider for the external model. Currently, the supported providers are `ai21labs`, `anthropic`, `aws-bedrock`, `cohere`, `databricks-model-serving`, `openai`, and `palm`.
61
+
*`provider` - (Required) The name of the provider for the external model. Currently, the supported providers are `ai21labs`, `anthropic`, `amazon-bedrock`, `cohere`, `databricks-model-serving`, `openai`, and `palm`.
62
62
*`name` - The name of the external model.
63
63
*`task` - The task type of the external model.
64
64
*`config` - The config for the external model, which must match the provider.
@@ -67,11 +67,11 @@ The following arguments are supported:
67
67
*`anthropic_config` - Anthropic Config
68
68
*`anthropic_api_key` - The Databricks secret key reference for an Anthropic API key.
69
69
The Databricks secret key reference for an Anthropic API key.
70
-
*`aws_bedrock_config` - AWS Bedrock Config
70
+
*`amazon_bedrock_config` - Amazon Bedrock Config
71
71
*`aws_region` - The AWS region to use. Bedrock has to be enabled there.
72
72
*`aws_access_key_id` - The Databricks secret key reference for an AWS Access Key ID with permissions to interact with Bedrock services.
73
73
*`aws_secret_access_key` - The Databricks secret key reference for an AWS Secret Access Key paired with the access key ID, with permissions to interact with Bedrock services.
74
-
*`bedrock_provider` - The underlying provider in AWS Bedrock. Supported values (case insensitive) include: `Anthropic`, `Cohere`, `AI21Labs`, `Amazon`.
74
+
*`bedrock_provider` - The underlying provider in Amazon Bedrock. Supported values (case insensitive) include: `Anthropic`, `Cohere`, `AI21Labs`, `Amazon`.
75
75
*`cohere_config` - Cohere Config
76
76
*`cohere_api_key` - The Databricks secret key reference for a Cohere API key.
77
77
*`databricks_model_serving_config` - Databricks Model Serving Config
0 commit comments