You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/search/cognitive-search-aml-skill.md
+8-4Lines changed: 8 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,19 +10,23 @@ ms.custom:
10
10
- ignite-2023
11
11
- build-2024
12
12
ms.topic: reference
13
-
ms.date: 05/28/2024
13
+
ms.date: 06/26/2024
14
14
---
15
15
16
16
# AML skill in an Azure AI Search enrichment pipeline
17
17
18
-
> [!IMPORTANT]
19
-
> This skill is in public preview under [supplemental terms of use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [preview REST API](/rest/api/searchservice/index-preview) supports this skill.
18
+
> [!IMPORTANT]
19
+
> This skill is in public preview under [supplemental terms of use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). Preview REST APIs support this skill.
20
20
21
21
The **AML** skill allows you to extend AI enrichment with a custom [Azure Machine Learning (AML)](../machine-learning/overview-what-is-azure-machine-learning.md) model. Once an AML model is [trained and deployed](../machine-learning/concept-azure-machine-learning-architecture.md#workspace), an **AML** skill integrates it into AI enrichment.
22
22
23
23
Like other built-in skills, an **AML** skill has inputs and outputs. The inputs are sent to your deployed AML online endpoint as a JSON object, which outputs a JSON payload as a response along with a success status code. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed. The response is expected to have the outputs specified by your **AML** skill. Any other response is considered an error and no enrichments are performed.
24
24
25
-
If you're using the [Azure AI Studio model catalog vectorizer (preview)](vector-search-vectorizer-azure-machine-learning-ai-studio-catalog.md) for integrated vectorization at query time, you should also use the **AML** skill for integrated vectorization during indexing. See [How to implement integrated vectorization using models from Azure AI Studio](vector-search-integrated-vectorization-ai-studio.md) for instructions. This scenario is supported through the 2024-05-01-preview REST API and the Azure portal.
25
+
The **AML** skill is a preview feature, but depending on the endpoint, you can call it in a skillset that targets a stable API version. For example, if the endpoint is a deployed model in an AML workspace, the skillset can be created using 2023-11-01 stable API, and the **AML** skill works even though it is a preview feature.
26
+
27
+
Starting in 2024-05-01-preview REST API and in the Azure portal (which also targets the 2024-05-01-preview), you can use the **AML** skill to connect to a model in the Azure AI Studio model catalog. For this paticular endpoint, your skillset must target the 2024-05-01-preview API version.
28
+
29
+
Connections to models hosted in the Azure AI Studio model catalog are supported for integrated vectorization workflows. This workflow generates embeddings automatically at indexing and query time. During indexing, the **AML** skill can connect to the model catalog to generate vectors for the index. At query time, queries can target the [Azure AI Studio model catalog vectorizer](vector-search-vectorizer-azure-machine-learning-ai-studio-catalog.md) that vectorizes a text input so that it can be used in a vector query. In this workflow, the **AML** skill and the model catalog vectorizer should be used together so that you're using the same embedding model for both indexing and queries. See [How to implement integrated vectorization using models from Azure AI Studio](vector-search-integrated-vectorization-ai-studio.md) for details on this workfow.
26
30
27
31
> [!NOTE]
28
32
> The indexer will retry twice for certain standard HTTP status codes returned from the AML online endpoint. These HTTP status codes are:
Copy file name to clipboardExpand all lines: articles/search/search-api-preview.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,13 +28,13 @@ Preview features are removed from this list if they're retired or transition to
28
28
|[**Scalar quantization**](vector-search-how-to-configure-compression-storage.md#option-1-configure-scalar-quantization)| Index | Compress vector index size in memory and on disk using built-in scalar quantization. |[Create or Update Index (preview)](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true) to add a `compressions` section to a vector profile. |
29
29
|[**Narrow data types**](vector-search-how-to-configure-compression-storage.md#option-2-assign-narrow-data-types-to-vector-fields)| Index | Assign a smaller data type on vector fields, assuming incoming data is of that data type. |[Create or Update Index (preview)](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true) to specify a vector field definition. [Binary vector support](vector-search-how-to-index-binary-data.md) is added in 2024-05-01-preview.|
30
30
|[**stored property**](vector-search-how-to-configure-compression-storage.md#option-3-set-the-stored-property-to-remove-retrievable-storage)| Index | Boolean that reduces storage of vector indexes by *not* storing retrievable vectors. |[Create or Update Index (preview)](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true) to set `stored` on a vector field. |
31
-
|[**Vectorizers**](vector-search-integrated-vectorization.md)| Queries | Text-to-vector conversion during query execution. |[Create or Update Index (preview)](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true) to define a `vectorizer`. [Search POST (preview)](/rest/api/searchservice/documents/search-post?view=rest-searchservice-2024-05-01-preview&preserve-view=true) for `vectorQueries`. |
31
+
|[**Vectorizers**](vector-search-integrated-vectorization.md)| Queries | Text-to-vector conversion during query execution. |[Create or Update Index (preview)](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true) to define a `vectorizer`. [Search POST (preview)](/rest/api/searchservice/documents/search-post?view=rest-searchservice-2024-05-01-preview&preserve-view=true) for `vectorQueries`. Vectorizers should be paired with an equivalent skill that supports integrated vectorization during indexing(AzureOpenAIEmbedding, Azure AI Vision multimodal, AML for models in the Azure AI Studio model catalog). Always use the same embedding model for queries and indexing. |
32
32
|[**Integrated vectorization**](vector-search-integrated-vectorization.md)| Index, skillset | Skills-driven data chunking and embedding during indexing. |[Create or Update Skillset (preview)](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true) for AzureOpenAIEmbedding skill and the data chunking properties of the Text Split skill. |
33
33
|[**Import and vectorize data**](search-get-started-portal-import-vectors.md)| Azure portal | A wizard that creates a full indexing pipeline that includes data chunking and vectorization. The wizard creates all of the objects and configuration settings. | Available on all search services, in all regions. |
34
34
|[**AzureOpenAIEmbedding skill**](cognitive-search-skill-azure-openai-embedding.md)| Applied AI (skills) | A new skill type that calls Azure OpenAI embedding model to generate embeddings during queries and indexing. |[Create or Update Skillset (preview)](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true). Also available in the portal through the [Import and vectorize data wizard](search-get-started-portal-import-vectors.md). |
35
35
|[**Azure AI Vision multimodal embedding skill**](cognitive-search-skill-vision-vectorize.md)| Applied AI (skills) | A new skill type that calls Azure AI Vision multimodal API to generate embeddings for text or images during indexing. |[Create or Update Skillset (preview)](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true). |
36
36
|[**Text Split skill**](cognitive-search-skill-textsplit.md)| Applied AI (skills) | Text Split has two new chunking-related properties in preview: `maximumPagesToTake`, `pageOverlapLength`. |[Create or Update Skillset (preview)](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true). Also available in the portal through the [Import and vectorize data wizard](search-get-started-portal-import-vectors.md). |
37
-
|[**Azure Machine Learning (AML) skill**](cognitive-search-aml-skill.md)| Applied AI (skills) |A new skill type to integrate an inferencing endpoint from Azure Machine Learning. |[Create or Update Skillset (preview)](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true). Starting in the 2024-05-01-preview, you can use this skill to connect to a model in the Azure AI Studio model catalog. It's also available in the portal, in skillset design, assuming Azure AI Search and Azure Machine Learning services are deployed in the same subscription. |
37
+
|[**Azure Machine Learning (AML) skill**](cognitive-search-aml-skill.md)| Applied AI (skills) |AML skill integrates an inferencing endpoint from Azure Machine Learning. |[Create or Update Skillset (preview)](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true). In previous preview APIs, it supports connections to deployed custom models in an AML workspace. Starting in the 2024-05-01-preview, you can use this skill to connect to a model in the Azure AI Studio model catalog. It's also available in the portal, in skillset design, assuming Azure AI Search and Azure Machine Learning services are deployed in the same subscription. |
38
38
|[**Incremental enrichment**](cognitive-search-incremental-indexing-conceptual.md)| Applied AI (skills) | Adds caching to an enrichment pipeline, allowing you to reuse existing output if a targeted modification, such as an update to a skillset or another object, doesn't change the content. Caching applies only to enriched documents produced by a skillset.|[Create or Update Indexer (preview)](/rest/api/searchservice/indexers/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true). |
39
39
|[**Index projections**](index-projections-concept-intro.md)| Applied AI (skills) | A component of a skillset definition that defines the shape of a secondary index, supporting a one-to-many index pattern, where content from an enrichment pipeline can target multiple indexes.|[Create or Update Skillset (preview)](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true). Also available in the portal through the [Import and vectorize data wizard](search-get-started-portal-import-vectors.md). |
40
40
|[**OneLake files indexer**](search-how-to-index-onelake-files.md)| Indexer data source | New data source for extracting searchable data and metadata data from a [lakehouse](/fabric/onelake/create-lakehouse-onelake) on top of [OneLake](/fabric/onelake/onelake-overview)|[Create or Update Data Source (preview)](/rest/api/searchservice/data-sources/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true). |
0 commit comments