You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/search/cognitive-search-aml-skill.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ ms.custom:
10
10
- ignite-2023
11
11
- build-2024
12
12
ms.topic: reference
13
-
ms.date: 05/08/2024
13
+
ms.date: 05/28/2024
14
14
---
15
15
16
16
# AML skill in an Azure AI Search enrichment pipeline
@@ -20,7 +20,7 @@ ms.date: 05/08/2024
20
20
21
21
The **AML** skill allows you to extend AI enrichment with a custom [Azure Machine Learning](../machine-learning/overview-what-is-azure-machine-learning.md) (AML) model. Once an AML model is [trained and deployed](../machine-learning/concept-azure-machine-learning-architecture.md#workspace), an **AML** skill integrates it into AI enrichment.
22
22
23
-
Like other built-in skills, an **AML** skill has inputs and outputs. The inputs are sent to your deployed AML online endpoint as a JSON object, which outputs a JSON payload as a response along with a success status code. The response is expected to have the outputs specified by your **AML** skill. Any other response is considered an error and no enrichments are performed.
23
+
Like other built-in skills, an **AML** skill has inputs and outputs. The inputs are sent to your deployed AML online endpoint as a JSON object, which outputs a JSON payload as a response along with a success status code. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed. The response is expected to have the outputs specified by your **AML** skill. Any other response is considered an error and no enrichments are performed.
24
24
25
25
If you're using the [Azure AI Studio model catalog vectorizer (preview)](vector-search-vectorizer-azure-machine-learning-ai-studio-catalog.md) for integrated vectorization at query time, you should also use the **AML** skill for integrated vectorization during indexing. See [How to implement integrated vectorization using models from Azure AI Studio](vector-search-integrated-vectorization-ai-studio.md) for instructions. This scenario is supported through the 2024-05-01-preview REST API and the Azure portal.
Copy file name to clipboardExpand all lines: articles/search/cognitive-search-custom-skill-interface.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,12 +8,12 @@ ms.service: cognitive-search
8
8
ms.custom:
9
9
- ignite-2023
10
10
ms.topic: how-to
11
-
ms.date: 04/25/2024
11
+
ms.date: 05/28/2024
12
12
---
13
13
14
14
# Add a custom skill to an Azure AI Search enrichment pipeline
15
15
16
-
An [AI enrichment pipeline](cognitive-search-concept-intro.md) can include both [built-in skills](cognitive-search-predefined-skills.md) and [custom skills](cognitive-search-custom-skill-web-api.md) that you personally create and publish. Your custom code executes externally from the search service (for example, as an Azure function), but accepts inputs and sends outputs to the skillset just like any other skill.
16
+
An [AI enrichment pipeline](cognitive-search-concept-intro.md) can include both [built-in skills](cognitive-search-predefined-skills.md) and [custom skills](cognitive-search-custom-skill-web-api.md) that you personally create and publish. Your custom code executes externally from the search service (for example, as an Azure function), but accepts inputs and sends outputs to the skillset just like any other skill. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
17
17
18
18
Custom skills might sound complex but can be simple and straightforward in terms of implementation. If you have existing packages that provide pattern matching or classification models, the content you extract from blobs could be passed to these models for processing. Since AI enrichment is Azure-based, your model should be on Azure also. Some common hosting methodologies include using [Azure Functions](cognitive-search-create-custom-skill-example.md) or [Containers](https://github.com/Microsoft/SkillsExtractorCognitiveSearch).
Copy file name to clipboardExpand all lines: articles/search/cognitive-search-skill-azure-openai-embedding.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,15 +9,15 @@ ms.custom:
9
9
- ignite-2023
10
10
- build-2024
11
11
ms.topic: reference
12
-
ms.date: 05/08/2024
12
+
ms.date: 05/28/2024
13
13
---
14
14
15
15
# Azure OpenAI Embedding skill
16
16
17
17
> [!IMPORTANT]
18
18
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2023-10-01-preview REST API](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2023-10-01-preview&preserve-view=true) supports the first iteration of this feature. The [2024-05-01-preview REST API](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true) adds more properties and supports more text embedding models on Azure OpenAI.
19
19
20
-
The **Azure OpenAI Embedding** skill connects to a deployed embedding model on your [Azure OpenAI](/azure/ai-services/openai/overview) resource to generate embeddings during indexing.
20
+
The **Azure OpenAI Embedding** skill connects to a deployed embedding model on your [Azure OpenAI](/azure/ai-services/openai/overview) resource to generate embeddings during indexing. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
21
21
22
22
The [Import and vectorize data wizard](search-get-started-portal-import-vectors.md) in the Azure portal uses the **Azure OpenAI Embedding** skill to vectorize content. You can run the wizard and review the generated skillset to see how the wizard builds the skill for the text-embedding-ada-002 model.
Copy file name to clipboardExpand all lines: articles/search/cognitive-search-skill-vision-vectorize.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ ms.custom:
9
9
- build-2024
10
10
- references_regions
11
11
ms.topic: reference
12
-
ms.date: 04/23/2024
12
+
ms.date: 05/28/2024
13
13
---
14
14
15
15
# Azure AI Vision multimodal embeddings skill
@@ -19,7 +19,7 @@ ms.date: 04/23/2024
19
19
20
20
The **Azure AI Vision multimodal embeddings** skill uses Azure AI Vision's [multimodal embeddings API](../ai-services/computer-vision/concept-image-retrieval.md) to generate embeddings for image or text input.
21
21
22
-
The skill is only supported in search services located in a region that supports the [Azure AI Vision Multimodal embeddings API](../ai-services/computer-vision/how-to/image-retrieval.md). Currently this is East US, France Central, Korea Central, North Europe, Southeast Asia, West Europe, and West US.
22
+
The skill is only supported in search services located in a region that supports the [Azure AI Vision Multimodal embeddings API](../ai-services/computer-vision/how-to/image-retrieval.md). Currently this is East US, France Central, Korea Central, North Europe, Southeast Asia, West Europe, and West US. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
23
23
24
24
> [!NOTE]
25
25
> This skill is bound to Azure AI services and requires [a billable resource](cognitive-search-attach-cognitive-services.md) for transactions that exceed 20 documents per indexer per day. Execution of built-in skills is charged at the existing [Azure AI services pay-as-you go price](https://azure.microsoft.com/pricing/details/cognitive-services/).
Copy file name to clipboardExpand all lines: articles/search/search-faq-frequently-asked-questions.yml
+10-5Lines changed: 10 additions & 5 deletions
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ metadata:
9
9
ms.author: heidist
10
10
ms.service: cognitive-search
11
11
ms.topic: faq
12
-
ms.date: 05/21/2024
12
+
ms.date: 05/28/2024
13
13
title: Azure AI Search Frequently Asked Questions
14
14
summary: Find answers to commonly asked questions about Azure AI Search.
15
15
@@ -179,19 +179,24 @@ sections:
179
179
- question: |
180
180
Where does Azure AI Search store customer data?
181
181
answer: |
182
-
It stores your data wherever your service is deployed. Azure AI Search doesn't store customer data outside of the deployment region.
182
+
It stores your data in the [geography (Geo)](https://azure.microsoft.com/explore/global-infrastructure/geographies/#geographies) where your service is deployed. Microsoft might replicate your data within the same geo for high availability and durability. For more information, see [data residency in Azure](https://azure.microsoft.com/explore/global-infrastructure/data-residency/#overview).
183
183
184
184
- question: |
185
185
Does Azure AI Search send customer data to other services for processing?
186
186
answer: |
187
-
Yes, if you use the built-in skills based on Azure AI services, the indexer sends requests to Azure AI services over the internal network. If you add a custom skill, the indexer sends content to the URI provided in the custom skill over the public network unless you configure a [shared private link](search-indexer-howto-access-private.md).
187
+
Yes, skills and vectorizers make [outbound calls from Azure AI Search](search-security-overview.md) to other Azure resources or external models that you specify for embedding or chat. Calls to those APIs typically contain raw content to be processed or queries that are vectorized by an embedding model. For Azure-to-Azure connections, the service sends requests over the internal network. If you add a custom skill or vectorizer, the indexer sends content to the URI provided in the custom skill over the public network unless you configure a [shared private link](search-indexer-howto-access-private.md).
188
188
189
-
When you configure indexing and queries for text-to-vector or image-to-image conversions, indexers and vectorizors send requests to models on Azure OpenAI, Azure AI Vision multimodal API, or to the model catalog in Azure AI Studio.
189
+
- question: |
190
+
Does Azure AI Search process customer data in other regions?
191
+
answer: |
192
+
Processing (vectorization or applied AI transformations) is performed in the Geo that hosts the Azure AI services used by skills, or the Azure apps or functions hosting custom skills, or the Azure OpenAI or Azure AI Studio region that hosts your deployed models. These resources are specified by you, so you can choose whether to provision them in the same Geo as your search service or not
193
+
194
+
If you send data to external (non-Azure) models or services, the processing location is determined by the external service.
190
195
191
196
- question: |
192
197
Can I control access to search results based on user identity?
193
198
answer: |
194
-
Not exactly. Typically, users who are authorized to run your application are also authorized to see all search results. Azure AI Search doesn't have built-in support for row-level or document-level permissions, but you can implement [security filters](./search-security-trimming-for-azure-search.md) as a workaround. For steps and script, see [Get started with the Python enterprise chat sample using RAG](/azure/developer/python/get-started-app-chat-template).
199
+
You can if you implement a solution that associates documents with a user identity. Typically, users who are authorized to run your application are also authorized to see all search results. Azure AI Search doesn't have built-in support for row-level or document-level permissions, but you can implement [security filters](./search-security-trimming-for-azure-search.md) as a workaround. For steps and script, see [Get started with the Python enterprise chat sample using RAG](/azure/developer/python/get-started-app-chat-template).
195
200
196
201
- question: |
197
202
Can I control access to operations based on user identity?
Copy file name to clipboardExpand all lines: articles/search/search-security-overview.md
+18-9Lines changed: 18 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ ms.service: cognitive-search
10
10
ms.custom:
11
11
- ignite-2023
12
12
ms.topic: conceptual
13
-
ms.date: 04/03/2024
13
+
ms.date: 05/28/2024
14
14
---
15
15
16
16
# Security overview for Azure AI Search
@@ -31,7 +31,7 @@ Azure AI Search has three basic network traffic patterns:
31
31
32
32
Inbound requests that target a search service endpoint include:
33
33
34
-
+ Create, read, update, or delete objects on the search service
34
+
+ Create, read, update, or delete indexes and other objects on the search service
35
35
+ Load an index with search documents
36
36
+ Query an index
37
37
+ Trigger indexer or skillset execution
@@ -165,13 +165,19 @@ If you require permissioned access over content in search results, there's a tec
165
165
166
166
## Data residency
167
167
168
-
When you set up a search service, you choose a location or region that determines where customer data is stored and processed. Azure AI Search won't store customer data outside of your specified region unless you configure a feature that has a dependency on another Azure resource, and that resource is provisioned in a different region.
168
+
When you set up a search service, you choose a region that determines where customer data is stored and processed. Each region exists within a [geography (Geo)](https://azure.microsoft.com/explore/global-infrastructure/geographies/#overview) that often includes multiple regions (for example, Switzerland is a Geo that contains Switzerland North and Switzerland West). Azure AI Search might replicate your data to another region within the same Geo for durability and high availability. The service won't store or process customer data outside of your specified Geo unless you configure a feature that has a dependency on another Azure resource, and that resource is provisioned in a different region.
169
169
170
-
Currently, the only external resource that a search service writes to is Azure Storage. The storage account is one that you provide, and it could be in any region. A search service will write to Azure Storage if you use any of the following features: [enrichment cache](cognitive-search-incremental-indexing-conceptual.md), [debug session](cognitive-search-debug-session.md), [knowledge store](knowledge-store-concept-intro.md).
170
+
Currently, the only external resource that a search service writes to is Azure Storage. The storage account is one that you provide, and it could be in any region. A search service writes to Azure Storage if you use any of the following features:
For more information about data residency, see [data residency in Azure](https://azure.microsoft.com/explore/global-infrastructure/data-residency/#overview).
171
177
172
178
### Exceptions to data residency commitments
173
179
174
-
Object names will be stored and processed outside of your selected region or location. Customers shouldn't place any sensitive data in name fields or create applications designed to store sensitive data in these fields. This data appears in the telemetry logs used by Microsoft to provide support for the service. Object names include names of indexes, indexers, data sources, skillsets, resources, containers, and key vault store.
180
+
Object names appear in the telemetry logs used by Microsoft to provide support for the service. Object names are stored and processed outside of your selected region or location. Object names include the names of indexes and index fields, aliases, indexers, data sources, skillsets, synonym maps, resources, containers, and key vault store. Customers shouldn't place any sensitive data in name fields or create applications designed to store sensitive data in these fields.
175
181
176
182
Telemetry logs are retained for one and a half years. During that period, Microsoft might access and reference object names under the following conditions:
177
183
@@ -189,13 +195,16 @@ Optionally, you can add customer-managed keys (CMK) for supplemental encryption
189
195
190
196
### Data in transit
191
197
192
-
In Azure AI Search, encryption starts with connections and transmissions. For search services on the public internet, Azure AI Search listens on HTTPS port 443.
198
+
For search service connections over the public internet, Azure AI Search listens on HTTPS port 443.
199
+
200
+
Client-to-service channel encryption is either TLS 1.2 or 1.3:
193
201
194
-
+ All client-to-service connections use TLS 1.2 encryption by default.
202
+
+ TLS 1.3 is the default on newer client operating systems and versions of .NET.
203
+
+ TLS 1.2 is the default on older systems, but you can [explicitly specify 1.3 on a client request](/dotnet/framework/network-programming/tls).
195
204
196
-
+ You can [file a support ticket](/azure/azure-portal/supportability/how-to-create-azure-support-request) to use TLS 1.3 instead.
205
+
Earlier versions of TLS (1.0 or 1.1) aren't supported.
197
206
198
-
Earlier versions (1.0 or 1.1) aren't supported.
207
+
For more information, see [TLS support in .NET Framework](/dotnet/framework/network-programming/tls#tls-support-in-net-framework).
Copy file name to clipboardExpand all lines: articles/search/vector-search-vectorizer-ai-services-vision.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,15 +8,15 @@ ms.service: cognitive-search
8
8
ms.custom:
9
9
- build-2024
10
10
ms.topic: reference
11
-
ms.date: 04/24/2024
11
+
ms.date: 05/28/2024
12
12
---
13
13
14
14
# Azure AI Vision vectorizer
15
15
16
16
> [!IMPORTANT]
17
17
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2024-05-01-Preview REST API](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-Preview&preserve-view=true) supports this feature.
18
18
19
-
The **Azure AI Vision** vectorizer connects to an Azure AI Vision resource to generate embeddings at query time using [the Multimodal embeddings API](../ai-services/computer-vision/concept-image-retrieval.md).
19
+
The **Azure AI Vision** vectorizer connects to an Azure AI Vision resource to generate embeddings at query time using [the Multimodal embeddings API](../ai-services/computer-vision/concept-image-retrieval.md). Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
20
20
21
21
> [!NOTE]
22
22
> This vectorizer is bound to Azure AI services. Execution of the vectorizer is charged at the existing [Azure AI services pay-as-you go price](https://azure.microsoft.com/pricing/details/cognitive-services/).
Copy file name to clipboardExpand all lines: articles/search/vector-search-vectorizer-azure-machine-learning-ai-studio-catalog.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,15 +8,15 @@ ms.service: cognitive-search
8
8
ms.custom:
9
9
- build-2024
10
10
ms.topic: reference
11
-
ms.date: 04/24/2024
11
+
ms.date: 05/28/2024
12
12
---
13
13
14
14
# Azure AI Studio model catalog vectorizer
15
15
16
16
> [!IMPORTANT]
17
17
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2024-05-01-Preview REST API](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-Preview&preserve-view=true) supports this feature.
18
18
19
-
The **Azure AI Studio model catalog** vectorizer connects to an embedding model that was deployed via [the Azure AI Studio model catalog](../ai-studio/how-to/model-catalog.md) to an Azure Machine Learning endpoint.
19
+
The **Azure AI Studio model catalog** vectorizer connects to an embedding model that was deployed via [the Azure AI Studio model catalog](../ai-studio/how-to/model-catalog.md) to an Azure Machine Learning endpoint. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
Copy file name to clipboardExpand all lines: articles/search/vector-search-vectorizer-azure-open-ai.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,15 +8,15 @@ ms.service: cognitive-search
8
8
ms.custom:
9
9
- build-2024
10
10
ms.topic: reference
11
-
ms.date: 04/24/2024
11
+
ms.date: 05/28/2024
12
12
---
13
13
14
14
# Azure OpenAI vectorizer
15
15
16
16
> [!IMPORTANT]
17
-
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2023-10-01-Preview REST API](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2023-10-01-preview&preserve-view=true)supports this feature.
17
+
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2023-10-01-Preview REST API](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2023-10-01-preview&preserve-view=true)and later preview REST APIs support this feature.
18
18
19
-
The **Azure OpenAI** vectorizer connects to a deployed embedding model on your [Azure OpenAI](/azure/ai-services/openai/overview) resource to generate embeddings at query time.
19
+
The **Azure OpenAI** vectorizer connects to a deployed embedding model on your [Azure OpenAI](/azure/ai-services/openai/overview) resource to generate embeddings at query time. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
20
20
21
21
> [!NOTE]
22
22
> This vectorizer is bound to Azure OpenAI and is charged at the existing [Azure OpenAI pay-as-you go price](https://azure.microsoft.com/pricing/details/cognitive-services/openai-service/#pricing).
0 commit comments