Skip to content

Commit fa9704b

Browse files
Merge pull request #276522 from HeidiSteen/heidist-may28
[azure search] PR port from 287242 to new PR
2 parents 7f7ef55 + dbe4e60 commit fa9704b

10 files changed

+46
-32
lines changed

articles/search/cognitive-search-aml-skill.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.custom:
1010
- ignite-2023
1111
- build-2024
1212
ms.topic: reference
13-
ms.date: 05/08/2024
13+
ms.date: 05/28/2024
1414
---
1515

1616
# AML skill in an Azure AI Search enrichment pipeline
@@ -20,7 +20,7 @@ ms.date: 05/08/2024
2020
2121
The **AML** skill allows you to extend AI enrichment with a custom [Azure Machine Learning](../machine-learning/overview-what-is-azure-machine-learning.md) (AML) model. Once an AML model is [trained and deployed](../machine-learning/concept-azure-machine-learning-architecture.md#workspace), an **AML** skill integrates it into AI enrichment.
2222

23-
Like other built-in skills, an **AML** skill has inputs and outputs. The inputs are sent to your deployed AML online endpoint as a JSON object, which outputs a JSON payload as a response along with a success status code. The response is expected to have the outputs specified by your **AML** skill. Any other response is considered an error and no enrichments are performed.
23+
Like other built-in skills, an **AML** skill has inputs and outputs. The inputs are sent to your deployed AML online endpoint as a JSON object, which outputs a JSON payload as a response along with a success status code. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed. The response is expected to have the outputs specified by your **AML** skill. Any other response is considered an error and no enrichments are performed.
2424

2525
If you're using the [Azure AI Studio model catalog vectorizer (preview)](vector-search-vectorizer-azure-machine-learning-ai-studio-catalog.md) for integrated vectorization at query time, you should also use the **AML** skill for integrated vectorization during indexing. See [How to implement integrated vectorization using models from Azure AI Studio](vector-search-integrated-vectorization-ai-studio.md) for instructions. This scenario is supported through the 2024-05-01-preview REST API and the Azure portal.
2626

articles/search/cognitive-search-custom-skill-interface.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,12 +8,12 @@ ms.service: cognitive-search
88
ms.custom:
99
- ignite-2023
1010
ms.topic: how-to
11-
ms.date: 04/25/2024
11+
ms.date: 05/28/2024
1212
---
1313

1414
# Add a custom skill to an Azure AI Search enrichment pipeline
1515

16-
An [AI enrichment pipeline](cognitive-search-concept-intro.md) can include both [built-in skills](cognitive-search-predefined-skills.md) and [custom skills](cognitive-search-custom-skill-web-api.md) that you personally create and publish. Your custom code executes externally from the search service (for example, as an Azure function), but accepts inputs and sends outputs to the skillset just like any other skill.
16+
An [AI enrichment pipeline](cognitive-search-concept-intro.md) can include both [built-in skills](cognitive-search-predefined-skills.md) and [custom skills](cognitive-search-custom-skill-web-api.md) that you personally create and publish. Your custom code executes externally from the search service (for example, as an Azure function), but accepts inputs and sends outputs to the skillset just like any other skill. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
1717

1818
Custom skills might sound complex but can be simple and straightforward in terms of implementation. If you have existing packages that provide pattern matching or classification models, the content you extract from blobs could be passed to these models for processing. Since AI enrichment is Azure-based, your model should be on Azure also. Some common hosting methodologies include using [Azure Functions](cognitive-search-create-custom-skill-example.md) or [Containers](https://github.com/Microsoft/SkillsExtractorCognitiveSearch).
1919

articles/search/cognitive-search-skill-azure-openai-embedding.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,15 +9,15 @@ ms.custom:
99
- ignite-2023
1010
- build-2024
1111
ms.topic: reference
12-
ms.date: 05/08/2024
12+
ms.date: 05/28/2024
1313
---
1414

1515
# Azure OpenAI Embedding skill
1616

1717
> [!IMPORTANT]
1818
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2023-10-01-preview REST API](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2023-10-01-preview&preserve-view=true) supports the first iteration of this feature. The [2024-05-01-preview REST API](/rest/api/searchservice/skillsets/create-or-update?view=rest-searchservice-2024-05-01-preview&preserve-view=true) adds more properties and supports more text embedding models on Azure OpenAI.
1919
20-
The **Azure OpenAI Embedding** skill connects to a deployed embedding model on your [Azure OpenAI](/azure/ai-services/openai/overview) resource to generate embeddings during indexing.
20+
The **Azure OpenAI Embedding** skill connects to a deployed embedding model on your [Azure OpenAI](/azure/ai-services/openai/overview) resource to generate embeddings during indexing. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
2121

2222
The [Import and vectorize data wizard](search-get-started-portal-import-vectors.md) in the Azure portal uses the **Azure OpenAI Embedding** skill to vectorize content. You can run the wizard and review the generated skillset to see how the wizard builds the skill for the text-embedding-ada-002 model.
2323

articles/search/cognitive-search-skill-vision-vectorize.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ ms.custom:
99
- build-2024
1010
- references_regions
1111
ms.topic: reference
12-
ms.date: 04/23/2024
12+
ms.date: 05/28/2024
1313
---
1414

1515
# Azure AI Vision multimodal embeddings skill
@@ -19,7 +19,7 @@ ms.date: 04/23/2024
1919
2020
The **Azure AI Vision multimodal embeddings** skill uses Azure AI Vision's [multimodal embeddings API](../ai-services/computer-vision/concept-image-retrieval.md) to generate embeddings for image or text input.
2121

22-
The skill is only supported in search services located in a region that supports the [Azure AI Vision Multimodal embeddings API](../ai-services/computer-vision/how-to/image-retrieval.md). Currently this is East US, France Central, Korea Central, North Europe, Southeast Asia, West Europe, and West US.
22+
The skill is only supported in search services located in a region that supports the [Azure AI Vision Multimodal embeddings API](../ai-services/computer-vision/how-to/image-retrieval.md). Currently this is East US, France Central, Korea Central, North Europe, Southeast Asia, West Europe, and West US. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
2323

2424
> [!NOTE]
2525
> This skill is bound to Azure AI services and requires [a billable resource](cognitive-search-attach-cognitive-services.md) for transactions that exceed 20 documents per indexer per day. Execution of built-in skills is charged at the existing [Azure AI services pay-as-you go price](https://azure.microsoft.com/pricing/details/cognitive-services/).

articles/search/search-faq-frequently-asked-questions.yml

Lines changed: 10 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ metadata:
99
ms.author: heidist
1010
ms.service: cognitive-search
1111
ms.topic: faq
12-
ms.date: 05/21/2024
12+
ms.date: 05/28/2024
1313
title: Azure AI Search Frequently Asked Questions
1414
summary: Find answers to commonly asked questions about Azure AI Search.
1515

@@ -179,19 +179,24 @@ sections:
179179
- question: |
180180
Where does Azure AI Search store customer data?
181181
answer: |
182-
It stores your data wherever your service is deployed. Azure AI Search doesn't store customer data outside of the deployment region.
182+
It stores your data in the [geography (Geo)](https://azure.microsoft.com/explore/global-infrastructure/geographies/#geographies) where your service is deployed. Microsoft might replicate your data within the same geo for high availability and durability. For more information, see [data residency in Azure](https://azure.microsoft.com/explore/global-infrastructure/data-residency/#overview).
183183
184184
- question: |
185185
Does Azure AI Search send customer data to other services for processing?
186186
answer: |
187-
Yes, if you use the built-in skills based on Azure AI services, the indexer sends requests to Azure AI services over the internal network. If you add a custom skill, the indexer sends content to the URI provided in the custom skill over the public network unless you configure a [shared private link](search-indexer-howto-access-private.md).
187+
Yes, skills and vectorizers make [outbound calls from Azure AI Search](search-security-overview.md) to other Azure resources or external models that you specify for embedding or chat. Calls to those APIs typically contain raw content to be processed or queries that are vectorized by an embedding model. For Azure-to-Azure connections, the service sends requests over the internal network. If you add a custom skill or vectorizer, the indexer sends content to the URI provided in the custom skill over the public network unless you configure a [shared private link](search-indexer-howto-access-private.md).
188188
189-
When you configure indexing and queries for text-to-vector or image-to-image conversions, indexers and vectorizors send requests to models on Azure OpenAI, Azure AI Vision multimodal API, or to the model catalog in Azure AI Studio.
189+
- question: |
190+
Does Azure AI Search process customer data in other regions?
191+
answer: |
192+
Processing (vectorization or applied AI transformations) is performed in the Geo that hosts the Azure AI services used by skills, or the Azure apps or functions hosting custom skills, or the Azure OpenAI or Azure AI Studio region that hosts your deployed models. These resources are specified by you, so you can choose whether to provision them in the same Geo as your search service or not
193+
194+
If you send data to external (non-Azure) models or services, the processing location is determined by the external service.
190195
191196
- question: |
192197
Can I control access to search results based on user identity?
193198
answer: |
194-
Not exactly. Typically, users who are authorized to run your application are also authorized to see all search results. Azure AI Search doesn't have built-in support for row-level or document-level permissions, but you can implement [security filters](./search-security-trimming-for-azure-search.md) as a workaround. For steps and script, see [Get started with the Python enterprise chat sample using RAG](/azure/developer/python/get-started-app-chat-template).
199+
You can if you implement a solution that associates documents with a user identity. Typically, users who are authorized to run your application are also authorized to see all search results. Azure AI Search doesn't have built-in support for row-level or document-level permissions, but you can implement [security filters](./search-security-trimming-for-azure-search.md) as a workaround. For steps and script, see [Get started with the Python enterprise chat sample using RAG](/azure/developer/python/get-started-app-chat-template).
195200
196201
- question: |
197202
Can I control access to operations based on user identity?

articles/search/search-security-overview.md

Lines changed: 18 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.service: cognitive-search
1010
ms.custom:
1111
- ignite-2023
1212
ms.topic: conceptual
13-
ms.date: 04/03/2024
13+
ms.date: 05/28/2024
1414
---
1515

1616
# Security overview for Azure AI Search
@@ -31,7 +31,7 @@ Azure AI Search has three basic network traffic patterns:
3131

3232
Inbound requests that target a search service endpoint include:
3333

34-
+ Create, read, update, or delete objects on the search service
34+
+ Create, read, update, or delete indexes and other objects on the search service
3535
+ Load an index with search documents
3636
+ Query an index
3737
+ Trigger indexer or skillset execution
@@ -165,13 +165,19 @@ If you require permissioned access over content in search results, there's a tec
165165

166166
## Data residency
167167

168-
When you set up a search service, you choose a location or region that determines where customer data is stored and processed. Azure AI Search won't store customer data outside of your specified region unless you configure a feature that has a dependency on another Azure resource, and that resource is provisioned in a different region.
168+
When you set up a search service, you choose a region that determines where customer data is stored and processed. Each region exists within a [geography (Geo)](https://azure.microsoft.com/explore/global-infrastructure/geographies/#overview) that often includes multiple regions (for example, Switzerland is a Geo that contains Switzerland North and Switzerland West). Azure AI Search might replicate your data to another region within the same Geo for durability and high availability. The service won't store or process customer data outside of your specified Geo unless you configure a feature that has a dependency on another Azure resource, and that resource is provisioned in a different region.
169169

170-
Currently, the only external resource that a search service writes to is Azure Storage. The storage account is one that you provide, and it could be in any region. A search service will write to Azure Storage if you use any of the following features: [enrichment cache](cognitive-search-incremental-indexing-conceptual.md), [debug session](cognitive-search-debug-session.md), [knowledge store](knowledge-store-concept-intro.md).
170+
Currently, the only external resource that a search service writes to is Azure Storage. The storage account is one that you provide, and it could be in any region. A search service writes to Azure Storage if you use any of the following features:
171+
172+
+ [enrichment cache](cognitive-search-incremental-indexing-conceptual.md)
173+
+ [debug session](cognitive-search-debug-session.md)
174+
+ [knowledge store](knowledge-store-concept-intro.md)
175+
176+
For more information about data residency, see [data residency in Azure](https://azure.microsoft.com/explore/global-infrastructure/data-residency/#overview).
171177

172178
### Exceptions to data residency commitments
173179

174-
Object names will be stored and processed outside of your selected region or location. Customers shouldn't place any sensitive data in name fields or create applications designed to store sensitive data in these fields. This data appears in the telemetry logs used by Microsoft to provide support for the service. Object names include names of indexes, indexers, data sources, skillsets, resources, containers, and key vault store.
180+
Object names appear in the telemetry logs used by Microsoft to provide support for the service. Object names are stored and processed outside of your selected region or location. Object names include the names of indexes and index fields, aliases, indexers, data sources, skillsets, synonym maps, resources, containers, and key vault store. Customers shouldn't place any sensitive data in name fields or create applications designed to store sensitive data in these fields.
175181

176182
Telemetry logs are retained for one and a half years. During that period, Microsoft might access and reference object names under the following conditions:
177183

@@ -189,13 +195,16 @@ Optionally, you can add customer-managed keys (CMK) for supplemental encryption
189195

190196
### Data in transit
191197

192-
In Azure AI Search, encryption starts with connections and transmissions. For search services on the public internet, Azure AI Search listens on HTTPS port 443.
198+
For search service connections over the public internet, Azure AI Search listens on HTTPS port 443.
199+
200+
Client-to-service channel encryption is either TLS 1.2 or 1.3:
193201

194-
+ All client-to-service connections use TLS 1.2 encryption by default.
202+
+ TLS 1.3 is the default on newer client operating systems and versions of .NET.
203+
+ TLS 1.2 is the default on older systems, but you can [explicitly specify 1.3 on a client request](/dotnet/framework/network-programming/tls).
195204

196-
+ You can [file a support ticket](/azure/azure-portal/supportability/how-to-create-azure-support-request) to use TLS 1.3 instead.
205+
Earlier versions of TLS (1.0 or 1.1) aren't supported.
197206

198-
Earlier versions (1.0 or 1.1) aren't supported.
207+
For more information, see [TLS support in .NET Framework](/dotnet/framework/network-programming/tls#tls-support-in-net-framework).
199208

200209
### Data at rest
201210

articles/search/vector-search-vectorizer-ai-services-vision.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,15 +8,15 @@ ms.service: cognitive-search
88
ms.custom:
99
- build-2024
1010
ms.topic: reference
11-
ms.date: 04/24/2024
11+
ms.date: 05/28/2024
1212
---
1313

1414
# Azure AI Vision vectorizer
1515

1616
> [!IMPORTANT]
1717
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2024-05-01-Preview REST API](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-Preview&preserve-view=true) supports this feature.
1818
19-
The **Azure AI Vision** vectorizer connects to an Azure AI Vision resource to generate embeddings at query time using [the Multimodal embeddings API](../ai-services/computer-vision/concept-image-retrieval.md).
19+
The **Azure AI Vision** vectorizer connects to an Azure AI Vision resource to generate embeddings at query time using [the Multimodal embeddings API](../ai-services/computer-vision/concept-image-retrieval.md). Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
2020

2121
> [!NOTE]
2222
> This vectorizer is bound to Azure AI services. Execution of the vectorizer is charged at the existing [Azure AI services pay-as-you go price](https://azure.microsoft.com/pricing/details/cognitive-services/).

articles/search/vector-search-vectorizer-azure-machine-learning-ai-studio-catalog.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,15 +8,15 @@ ms.service: cognitive-search
88
ms.custom:
99
- build-2024
1010
ms.topic: reference
11-
ms.date: 04/24/2024
11+
ms.date: 05/28/2024
1212
---
1313

1414
# Azure AI Studio model catalog vectorizer
1515

1616
> [!IMPORTANT]
1717
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2024-05-01-Preview REST API](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2024-05-01-Preview&preserve-view=true) supports this feature.
1818
19-
The **Azure AI Studio model catalog** vectorizer connects to an embedding model that was deployed via [the Azure AI Studio model catalog](../ai-studio/how-to/model-catalog.md) to an Azure Machine Learning endpoint.
19+
The **Azure AI Studio model catalog** vectorizer connects to an embedding model that was deployed via [the Azure AI Studio model catalog](../ai-studio/how-to/model-catalog.md) to an Azure Machine Learning endpoint. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
2020

2121
## Vectorizer parameters
2222

articles/search/vector-search-vectorizer-azure-open-ai.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,15 +8,15 @@ ms.service: cognitive-search
88
ms.custom:
99
- build-2024
1010
ms.topic: reference
11-
ms.date: 04/24/2024
11+
ms.date: 05/28/2024
1212
---
1313

1414
# Azure OpenAI vectorizer
1515

1616
> [!IMPORTANT]
17-
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2023-10-01-Preview REST API](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2023-10-01-preview&preserve-view=true) supports this feature.
17+
> This feature is in public preview under [Supplemental Terms of Use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). The [2023-10-01-Preview REST API](/rest/api/searchservice/indexes/create-or-update?view=rest-searchservice-2023-10-01-preview&preserve-view=true) and later preview REST APIs support this feature.
1818
19-
The **Azure OpenAI** vectorizer connects to a deployed embedding model on your [Azure OpenAI](/azure/ai-services/openai/overview) resource to generate embeddings at query time.
19+
The **Azure OpenAI** vectorizer connects to a deployed embedding model on your [Azure OpenAI](/azure/ai-services/openai/overview) resource to generate embeddings at query time. Your data is processed in the [Geo](https://azure.microsoft.com/explore/global-infrastructure/data-residency/) where your model is deployed.
2020

2121
> [!NOTE]
2222
> This vectorizer is bound to Azure OpenAI and is charged at the existing [Azure OpenAI pay-as-you go price](https://azure.microsoft.com/pricing/details/cognitive-services/openai-service/#pricing).

0 commit comments

Comments
 (0)