Skip to content

Commit 72191c8

Browse files
committed
Merge branch 'main' into release-preview-new-mistral-models
2 parents 1bf43bb + b338a2f commit 72191c8

File tree

98 files changed

+264
-253
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

98 files changed

+264
-253
lines changed

articles/ai-services/openai/toc.yml

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -233,6 +233,22 @@ items:
233233
href: ./tutorials/embeddings.md
234234
- name: Fine-tuning GPT-4o mini
235235
href: ./tutorials/fine-tune.md
236+
- name: Security & Governance
237+
items:
238+
- name: Use virtual networks
239+
href: ../cognitive-services-virtual-networks.md?context=/azure/ai-services/openai/context/context
240+
- name: Encryption of data at rest
241+
href: encrypt-data-at-rest.md
242+
- name: Managed identity
243+
href: ./how-to/managed-identity.md
244+
- name: Role-based access control (Azure RBAC)
245+
href: ./how-to/role-based-access-control.md
246+
- name: Business continuity & disaster recovery (BCDR)
247+
href: ./how-to/business-continuity-disaster-recovery.md
248+
- name: Use your data
249+
items:
250+
- name: Network and access configuration
251+
href: ./how-to/on-your-data-configuration.md
236252
- name: Responsible AI
237253
items:
238254
- name: Overview

articles/ai-studio/how-to/deploy-models-cohere-rerank.md

Lines changed: 25 additions & 30 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ description: Learn to deploy and use Cohere Rerank models with Azure AI Foundry.
55
manager: scottpolly
66
ms.service: azure-ai-studio
77
ms.topic: how-to
8-
ms.date: 07/24/2024
8+
ms.date: 12/06/2024
99
ms.reviewer: shubhiraj
1010
ms.author: mopeakande
1111
author: msakande
@@ -24,12 +24,12 @@ In this article, you learn about the Cohere Rerank models, how to use Azure AI F
2424

2525
Cohere offers two Rerank models in [Azure AI Foundry](https://ai.azure.com). These models are available in the model catalog for deployment as serverless APIs:
2626

27-
* Cohere Rerank 3 - English
28-
* Cohere Rerank 3 - Multilingual
27+
* Cohere Rerank v3 - English
28+
* Cohere Rerank v3 - Multilingual
2929

3030
You can browse the Cohere family of models in the [Model Catalog](model-catalog.md) by filtering on the Cohere collection.
3131

32-
### Cohere Rerank 3 - English
32+
### Cohere Rerank v3 - English
3333

3434
Cohere Rerank English is a reranking model used for semantic search and retrieval-augmented generation (RAG). Rerank enables you to significantly improve search quality by augmenting traditional keyword-based search systems with a semantic-based reranking system that can contextualize the meaning of a user's query beyond keyword relevance. Cohere's Rerank delivers higher quality results than embedding-based search, lexical search, and even hybrid search, and it requires only adding a single line of code into your application.
3535

@@ -42,7 +42,7 @@ Rerank supports JSON objects as documents where users can specify, at query time
4242

4343
Rerank English works well for code retrieval, semi-structured data retrieval, and long context.
4444

45-
### Cohere Rerank 3 - Multilingual
45+
### Cohere Rerank v3 - Multilingual
4646

4747
Cohere Rerank Multilingual is a reranking model used for semantic search and retrieval-augmented generation (RAG). Rerank Multilingual supports more than 100 languages and can be used to search within a language (for example, to search with a French query on French documents) and across languages (for example, to search with an English query on Chinese documents). Rerank enables you to significantly improve search quality by augmenting traditional keyword-based search systems with a semantic-based reranking system that can contextualize the meaning of a user's query beyond keyword relevance. Cohere's Rerank delivers higher quality results than embedding-based search, lexical search, and even hybrid search, and it requires only adding a single line of code into your application.
4848

@@ -64,49 +64,44 @@ You can deploy the previously mentioned Cohere models as a service with pay-as-y
6464
### Prerequisites
6565

6666
- An Azure subscription with a valid payment method. Free or trial Azure subscriptions won't work. If you don't have an Azure subscription, create a [paid Azure account](https://azure.microsoft.com/pricing/purchase-options/pay-as-you-go) to begin.
67-
- An [AI Foundry hub](../how-to/create-azure-ai-resource.md). The serverless API model deployment offering for Cohere Rerank is only available with hubs created in these regions:
68-
69-
* East US
70-
* East US 2
71-
* North Central US
72-
* South Central US
73-
* West US
74-
* West US 3
75-
* Sweden Central
76-
77-
For a list of regions that are available for each of the models supporting serverless API endpoint deployments, see [Region availability for models in serverless API endpoints](deploy-models-serverless-availability.md).
67+
68+
- An [Azure AI Foundry hub](../how-to/create-azure-ai-resource.md). The serverless API model deployment offering for Cohere Rerank is only available with hubs created in specific regions. For a list of regions that are available for each of the Cohere models that support serverless API endpoint deployments, see [Region availability for models in serverless API endpoints](deploy-models-serverless-availability.md#cohere-models).
7869

7970
- An [Azure AI Foundry project](../how-to/create-projects.md).
71+
8072
- Azure role-based access controls are used to grant access to operations in Azure AI Foundry portal. To perform the steps in this article, your user account must be assigned the __Azure AI Developer role__ on the resource group. For more information on permissions, see [Role-based access control in Azure AI Foundry portal](../concepts/rbac-ai-studio.md).
8173

8274

8375
### Create a new deployment
8476

85-
The following steps demonstrate the deployment of Cohere Rerank 3 - English, but you can use the same steps to deploy Cohere Rerank 3 - Multilingual by replacing the model name.
77+
The following steps demonstrate the deployment of Cohere Rerank v3 - English, but you can use the same steps to deploy Cohere Rerank v3 - Multilingual by replacing the model name.
8678

8779
To create a deployment:
8880

89-
1. Sign in to [Azure AI Foundry](https://ai.azure.com).
90-
1. Select **Model catalog** from the left sidebar.
91-
1. Search for *Cohere*.
92-
1. Select **cohere-rerank-3-english** to open the Model Details page.
81+
[!INCLUDE [open-catalog](../includes/open-catalog.md)]
82+
83+
4. Select the model card of the model you want to deploy. In this article, you select **Cohere-rerank-v3-english** to open the Model Details page.
84+
9385
1. Select **Deploy** to open a serverless API deployment window for the model.
94-
1. Alternatively, you can initiate a deployment by starting from your project in AI Foundry portal.
86+
1. Alternatively, you can initiate a deployment from your project in the AI Foundry portal as follows:
9587

9688
1. From the left sidebar of your project, select **Models + Endpoints**.
97-
1. Select **+ Deploy model**.
98-
1. Search for and select **Cohere-rerank-3-english**. to open the Model Details page.
89+
1. Select **+ Deploy model** > **Deploy base model**.
90+
1. Search for and select **Cohere-rerank-v3-english** to open the Model Details page.
9991
1. Select **Confirm** to open a serverless API deployment window for the model.
10092

101-
1. Select the project in which you want to deploy your model.
10293
1. In the deployment wizard, select the link to **Azure Marketplace Terms** to learn more about the terms of use.
10394
1. Select the **Pricing and terms** tab to learn about pricing for the selected model.
104-
1. Select the **Subscribe and Deploy** button. If this is your first time deploying the model in the project, you have to subscribe your project for the particular offering. This step requires that your account has the **Azure AI Developer role** permissions on the resource group, as listed in the prerequisites. Each project has its own subscription to the particular Azure Marketplace offering of the model, which allows you to control and monitor spending. Currently, you can have only one deployment for each model within a project.
95+
1. Select the **Subscribe and Deploy** button. If this is your first time deploying the model in the project, you have to subscribe your project for the particular offering.
96+
97+
> [!NOTE]
98+
> This step requires that your account has the **Azure AI Developer role** permissions on the resource group, as listed in the prerequisites. Models that are offered by non-Microsoft providers (for example, Cohere models) are billed through the Azure Marketplace. For such models, you're required to subscribe your project to the particular model offering. Each project has its own subscription to the particular Azure Marketplace offering of the model, which allows you to control and monitor spending. Currently, you can have only one deployment for each model within a project.
99+
105100
1. Once you subscribe the project for the particular Azure Marketplace offering, subsequent deployments of the _same_ offering in the _same_ project don't require subscribing again. If this scenario applies to you, there's a **Continue to deploy** option to select.
106101

107102
1. Give the deployment a name. This name becomes part of the deployment API URL. This URL must be unique in each Azure region.
108103

109-
1. Select **Deploy**. Wait until the deployment is ready and you're redirected to the Deployments page.
104+
1. Select **Deploy**. Wait until the deployment is ready and you're redirected to the **Model deployments** page.
110105
1. On the Deployments page, select the deployment, and note the endpoint's **Target** URL and the Secret **Key**. For more information on using the APIs, see the [reference](#rerank-api-reference-for-cohere-rerank-models-deployed-as-a-service) section.
111106
1. [!INCLUDE [Find your deployment details](../includes/find-deployments.md)]
112107

@@ -122,11 +117,11 @@ Cohere Rerank models deployed as serverless APIs can be consumed using the Reran
122117

123118
1. Copy the **Target** URL and the **Key** value.
124119

125-
1. Cohere currently exposes `v1/rerank` for inference with the Rerank 3 - English and Rerank 3 - Multilingual models schema. For more information on using the APIs, see the [reference](#rerank-api-reference-for-cohere-rerank-models-deployed-as-a-service) section.
120+
1. Cohere currently exposes `v1/rerank` for inference with the Rerank v3 - English and Rerank v3 - Multilingual models schema. For more information on using the APIs, see the [reference](#rerank-api-reference-for-cohere-rerank-models-deployed-as-a-service) section.
126121

127122
## Rerank API reference for Cohere Rerank models deployed as a service
128123

129-
Cohere Rerank 3 - English and Rerank 3 - Multilingual accept the native Cohere Rerank API on `v1/rerank`. This section contains details about the Cohere Rerank API.
124+
Cohere Rerank v3 - English and Rerank v3 - Multilingual accept the native Cohere Rerank API on `v1/rerank`. This section contains details about the Cohere Rerank API.
130125

131126
#### v1/rerank request
132127

@@ -139,7 +134,7 @@ Cohere Rerank 3 - English and Rerank 3 - Multilingual accept the native Cohere R
139134

140135
#### v1/rerank request schema
141136

142-
Cohere Rerank 3 - English and Rerank 3 - Multilingual accept the following parameters for a `v1/rerank` API call:
137+
Cohere Rerank v3 - English and Rerank v3 - Multilingual accept the following parameters for a `v1/rerank` API call:
143138

144139
| Property | Type | Default | Description |
145140
| --- | --- | --- | --- |

articles/ai-studio/includes/region-availability-maas.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -19,10 +19,10 @@ Cohere Command R+ 08-2024 | [Microsoft Managed Countries](/partner-center/m
1919
Cohere Command R 08-2024 | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) |East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
2020
Cohere Command R+ | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar |East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
2121
Cohere Command R | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
22-
Cohere Rerank 3 - English | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
23-
Cohere Rerank 3 - Multilingual | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
24-
Cohere Embed 3 - English | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar |East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
25-
Cohere Embed 3 - Multilingual | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar |East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
22+
Cohere Rerank v3 - English | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
23+
Cohere Rerank v3 - Multilingual | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
24+
Cohere Embed v3 - English | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar |East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
25+
Cohere Embed v3 - Multilingual | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Japan <br> Qatar |East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
2626

2727

2828
### JAIS models

articles/search/cognitive-search-concept-image-scenarios.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -149,7 +149,7 @@ This section supplements the [skill reference](cognitive-search-predefined-skill
149149

150150
1. [Create or update a skillset](/rest/api/searchservice/skillsets/create) to add skills.
151151

152-
1. Add templates for OCR and Image Analysis from the portal, or copy the definitions from the [skill reference](cognitive-search-predefined-skills.md) documentation. Insert them into the skills array of your skillset definition.
152+
1. Add templates for OCR and Image Analysis from the Azure portal, or copy the definitions from the [skill reference](cognitive-search-predefined-skills.md) documentation. Insert them into the skills array of your skillset definition.
153153

154154
1. If necessary, [include a multi-service key](cognitive-search-attach-cognitive-services.md) in the Azure AI services property of the skillset. Azure AI Search makes calls to a billable Azure AI services resource for OCR and image analysis for transactions that exceed the free limit (20 per indexer per day). Azure AI services must be in the same region as your search service.
155155

articles/search/cognitive-search-concept-troubleshooting.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -70,7 +70,7 @@ For [parallel indexing](search-howto-large-index.md), distribute your data into
7070

7171
## See also
7272

73-
+ [Quickstart: Create an AI enrichment pipeline in the portal](search-get-started-skillset.md)
73+
+ [Quickstart: Create an AI enrichment pipeline in the Azure portal](search-get-started-skillset.md)
7474
+ [Tutorial: Learn AI enrichment REST APIs](cognitive-search-tutorial-blob.md)
7575
+ [How to configure blob indexers](search-howto-indexing-azure-blob-storage.md)
7676
+ [How to define a skillset](cognitive-search-defining-skillset.md)

articles/search/cognitive-search-defining-skillset.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: azure-ai-search
88
ms.custom:
99
- ignite-2023
1010
ms.topic: conceptual
11-
ms.date: 10/04/2024
11+
ms.date: 12/06/2024
1212
---
1313

1414
# Create a skillset in Azure AI Search
@@ -269,9 +269,9 @@ Although skill output can be optionally cached for reuse purposes, it's usually
269269

270270
## Tips for a first skillset
271271

272-
+ Try the [Import data wizard](search-import-data-portal.md).
272+
+ Try the [Import data wizard](search-get-started-portal.md) or [Import and vectorize data wizard](search-get-started-portal-import-vectors.md).
273273

274-
The wizard automates several steps that can be challenging the first time around. It defines the skillset, index, and indexer, including field mappings and output field mappings. It also defines projections in a knowledge store if you're using one. For some skills, such as OCR or image analysis, the wizard adds utility skills that merge the image and text content that was separated during document cracking.
274+
The wizards automate several steps that can be challenging the first time around. It defines the skillset, index, and indexer, including field mappings and output field mappings. It also defines projections in a knowledge store if you're using one. For some skills, such as OCR or image analysis, the wizard adds utility skills that merge the image and text content that was separated during document cracking.
275275

276276
After the wizard runs, you can open each object in the Azure portal to view its JSON definition.
277277

articles/search/cognitive-search-how-to-debug-skillset.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -57,15 +57,15 @@ Debug sessions work with all generally available [indexer data sources](search-d
5757

5858
1. On the action bar at the top, select **Add debug session**.
5959

60-
:::image type="content" source="media/cognitive-search-debug/new-debug-session.png" lightbox="media/cognitive-search-debug/new-debug-session.png" alt-text="Screenshot of the debug sessions commands in the portal page." border="true":::
60+
:::image type="content" source="media/cognitive-search-debug/new-debug-session.png" lightbox="media/cognitive-search-debug/new-debug-session.png" alt-text="Screenshot of the debug sessions commands in the Azure portal page." border="true":::
6161

6262
1. In **Debug session name**, provide a name that will help you remember which skillset, indexer, and data source the debug session is about.
6363

6464
1. In **Indexer template**, select the indexer that drives the skillset you want to debug. Copies of both the indexer and skillset are used to initialize the session.
6565

6666
1. In **Document to debug**, choose the first document in the index or select a specific document. If you select a specific document, depending on the data source, you're asked for a URI or a row ID.
6767

68-
If your specific document is a blob, provide the blob URI. You can find the URI in the blob property page in the portal.
68+
If your specific document is a blob, provide the blob URI. You can find the URI in the blob property page in the Azure portal.
6969

7070
:::image type="content" source="media/cognitive-search-debug/copy-blob-url.png" lightbox="media/cognitive-search-debug/copy-blob-url.png" alt-text="Screenshot of the URI property in blob storage." border="true":::
7171

@@ -87,7 +87,7 @@ It's expected for a debug session to take longer to execute than the indexer sin
8787

8888
## Start with errors and warnings
8989

90-
Indexer execution history in the portal gives you the full error and warning list for all documents. In a debug session, the errors and warnings are limited to one document. You can work through this list, make your changes, and then return to the list to verify whether issues are resolved.
90+
Indexer execution history in the Azure portal gives you the full error and warning list for all documents. In a debug session, the errors and warnings are limited to one document. You can work through this list, make your changes, and then return to the list to verify whether issues are resolved.
9191

9292
Remember that a debug session is based on one document from the entire index. If an input or output looks wrong, the problem could be specific to that document. You can choose a different document to confirm whether errors and warnings are pervasive or specific to a single document.
9393

0 commit comments

Comments
 (0)