You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/search/cognitive-search-attach-cognitive-services.md
+42-42Lines changed: 42 additions & 42 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
---
2
2
title: Attach a Cognitive Services resource with a skillset - Azure Search
3
-
description: Instructions for attaching a Cognitive Services All-in-One subscription to a cognitive enrichment pipeline in Azure Search.
3
+
description: Instructions for attaching a Cognitive Services all-in-one subscription to a cognitive enrichment pipeline in Azure Search.
4
4
manager: cgronlun
5
5
author: LuisCabrer
6
6
services: search
@@ -13,84 +13,84 @@ ms.custom: seodec2018
13
13
---
14
14
# Attach a Cognitive Services resource with a skillset in Azure Search
15
15
16
-
AI algorithms drive the [cognitive indexing pipelines](cognitive-search-concept-intro.md) used for processing unstructured data in Azure Search. These algorithms are based on [Cognitive Services resources](https://azure.microsoft.com/services/cognitive-services/), including [Computer Vision](https://azure.microsoft.com/services/cognitive-services/computer-vision/) for image analysis and optical character recognition (OCR), and [Text Analytics](https://azure.microsoft.com/services/cognitive-services/text-analytics/) for entity recognition, key phrase extraction, and other enrichments.
16
+
AI algorithms drive the [cognitive indexing pipelines](cognitive-search-concept-intro.md) used for processing unstructured data in Azure Search. These algorithms are based on [Azure Cognitive Services resources](https://azure.microsoft.com/services/cognitive-services/), including [Computer Vision](https://azure.microsoft.com/services/cognitive-services/computer-vision/) for image analysis and optical character recognition (OCR) and [Text Analytics](https://azure.microsoft.com/services/cognitive-services/text-analytics/) for entity recognition, key phrase extraction, and other enrichments.
17
17
18
-
You can enrich a limited number of documents for free, or attach a billable Cognitive Services resource for larger and more frequent workloads. In this article, learn how to associate a Cognitive Services resource with your cognitive skillset to enrich data during [Azure Search indexing](search-what-is-an-index.md).
18
+
You can enrich a limited number of documents for free, or you can attach a billable Cognitive Services resource for larger and more frequent workloads. In this article, you'll learn how to associate a Cognitive Services resource with your cognitive skillset to enrich data during [Azure Search indexing](search-what-is-an-index.md).
19
19
20
-
If your pipeline consists of skills unrelated to Cognitive Services APIs, you should still attach a Cognitive Services resource. Doing so overrides the **Free** resource that limits you to a small quantity of enrichments per day. There is no charge for skills that are not bound to Cognitive Services APIs. These skills include:[custom skills](cognitive-search-create-custom-skill-example.md), [text merger](cognitive-search-skill-textmerger.md), [text splitter](cognitive-search-skill-textsplit.md), and [shaper](cognitive-search-skill-shaper.md).
20
+
Even if your pipeline consists of skills that aren't related to Cognitive Services APIs, you should still attach a Cognitive Services resource. Doing so overrides the Free resource that limits you to a small number of enrichments per day. You won't be charged for skills that aren't bound to Cognitive Services APIs. These skills include [custom skills](cognitive-search-create-custom-skill-example.md), [text merger](cognitive-search-skill-textmerger.md), [text splitter](cognitive-search-skill-textsplit.md), and [shaper](cognitive-search-skill-shaper.md).
21
21
22
22
> [!NOTE]
23
-
> As you expand scope by increasing the frequency of processing, adding more documents, or adding more AI algorithms, you will need to attach a billable Cognitive Services resource. Charges accrue when calling APIs in Cognitive Services, and for image extraction as part of the document-cracking stage in Azure Search. There are no charges for text extraction from documents.
23
+
> As you expand scope by increasing the frequency of processing, adding more documents, or adding more AI algorithms, you'll need to attach a billable Cognitive Services resource. You'll be charged for calling APIs in Cognitive Services and for image extraction as part of the document-cracking stage in Azure Search. You won't be charged for text extraction from documents.
24
24
>
25
-
> Execution of built-in skills is charged at the existing [Cognitive Services pay-as-you go price](https://azure.microsoft.com/pricing/details/cognitive-services/). Image extraction pricing is described on the [Azure Search pricing page](https://go.microsoft.com/fwlink/?linkid=2042400).
25
+
> Execution of built-in skills is billed at the [Cognitive Services pay-as-you go price](https://azure.microsoft.com/pricing/details/cognitive-services/). For information about image extraction pricing, see the [Azure Search pricing page](https://go.microsoft.com/fwlink/?linkid=2042400).
26
26
27
27
## Use Free resources
28
28
29
-
You can use a limited, free processing option to complete the cognitive search tutorial and quickstart exercises.
29
+
You can use a limited, free processing option to complete the cognitive search tutorial and quickstart exercises.
30
30
31
-
**Free (Limited Enrichments)** are restricted to 20 documents per day, per subscription.
31
+
Free (Limited enrichments) resources are restricted to 20 documents per day, per subscription.
32
32
33
-
1. Open the **Import data** wizard.
33
+
1. Open the Import data wizard:
34
34
35
-

35
+

36
36
37
-
1. Choose a data source and continue to **Add cognitive search (optional)**. For a step-by-step walkthrough of this wizard, see [Import, index, and query using portal tools](search-get-started-portal.md).
37
+
1. Choose a data source and continue to **Add cognitive search (Optional)**. For a step-by-step walkthrough of this wizard, see [Import, index, and query by using portal tools](search-get-started-portal.md).
38
38
39
-
1. Expand **Attach Cognitive Services** and select **Free (Limited Enrichments)**.
39
+
1. Expand **Attach Cognitive Services** and then select **Free (Limited enrichments)**:
Continue to the next step, **Add enrichments**. For a description of skills available in the portal, see ["Step 2: Add cognitive skill"](cognitive-search-quickstart-blob.md#create-the-enrichment-pipeline) in the cognitive search quickstart.
43
+
1.Continue to the next step, **Add Enrichments**. For a description of skills available in the portal, see [Step 2: Add cognitive skills](cognitive-search-quickstart-blob.md#create-the-enrichment-pipeline) in the cognitive search quickstart.
44
44
45
45
## Use billable resources
46
46
47
-
For workloads numbering more than 20 enrichments daily, you need to attach a billable Cognitive Services resource.
47
+
For workloads that create more than 20 enrichments per day, you need to attach a billable Cognitive Services resource.
48
48
49
-
You are only charged for skills that call the Cognitive Services APIs. Non-API-based skills like [custom skills](cognitive-search-create-custom-skill-example.md), [text merger](cognitive-search-skill-textmerger.md), [text splitter](cognitive-search-skill-textsplit.md), and [shaper](cognitive-search-skill-shaper.md) skills are not billed.
49
+
You're charged only for skills that call the Cognitive Services APIs. You're not billed for [custom skills](cognitive-search-create-custom-skill-example.md), or skills like [text merger](cognitive-search-skill-textmerger.md), [text splitter](cognitive-search-skill-textsplit.md), and [shaper](cognitive-search-skill-shaper.md), which aren't API-based.
50
50
51
-
1. Open the **Import data** wizard, choose a data source, and continue to **Add cognitive search (optional)**.
51
+
1. Open the Import data wizard, choose a data source, and continue to **Add cognitive search (Optional)**.
52
52
53
-
1. Expand **Attach Cognitive Services** and then select **Create new Cognitive Services resource**. A new tab opens so that you can create the resource.
53
+
1. Expand **Attach Cognitive Services** and then select **Create new Cognitive Services resource**. A new tab opens so that you can create the resource:
54
54
55
55

56
56
57
-
1. In Location, choose the same region as Azure Search. This is required for performance reasons, but it also voids outbound bandwidth charges across regions.
57
+
1. In the **Location** list, select the region where your Azure Search service is located. You need to use this region for performance reasons. Using this region also voids outbound bandwidth charges across regions.
58
58
59
-
1. In Pricing tier, choose**S0** to get the all-in-one collection of Cognitive Services features, including the Vision and Language features that back the predefined skills used by Azure Search.
59
+
1. In the **Pricing tier** list, select**S0** to get the all-in-one collection of Cognitive Services features, including the Vision and Language features that back the predefined skills used by Azure Search.
60
60
61
61
For the S0 tier, you can find rates for specific workloads on the [Cognitive Services pricing page](https://azure.microsoft.com/pricing/details/cognitive-services/).
62
62
63
-
+ In **Select Offer**, make sure that *Cognitive Services* is selected.
64
-
+ Under Language features, the rates for *Text Analytics Standard* apply to AI indexing.
65
-
+ Under Vision features, the rates for *Computer Vision S1* are applied.
63
+
+ In the **Select Offer** list, make sure **Cognitive Services** is selected.
64
+
+ Under **Language** features, the rates for **Text Analytics Standard** apply to AI indexing.
65
+
+ Under **Vision** features, the rates for **Computer Vision S1** apply.
66
66
67
-
1.Click**Create** to provision the new Cognitive Services resource.
67
+
1.Select**Create** to provision the new Cognitive Services resource.
68
68
69
-
1. Return to the previous tab containing the **Import data** wizard. Click**Refresh** to show the Cognitive Services resource, and then select the resource.
69
+
1. Return to the previous tab, which contains the Import data wizard. Select**Refresh** to show the Cognitive Services resource, and then select the resource:
70
70
71
-

71
+

72
72
73
-
1. Expand the **Add Enrichments** section to select the specific cognitive skills that you want to run over your data, and proceed with the rest of the flow. For a description of skills available in the portal, see ["Step 2: Add cognitive skill"](cognitive-search-quickstart-blob.md#create-the-enrichment-pipeline) in the cognitive search quickstart.
73
+
1. Expand the **Add Enrichments** section to select the specific cognitive skills that you want to run on your data. Complete the rest of the wizard. For a description of skills available in the portal, see [Step 2: Add cognitive skills](cognitive-search-quickstart-blob.md#create-the-enrichment-pipeline) in the cognitive search quickstart.
74
74
75
75
## Attach an existing skillset to a Cognitive Services resource
76
76
77
77
If you have an existing skillset, you can attach it to a new or different Cognitive Services resource.
78
78
79
-
1. On the **Service overview** page, click**Skillsets**.
79
+
1. On the **Service overview** page, select**Skillsets**:
Recall that **Free (Limited Enrichments)**is limited to 20 documents daily, and that **Create new Cognitive Services resource** is used to provision a new billable resource. If you create a new resource, select **Refresh** to refresh the list of Cognitive Services resources, and then select the resource.
87
+
Remember that the **Free (Limited enrichments)**option limits you to 20 documents daily, and that you can use **Create new Cognitive Services resource** to provision a new billable resource. If you create a new resource, select **Refresh** to refresh the list of Cognitive Services resources, and then select the resource.
88
88
89
89
## Attach Cognitive Services programmatically
90
90
91
-
When you're defining the skillset programmatically, add a `cognitiveServices` section to the skillset. In the section, include the key of the Cognitive Services resource that you want to associate with the skillset. Recall that the resource must be in the same region as Azure Search. Also include `@odata.type`, and set it to `#Microsoft.Azure.Search.CognitiveServicesByKey`.
91
+
When you're defining the skillset programmatically, add a `cognitiveServices` section to the skillset. In that section, include the key of the Cognitive Services resource that you want to associate with the skillset. Remember that the resource must be in the same region as your Azure Search resource. Also include `@odata.type`, and set it to `#Microsoft.Azure.Search.CognitiveServicesByKey`.
92
92
93
-
The following example shows this pattern. Notice the cognitiveServices section at the bottom of the definition
93
+
The following example shows this pattern. Notice the `cognitiveServices` section at the end of the definition.
94
94
95
95
```http
96
96
PUT https://[servicename].search.windows.net/skillsets/[skillset name]?api-version=2019-05-06
To estimate costs associated with cognitive search indexing, start with an idea of what an average document looks like so that you can run some numbers. For example, for estimation purposes, you might approximate:
131
+
To estimate the costs associated with cognitive search indexing, start with an idea of what an average document looks like so you can run some numbers. For example, you might approximate:
132
132
133
-
+1000 PDFs
134
-
+ Six pages each
135
-
+ One image per page (6000 images)
136
-
+3000 characters per page
133
+
+1,000 PDFs.
134
+
+ Six pages each.
135
+
+ One image per page (6,000 images).
136
+
+3,000 characters per page.
137
137
138
-
Assume a pipeline consisting of document cracking of each PDF with image and text extraction, optical character recognition (OCR) of images, and entity recognition of organizations.
138
+
Assume a pipeline that consists of document cracking of each PDF, image and text extraction, optical character recognition (OCR) of images, and entity recognition of organizations.
139
139
140
-
In this exercise, we're using the most expensive price per transaction. Actual costs could be lower due to graduated pricing. See [Cognitive Services pricing](https://azure.microsoft.com/pricing/details/cognitive-services).
140
+
The prices shown in this article are hypothetical. They're used to illustrate the estimation process. Your costs could be lower. For the actual prices of transactions, see See [Cognitive Services pricing](https://azure.microsoft.com/pricing/details/cognitive-services).
141
141
142
-
1. For document cracking with text and image content, text extraction is currently free. For 6000 images, assume $1 for every 1,000 images extracted, costing $6.00 for this step.
142
+
1. For document cracking with text and image content, text extraction is currently free. For 6,000 images, assume $1 for every 1,000 images extracted. That's a cost of $6.00 for this step.
143
143
144
144
2. For OCR of 6,000 images in English, the OCR cognitive skill uses the best algorithm (DescribeText). Assuming a cost of $2.50 per 1,000 images to be analyzed, you would pay $15.00 for this step.
145
145
146
-
3. For entity extraction, you would have a total of 3 text records per page. Each record is 1,000 characters. Three text records per page * 6,000 pages = 18,000 text records. Assuming $2.00 per 1,000 text records, this step would cost $36.00.
146
+
3. For entity extraction, you'd have a total of three text records per page. Each record is 1,000 characters. Three text records per page multiplied by 6,000 pages equals 18,000 text records. Assuming $2.00 per 1,000 text records, this step would cost $36.00.
147
147
148
-
Putting it all together, you would pay about $57.00 to ingest 1,000 PDF documents of this nature with the described skillset.
148
+
Putting it all together, you'd pay about $57.00 to ingest 1,000 PDF documents of this type with the described skillset.
0 commit comments