You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/search/cognitive-search-tutorial-blob-dotnet.md
+14-20Lines changed: 14 additions & 20 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,10 +25,10 @@ Skillsets add AI processing to raw content, making that content more uniform and
25
25
This tutorial helps you learn how to:
26
26
27
27
> [!div class="checklist"]
28
-
> + Define objects in an enrichment pipeline
29
-
> + Build a skillset that invokes OCR, language detection, entity recognition, and key phrase extraction
30
-
> + Execute the pipeline to invoke transformations, and to create and load a search index
31
-
> + Check the results using full text search
28
+
> + Define objects in an enrichment pipeline.
29
+
> + Build a skillset. Invoke OCR, language detection, entity recognition, and key phrase extraction.
30
+
> + Execute the pipeline. Create and load a search index.
31
+
> + Check the results using full text search.
32
32
33
33
If you don't have an Azure subscription, open a [free account](https://azure.microsoft.com/free/?WT.mc_id=A261C142F) before you begin.
34
34
@@ -50,40 +50,36 @@ Once content is extracted, the [skillset](cognitive-search-working-with-skillset
50
50
51
51
+[Azure AI Search](search-create-app-portal.md)
52
52
53
-
+[Sample data files (mixed media)](https://github.com/Azure-Samples/azure-search-sample-data/tree/main/ai-enrichment-mixed-media)
54
-
55
53
> [!NOTE]
56
-
> You can use the free search service for this tutorial. A free search service limits you to three indexes, three indexers, and three data sources. This tutorial creates one of each. Before starting, make sure you have room on your service to accept the new resources.
54
+
> You can use a free search service for this tutorial. The free tier limits you to three indexes, three indexers, and three data sources. This tutorial creates one of each. Before starting, make sure you have room on your service to accept the new resources.
55
+
56
+
### Download files
57
+
58
+
Download a zip file of the sample data repository and extract the contents.
59
+
60
+
+[Sample data files (mixed media)](https://github.com/Azure-Samples/azure-search-sample-data/tree/main/ai-enrichment-mixed-media)
57
61
58
62
### Upload sample data to Azure Storage
59
63
60
64
1. In Azure Storage, create a new container and name it *cog-search-demo*.
61
65
62
66
1.[Upload the sample data files](/azure/storage/blobs/storage-quickstart-blobs-portal).
63
67
64
-
:::image type="content" source="media/cognitive-search-tutorial-blob/sample-files.png" alt-text="Screenshot of the files in File Explorer." border="true":::
65
-
66
68
1. Get a storage connection string so that you can formulate a connection in Azure AI Search.
67
69
68
70
1. On the left, select **Access keys**.
69
71
70
72
1. Copy the connection string for either key one or key two. The connection string is similar to the following example:
AI enrichment is backed by Azure AI services, including Language service and Azure AI Vision for natural language and image processing. For small workloads like this tutorial, you can use the free allocation of 20 transactions per indexer. For larger workloads, [attach an Azure AI Services multi-region resource to a skillset](cognitive-search-attach-cognitive-services.md) for pay-as-you-go pricing.
79
-
80
-
### Azure AI Search
81
-
82
-
The third component is Azure AI Search, which you can [create in the portal](search-create-service-portal.md) or [find an existing search service](https://portal.azure.com/#blade/HubsExtension/BrowseResourceBlade/resourceType/Microsoft.Search%2FsearchServices) in your subscription.
80
+
Built-in AI enrichment is backed by Azure AI services, including Language service and Azure AI Vision for natural language and image processing. For small workloads like this tutorial, you can use the free allocation of 20 transactions per indexer. For larger workloads, [attach an Azure AI Services multi-region resource to a skillset](cognitive-search-attach-cognitive-services.md) for pay-as-you-go pricing.
83
81
84
-
You can use the Free tier to complete this walkthrough.
85
-
86
-
### Copy a key and URL
82
+
### Copy a search service URL and API key
87
83
88
84
For this tutorial, connections to Azure AI Search require an endpoint and an API key. You can get these values from the Azure portal.
89
85
@@ -93,8 +89,6 @@ For this tutorial, connections to Azure AI Search require an endpoint and an API
93
89
94
90
:::image type="content" source="media/search-get-started-rest/get-url-key.png" alt-text="Screenshot of the URL and API keys in the Azure portal.":::
95
91
96
-
A valid API key establishes trust, on a per request basis, between the application sending the request and the search service handling it.
97
-
98
92
## Set up your environment
99
93
100
94
Begin by opening Visual Studio and creating a new Console App project that can run on .NET Core.
Copy file name to clipboardExpand all lines: articles/search/cognitive-search-tutorial-blob.md
+13-21Lines changed: 13 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -21,10 +21,10 @@ Skillsets add AI processing to raw content, making that content more uniform and
21
21
This tutorial helps you learn how to:
22
22
23
23
> [!div class="checklist"]
24
-
> + Define objects in an enrichment pipeline
25
-
> + Build a skillset that invokes OCR, language detection, entity recognition, and key phrase extraction
26
-
> + Execute the pipeline to invoke transformations, and to create and load a search index
27
-
> + Check the results using full text search
24
+
> + Define objects in an enrichment pipeline.
25
+
> + Build a skillset. Invoke OCR, language detection, entity recognition, and key phrase extraction.
26
+
> + Execute the pipeline. Create and load a search index.
27
+
> + Check the results using full text search.
28
28
29
29
If you don't have an Azure subscription, open a [free account](https://azure.microsoft.com/free/?WT.mc_id=A261C142F) before you begin.
30
30
@@ -44,42 +44,36 @@ Once content is extracted, the [skillset](cognitive-search-working-with-skillset
44
44
45
45
+[Azure AI Search](search-create-app-portal.md)
46
46
47
-
+[Sample data files (mixed media)](https://github.com/Azure-Samples/azure-search-sample-data/tree/main/ai-enrichment-mixed-media)
47
+
> [!NOTE]
48
+
> You can use a free search service for this tutorial. The free tier limits you to three indexes, three indexers, and three data sources. This tutorial creates one of each. Before starting, make sure you have room on your service to accept the new resources.
> You can use the free service for this tutorial. A free search service limits you to three indexes, three indexers, and three data sources. This tutorial creates one of each. Before starting, make sure you have room on your service to accept the new resources.
52
+
+[Sample data files (mixed media)](https://github.com/Azure-Samples/azure-search-sample-data/tree/main/ai-enrichment-mixed-media). Download a zip file of the sample data repository and extract the contents.
1. In Azure Storage, create a new container and name it *cog-search-demo*.
57
59
58
60
1.[Upload the sample data files](/azure/storage/blobs/storage-quickstart-blobs-portal).
59
61
60
-
:::image type="content" source="media/cognitive-search-tutorial-blob/sample-files.png" alt-text="Screenshot of the files in File Explorer." border="true":::
61
-
62
62
1. Get a storage connection string so that you can formulate a connection in Azure AI Search.
63
63
64
64
1. On the left, select **Access keys**.
65
65
66
66
1. Copy the connection string for either key one or key two. The connection string is similar to the following example:
AI enrichment is backed by Azure AI services, including Language service and Azure AI Vision for natural language and image processing. For small workloads like this tutorial, you can use the free allocation of twenty transactions per indexer. For larger workloads, [attach an Azure AI Services multi-region resource to a skillset](cognitive-search-attach-cognitive-services.md) for pay-as-you-go pricing.
75
-
76
-
### Azure AI Search
77
-
78
-
The third component is Azure AI Search, which you can [create in the portal](search-create-service-portal.md) or [find an existing search service](https://portal.azure.com/#blade/HubsExtension/BrowseResourceBlade/resourceType/Microsoft.Search%2FsearchServices) in your subscription.
74
+
Built-in AI enrichment is backed by Azure AI services, including Language service and Azure AI Vision for natural language and image processing. For small workloads like this tutorial, you can use the free allocation of twenty transactions per indexer. For larger workloads, [attach an Azure AI Services multi-region resource to a skillset](cognitive-search-attach-cognitive-services.md) for pay-as-you-go pricing.
79
75
80
-
You can use the Free tier to complete this walkthrough.
81
-
82
-
### Copy a key and URL
76
+
### Copy a search service URL and API key
83
77
84
78
For this tutorial, connections to Azure AI Search require an endpoint and an API key. You can get these values from the Azure portal.
85
79
@@ -89,8 +83,6 @@ For this tutorial, connections to Azure AI Search require an endpoint and an API
89
83
90
84
:::image type="content" source="media/search-get-started-rest/get-url-key.png" alt-text="Screenshot of the URL and API keys in the Azure portal.":::
91
85
92
-
A valid API key establishes trust, on a per request basis, between the application sending the request and the search service handling it.
93
-
94
86
## Set up your REST file
95
87
96
88
1. Start Visual Studio Code and open the [skillset-tutorial.rest](https://github.com/Azure-Samples/azure-search-rest-samples/tree/main/skillset-tutorial) file. See [Quickstart: Text search using REST](search-get-started-rest.md) if you need help with the REST client.
@@ -322,7 +322,14 @@ When you're working in your own subscription, it's a good idea at the end of a p
322
322
323
323
You can find and manage resources in the portal, using the **All resources** or **Resource groups** link in the left-navigation pane.
324
324
325
-
On a free service, remember the limitation of three indexes, indexers, and data sources. You can delete individual items in the portal to stay under the limit.
Copy file name to clipboardExpand all lines: articles/search/search-get-started-vector.md
+12-1Lines changed: 12 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -805,7 +805,18 @@ Here's the last query in the collection: a hybrid query, with semantic ranking,
805
805
806
806
## Clean up
807
807
808
-
Azure AI Search is a billable resource. If it's no longer needed, delete it from your subscription to avoid charges.
808
+
When you're working in your own subscription, it's a good idea at the end of a project to identify whether you still need the resources you created. Resources left running can cost you money. You can delete resources individually or delete the resource group to delete the entire set of resources.
809
+
810
+
You can find and manage resources in the portal, using the **All resources** or **Resource groups** link in the left-navigation pane.
*[Create](search-create-service-portal.md) or [find an existing search service](https://portal.azure.com/#blade/HubsExtension/BrowseResourceBlade/resourceType/Microsoft.Search%2FsearchServices)
36
+
*[Azure AI Search](search-what-is-azure-search.md). [Create](search-create-service-portal.md) or [find an existing search service](https://portal.azure.com/#blade/HubsExtension/BrowseResourceBlade/resourceType/Microsoft.Search%2FsearchServices)
37
37
38
38
> [!NOTE]
39
-
> You can use the free service for this tutorial. A free search service limits you to three indexes, three indexers, and three data sources. This tutorial creates one of each. Before starting, make sure you have room on your service to accept the new resources.
39
+
> You can use a free search service for this tutorial. The free tier limits you to three indexes, three indexers, and three data sources. This tutorial creates one of each. Before starting, make sure you have room on your service to accept the new resources.
Copy file name to clipboardExpand all lines: articles/search/search-query-partial-matching.md
+2-5Lines changed: 2 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -54,9 +54,6 @@ The approach looks like this:
54
54
1. Assign the analyzer to the field
55
55
1. Build and test the index
56
56
57
-
> [!TIP]
58
-
> Evaluating analyzers is an iterative process that requires frequent index rebuilds. You can make this step easier by using Postman, the REST APIs for [Create Index](/rest/api/searchservice/create-index), [Delete Index](/rest/api/searchservice/delete-index),[Load Documents](/rest/api/searchservice/addupdate-or-delete-documents), and [Search Documents](/rest/api/searchservice/search-documents). For Load Documents, the request body should contain a small representative data set that you want to test (for example, a field with phone numbers or product codes). With these APIs in the same Postman collection, you can cycle through these steps quickly.
59
-
60
57
## 1 - Create a dedicated field
61
58
62
59
Analyzers determine how terms are tokenized in an index. Since analyzers are assigned on a per-field basis, you can create fields in your index to optimize for different scenarios. For example, you might define "featureCode" and "featureCodeRegex" to support regular full text search on the first, and advanced pattern matching on the second. The analyzers assigned to each field determine how the contents of each field are tokenized in the index.
@@ -91,7 +88,7 @@ When choosing an analyzer that produces whole-term tokens, the following analyze
91
88
|[whitespace](https://lucene.apache.org/core/6_6_1/analyzers-common/org/apache/lucene/analysis/core/WhitespaceAnalyzer.html)| Separates on white spaces only. Terms that include dashes or other characters are treated as a single token. |
92
89
|[custom analyzer](index-add-custom-analyzers.md)| (recommended) Creating a custom analyzer lets you specify both the tokenizer and token filter. The previous analyzers must be used as-is. A custom analyzer lets you pick which tokenizers and token filters to use. <br><br>A recommended combination is the [keyword tokenizer](https://lucene.apache.org/core/6_6_1/analyzers-common/org/apache/lucene/analysis/core/KeywordTokenizer.html) with a [lower-case token filter](https://lucene.apache.org/core/6_6_1/analyzers-common/org/apache/lucene/analysis/core/LowerCaseFilter.html). By itself, the built-in [keyword analyzer](https://lucene.apache.org/core/6_6_1/analyzers-common/org/apache/lucene/analysis/core/KeywordAnalyzer.html) doesn't lower-case any upper-case text, which can cause queries to fail. A custom analyzer gives you a mechanism for adding the lower-case token filter. |
93
90
94
-
If you're using a web API test tool like Postman, you can add the [Test Analyzer REST call](/rest/api/searchservice/test-analyzer) to inspect tokenized output.
91
+
Using a REST client, you can add the [Test Analyzer REST call](/rest/api/searchservice/test-analyzer) to inspect tokenized output.
95
92
96
93
The index must exist on the search service, but it can be empty. Given an existing index and a field containing dashes or partial terms, you can try various analyzers over specific terms to see what tokens are emitted.
97
94
@@ -231,7 +228,7 @@ Once you've defined an index with analyzers and field definitions that support y
231
228
232
229
If you're familiar with Postman and REST APIs, [download the query examples collection](https://github.com/Azure-Samples/azure-search-rest-samples/) to query partial terms and special characters described in this article. The collection includes REST API requests for index creation and deletion, sample documents and an upload documents request, a test analyzer request, and queries.
233
230
234
-
The previous sections explained the logic. This section steps through each API you should call when testing your solution. As previously noted, if you use an interactive web test tool such as Postman, you can step through these tasks quickly.
231
+
The previous sections explained the logic. This section steps through each API you should call when testing your solution.
235
232
236
233
+[Delete Index](/rest/api/searchservice/delete-index) removes an existing index of the same name so that you can recreate it.
0 commit comments