You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
summary: Find answers to commonly asked questions about Azure Cognitive Search.
15
15
@@ -21,11 +21,6 @@ sections:
21
21
answer: |
22
22
Azure Cognitive Search is a service on Azure that provides a dedicated search engine and persistent storage of your searchable content for full text search scenarios. It also includes optional, integrated AI used during indexing to extract more text and structure from raw content.
23
23
24
-
- question: |
25
-
Does Cognitive Search support vector search?
26
-
answer: |
27
-
No. Currently, Cognitive Search runs on a version of Apache Lucene that doesn't support vector search.
Copy file name to clipboardExpand all lines: articles/search/semantic-search-overview.md
+20-14Lines changed: 20 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,33 +8,39 @@ author: HeidiSteen
8
8
ms.author: heidist
9
9
ms.service: cognitive-search
10
10
ms.topic: conceptual
11
-
ms.date: 06/17/2022
11
+
ms.date: 04/26/2023
12
12
ms.custom: references_regions
13
13
---
14
14
# Semantic search in Azure Cognitive Search
15
15
16
16
> [!IMPORTANT]
17
17
> Semantic search is in public preview under [supplemental terms of use](https://azure.microsoft.com/support/legal/preview-supplemental-terms/). It's available through the Azure portal, preview REST API, and beta SDKs. These features are billable (see [Availability and pricing](semantic-search-overview.md#availability-and-pricing)).
18
18
19
-
Semantic search is a collection of query-related capabilities that bring semantic relevance and language understanding to search results. This article is a high-level introduction to semantic search. The embedded video describes the technology, and the section at the end covers availability and pricing.
19
+
Currently in Azure Cognitive Search, "semantic search" is a collection of query-related capabilities that bring semantic relevance and language understanding to textual search results. This article is a high-level introduction to semantic search. The embedded video describes the feature, and the section at the end covers availability and pricing.
20
20
21
-
Semantic search is a premium feature. We recommend this article for background, but if you'd rather get started, follow these steps:
21
+
Semantic search is a premium feature that's billed by usage. We recommend this article for background, but if you'd rather get started, follow these steps:
22
22
23
23
> [!div class="checklist"]
24
24
> *[Check regional and service tier requirements](#availability-and-pricing).
25
-
> *[Enable semantic search](#enable-semantic-search) on your search service.
25
+
> *[Enable semantic search for semantic ranking](#enable-semantic-search) on your search service.
26
26
> * Create or modify queries to [return semantic captions and highlights](semantic-how-to-query-request.md).
27
27
> * Add a few more query properties to also [return semantic answers](semantic-answers.md).
28
28
29
29
## What is semantic search?
30
30
31
-
Semantic search is a collection of features that improve the quality of search results. When enabled on your search service, it extends the query execution pipeline in two ways. First, it adds secondary ranking over an initial result set, promoting the most semantically relevant results to the top of the list. Second, it extracts and returns captions and answers in the response, which you can render on a search page to improve the user's search experience.
31
+
Semantic search is a collection of features that improve the quality of initial search results for text-based queries. When you enable it on your search service, semantic search extends the query execution pipeline in two ways:
32
+
33
+
* First, it adds secondary ranking over an initial result set, promoting the most semantically relevant results to the top of the list.
34
+
35
+
* Second, it extracts and returns captions and answers in the response, which you can render on a search page to improve the user's search experience.
36
+
37
+
Although semantic search and vector search are closely related, this particular feature doesn't provide vector search.
32
38
33
39
| Feature | Description |
34
40
|---------|-------------|
35
41
|[Semantic re-ranking](semantic-ranking.md)| Uses the context or semantic meaning of a query to compute a new relevance score over existing results. |
36
42
|[Semantic captions and highlights](semantic-how-to-query-request.md)| Extracts sentences and phrases from a document that best summarize the content, with highlights over key passages for easy scanning. Captions that summarize a result are useful when individual content fields are too dense for the results page. Highlighted text elevates the most relevant terms and phrases so that users can quickly determine why a match was considered relevant. |
37
-
|[Semantic answers](semantic-answers.md)| An optional and additional substructure returned from a semantic query. It provides a direct answer to a query that looks like a question. It requires that a document has text with the characteristics of an answer. |
43
+
|[Semantic answers](semantic-answers.md)| An optional and extra substructure returned from a semantic query. It provides a direct answer to a query that looks like a question. It requires that a document has text with the characteristics of an answer. |
38
44
39
45
## How semantic ranking works
40
46
@@ -58,23 +64,23 @@ Query execution proceeds as usual, with term parsing, analysis, and scans over t
58
64
59
65
In the preparation step, the document corpus returned from the initial result set is analyzed at the sentence and paragraph level to find passages that summarize each document. In contrast with keyword search, this step uses machine reading and comprehension to evaluate the content. Through this stage of content processing, a semantic query returns [captions](semantic-how-to-query-request.md) and [answers](semantic-answers.md). To formulate them, semantic search uses language representation to extract and highlight key passages that best summarize a result. If the search query is a question - and answers are requested - the response will also include a text passage that best answers the question, as expressed by the search query.
60
66
61
-
For both captions and answers, existing text is used in the formulation. The semantic models do not compose new sentences or phrases from the available content, nor does it apply logic to arrive at new conclusions. In short, the system will never return content that doesn't already exist.
67
+
For both captions and answers, existing text is used in the formulation. The semantic models don't compose new sentences or phrases from the available content, nor does it apply logic to arrive at new conclusions. In short, the system will never return content that doesn't already exist.
62
68
63
69
Results are then re-scored based on the [conceptual similarity](semantic-ranking.md) of query terms.
64
70
65
71
To use semantic capabilities in queries, you'll need to make small modifications to the [search request](semantic-how-to-query-request.md), but no extra configuration or reindexing is required.
66
72
67
73
## Semantic capabilities and limitations
68
74
69
-
Semantic search is a newer technology so it's important to set expectations about what it can and cannot do. What it can do is improve the quality of search by:
75
+
Semantic search is a newer technology so it's important to set expectations about what it can and can't do. What it can do is improve the quality of search by:
70
76
71
77
* Promoting matches that are semantically closer to the intent of original query.
72
78
73
79
* Finding strings in each result that can be used as captions, and potentially answers, that can be rendered on a search results page.
74
80
75
-
What it can't do is rerun the query over the entire corpus to find semantically relevant results. Semantic search re-ranks the *existing* result set, consisting of the top 50 results as scored by the default ranking algorithm. Furthermore, semantic search cannot create new information or strings. Captions and answers are extracted verbatim from your content so if the results do not include answer-like text, the language models will not produce one.
81
+
What it can't do is rerun the query over the entire corpus to find semantically relevant results. Semantic search re-ranks the *existing* result set, consisting of the top 50 results as scored by the default ranking algorithm. Furthermore, semantic search can't create new information or strings. Captions and answers are extracted verbatim from your content so if the results don't include answer-like text, the language models won't produce one.
76
82
77
-
Although semantic search is not beneficial in every scenario, certain content can benefit significantly from its capabilities. The language models in semantic search work best on searchable content that is information-rich and structured as prose. A knowledge base, online documentation, or documents that contain descriptive content see the most gains from semantic search capabilities.
83
+
Although semantic search isn't beneficial in every scenario, certain content can benefit significantly from its capabilities. The language models in semantic search work best on searchable content that is information-rich and structured as prose. A knowledge base, online documentation, or documents that contain descriptive content see the most gains from semantic search capabilities.
78
84
79
85
## Availability and pricing
80
86
@@ -85,11 +91,11 @@ Semantic search and spell check are available on services that meet the criteria
| Spell check | Basic <sup>2</sup> and above | All | None | None (free) |
87
93
88
-
<sup>1</sup> On the pricing page, scroll down to view additional features that are billed separately. At lower query volumes (under 1000 monthly), semantic search is free. To go above that limit, you can opt in to the semantic search standard pricing plan. The pricing page shows you the semantic query billing rate for different currencies and intervals.
94
+
<sup>1</sup> On the pricing page, scroll down to view more features that are billed separately. At lower query volumes (under 1000 monthly), semantic search is free. To go above that limit, you can opt in to the semantic search standard pricing plan. The pricing page shows you the semantic query billing rate for different currencies and intervals.
89
95
90
-
<sup>2</sup> Due to the provisioning mechanisms and lifespan of shared (free) search services, a small number of services happen to have spell check on the free tier. However, spell check availability on free tier services is not guaranteed and should not be expected.
96
+
<sup>2</sup> Due to the provisioning mechanisms and lifespan of shared (free) search services, a few services happen to have spell check on the free tier. However, spell check availability on free tier services isn't guaranteed and shouldn't be expected.
91
97
92
-
Charges for semantic search are levied when query requests include "queryType=semantic" and the search string is not empty (for example, "search=pet friendly hotels in New York". If your search string is empty ("search=*"), you won't be charged, even if the queryType is set to "semantic".
98
+
Charges for semantic search are levied when query requests include "queryType=semantic" and the search string isn't empty (for example, "search=pet friendly hotels in New York". If your search string is empty ("search=*"), you won't be charged, even if the queryType is set to "semantic".
93
99
94
100
## Enable semantic search
95
101
@@ -103,7 +109,7 @@ By default, semantic search is disabled on all services. To enable semantic sear
103
109
104
110
:::image type="content" source="media/semantic-search-overview/semantic-search-billing.png" alt-text="Screenshot of enabling semantic search in the Azure portal" border="true":::
105
111
106
-
Semantic Search's free plan is capped at 1,000 queries per month. After the first 1,000 queries in the free plan, you'll receive an error message letting you know you've exhausted your quota whenever you issue a semantic query. When this happens, you'll need to upgrade to the standard plan to continue using semantic search.
112
+
Semantic Search's free plan is capped at 1,000 queries per month. After the first 1,000 queries in the free plan, you'll receive an error message letting you know you've exhausted your quota whenever you issue a semantic query. When this happens, you need to upgrade to the standard plan to continue using semantic search.
107
113
108
114
Alternatively, you can also enable semantic search using the [Create or Update Service API](/rest/api/searchmanagement/2021-04-01-preview/services/create-or-update#searchsemanticsearch) that's described in the next section.
0 commit comments