You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/search/search-get-started-portal-image-search.md
+9-12Lines changed: 9 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
2
title: Quickstart image search
3
3
titleSuffix: Azure AI Search
4
-
description: Index and query images on Azure AI Search using the Azure portal. Run the Import and vectorize data wizard to vectorize images. Use Search Explorer to query images.
4
+
description: Search for images on Azure AI Search index using the Azure portal. Run the Import and vectorize data wizard to vectorize images, then use Search Explorer to provide an image as your query input.
5
5
6
6
author: HeidiSteen
7
7
ms.author: heidist
@@ -24,7 +24,7 @@ You need three Azure resources and some sample image files to complete this walk
24
24
> [!div class="checklist"]
25
25
> + Azure Storage to store image files as blobs
26
26
> + Azure AI services multiservice account, used for image vectorization and Optical Character Recognition (OCR)
27
-
> + Azure AI Search for indexing and queries
27
+
> + Azure AI Search for image vectorization during indexing and queries
28
28
29
29
Sample data consists of image files in the [azure-search-sample-data](https://github.com/Azure-Samples/azure-search-sample-data/tree/main/unsplash-images) repo, but you can use different images and still follow this walkthrough.
30
30
@@ -100,13 +100,14 @@ Azure AI Vision provides text embeddings, so we'll use that resource for text ve
100
100
101
101
Use Azure AI Vision to generate a vector representation of the image files.
102
102
103
-
In this step, you can also apply AI to extract text from images. The wizard uses OCR from Azure AI services to recognize text in image files. Two more outputs appear in the index when OCR is added to the workflow:
103
+
In this step, you can also apply AI to extract text from images. The wizard uses OCR from Azure AI services to recognize text in image files.
104
104
105
-
+ First, the "chunk" field is populated with the OCR-generated string.
105
+
Two more outputs appear in the index when OCR is added to the workflow:
106
106
107
-
+ Second, the "text_vector" field is populated with an embedding that represents the string.
107
+
+ First, the "chunk" field is populated with an OCR-generated string of any text in the image.
108
+
+ Second, the "text_vector" field is populated with an embedding that represents the "chunk" string.
108
109
109
-
The inclusion of plain text in an index is useful if you want to use relevance features that operate on strings, such as semantic ranking and scoring profiles.
110
+
The inclusion of plain text in the "chunk" field is useful if you want to use relevance features that operate on strings, such as [semantic ranking](semantic-search-overview.md) and [scoring profiles](index-add-scoring-profiles.md).
110
111
111
112
1. On the **Vectorize your images** page, select the **Vectorize images** checkbox, and then select **AI Vision vectorization**.
112
113
@@ -143,20 +144,16 @@ The inclusion of plain text in an index is useful if you want to use relevance f
143
144
+ Skillset with the following five skills:
144
145
145
146
+[OCR skill](cognitive-search-skill-ocr.md) recognizes text in image files.
146
-
147
147
+[Text Merger skill](cognitive-search-skill-textmerger.md) unifies the various outputs of OCR processing.
148
-
149
148
+[Text Split skill](cognitive-search-skill-textsplit.md) adds data chunking. This skill is built into the wizard workflow.
150
-
151
149
+[Azure AI Vision multimodal](cognitive-search-skill-vision-vectorize.md) is used to vectorize text generated from OCR.
152
-
153
150
+[Azure AI Vision multimodal](cognitive-search-skill-vision-vectorize.md) is called again to vectorize images.
154
151
155
152
+ Indexer with field mappings and output field mappings.
156
153
157
154
## Check results
158
155
159
-
Search explorer accepts text, vectors, and images as query inputs. You can drag or select an image into the search area, and it will be vectorized for search. Image vectorization assumes that your index has a vectorizer definition, which **Import and vectorize data** creates from your inputs.
156
+
Search explorer accepts text, vectors, and images as query inputs. You can drag or select an image into the search area, and it will be vectorized for search. Search Explorer vectorizes your image and sends the vector as a query input to the search engine. Image vectorization assumes that your index has a vectorizer definition, which **Import and vectorize data** creates from your inputs.
160
157
161
158
1. In the Azure portal, under **Search Management** and **Indexes**, select the index your created. An embedded Search Explorer is the first tab.
162
159
@@ -170,7 +167,7 @@ Search explorer accepts text, vectors, and images as query inputs. You can drag
170
167
171
168
:::image type="content" source="media/search-get-started-portal-images/image-search.png" alt-text="Screenshot of search results.":::
172
169
173
-
The top match should be the image you searched for. Because a vector search matches on similar vectors, the search engine returns any document that is sufficiently similar to the query input. You can switch to JSON view for more advanced queries that include relevance tuning.
170
+
The top match should be the image you searched for. Because a [vector search](vector-search-overview.md) matches on similar vectors, the search engine returns any document that is sufficiently similar to the query input, up to *k*-number of results. You can switch to JSON view for more advanced queries that include relevance tuning.
174
171
175
172
1. Try other query options to compare search outcomes:
| [Image search in the Azure portal](search-get-started-portal-image-search.md) | Feature | Search explorer now supports image search. In a vector index that has vectorized image content, you can drop images into Search Explorer to query for matching image content.
26
+
| [Image search in the Azure portal](search-get-started-portal-image-search.md) | Feature | Search explorer now supports image search. In a vector index that has vectorized image content, you can drop images into Search Explorer to query for a match.
0 commit comments