Skip to content

Commit a6acf5f

Browse files
committed
some writer edits to img retrieval concept
1 parent 6af3ddb commit a6acf5f

File tree

1 file changed

+19
-18
lines changed

1 file changed

+19
-18
lines changed

articles/cognitive-services/Computer-vision/concept-image-retrieval.md

Lines changed: 19 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -13,45 +13,46 @@ ms.date: 03/06/2023
1313
ms.author: pafarley
1414
---
1515

16-
# Image Retrieval
16+
# Image retrieval
1717

18-
Image Retrieval is a process of searching a large collection of images to find those that are most similar to a given query image. Image retrieval systems traditionally have used features extracted from the images, such as content labels, tags, image descriptors, to compare images and rank them by similarity. However, vector similarity search is gaining more popularity due to a no. of benefits over traditional keyword based search and is becoming a vital component in popular content search services.
18+
Image retrieval is the process of searching a large collection of images to find those that are most similar to a given query image. Image retrieval systems have traditionally used features extracted from the images, such as content labels, tags, and image descriptors, to compare images and rank them by similarity. However, vector similarity search is gaining more popularity due to a number of benefits over traditional keyword-based search and is becoming a vital component in popular content search services.
1919

20-
## Whats the difference between Vector search and Keyword based search?
20+
## What's the difference between vector search and keyword-based search?
2121

22-
Keyword search is the most basic and traditional method of information retrieval. In this approach, the search engine looks for the exact match of the keywords or phrases entered by the user in the search query and compares with labels and tags provided for the images. The search engine then returns images that contain those exact keywords as content tags and image labels. Keyword search relies heavily on the user's ability to input relevant and specific search terms.
22+
Keyword search is the most basic and traditional method of information retrieval. In this approach, the search engine looks for the exact match of the keywords or phrases entered by the user in the search query and compares with labels and tags provided for the images. The search engine then returns images that contain those exact keywords as content tags and image labels. Keyword search relies heavily on the user's ability to input relevant and specific search terms.
2323

24-
Vector search, on the other hand, searches large collections of vectors in high-dimensional space to find vectors that are similar to a given query. Vector search looks for semantic similarities by capturing the context and meaning of the search query. This approach is often more efficient than traditional image retrieval techniques, as it can reduce search space and improve the accuracy of the results
24+
Vector search, on the other hand, searches large collections of vectors in high-dimensional space to find vectors that are similar to a given query. Vector search looks for semantic similarities by capturing the context and meaning of the search query. This approach is often more efficient than traditional image retrieval techniques, as it can reduce search space and improve the accuracy of the results.
2525

26-
## Business Applications:
26+
## Business Applications
2727

2828
Image retrieval has a variety of applications in different fields, including:
2929

3030
- Digital asset management: Image retrieval can be used to manage large collections of digital images, such as in museums, archives, or online galleries. Users can search for images based on visual features and retrieve the images that match their criteria.
3131
- Medical image retrieval: Image retrieval can be used in medical imaging to search for images based on their diagnostic features or disease patterns. This can help doctors or researchers to identify similar cases or track disease progression.
3232
- Security and surveillance: Image retrieval can be used in security and surveillance systems to search for images based on specific features or patterns, such as in, people & object tracking, or threat detection.
33-
- Forensic image retrieval: Image retrieval can be used in forensic investigations to search for images based on their visual content or metadata, such as in cases of cybercrime.
34-
- E-commerce: Image retrieval can be used in online shopping applications to search for similar products based on their features or descriptions or provide recommendations based on the previous.
33+
- Forensic image retrieval: Image retrieval can be used in forensic investigations to search for images based on their visual content or metadata, such as in cases of cyber-crime.
34+
- E-commerce: Image retrieval can be used in online shopping applications to search for similar products based on their features or descriptions or provide recommendations based on previous purchases.
3535
- Fashion and design: Image retrieval can be used in fashion and design to search for images based on their visual features, such as color, pattern, or texture. This can help designers or retailers to identify similar products or trends.
3636

37-
## What are Vector Embeddings?
37+
## What are vector embeddings?
3838

39-
Vector embeddings are a way of representing contenttext or images, as vectors of real numbers in a high-dimensional space. Vector embeddings are often learned from large amounts of textual and visual data using machine learning algorithms, such as neural networks. Each dimension of the vector corresponds to a different feature or attribute of the content, such as its semantic meaning, syntactic role, or context in which it commonly appears.
39+
Vector embeddings are a way of representing content—text or images—as vectors of real numbers in a high-dimensional space. Vector embeddings are often learned from large amounts of textual and visual data using machine learning algorithms, such as neural networks. Each dimension of the vector corresponds to a different feature or attribute of the content, such as its semantic meaning, syntactic role, or context in which it commonly appears.
4040

4141
> [!NOTE]
42-
> Vector embeddings can only be meaningfully compared if they are from the same model type.
42+
> Vector embeddings can only be meaningfully compared if they are from the same model type.
4343
4444
## How does it work?
4545

4646
(image tbd)
4747

48-
- Vectorize Images & Text: Image Retrieval APIs (add reference link) - VectorizeImage and VectorizeText, can be used to extract feature vectors out of an image or text respectively. The APIs return a single feature vector representing the entire input.
49-
- Measure similarity: Vector search systems typically use distance metrics, such as cosine distance or Euclidean distance, to compare vectors and rank them by similarity. Vision studio (link) demo uses cosine distance (link to quick start code) to measure similarity.
50-
- Retrieve Images: Use the top N vectors similar to the search query and retrieve images corresponding to those vectors from your Photo library to provide as the final result.
48+
1. Vectorize Images and Text: the Image Retrieval APIs, **VectorizeImage** and **VectorizeText**, can be used to extract feature vectors out of an image or text respectively. The APIs return a single feature vector representing the entire input.
49+
- Measure similarity: Vector search systems typically use distance metrics, such as cosine distance or Euclidean distance, to compare vectors and rank them by similarity. The [Vision studio](https://portal.vision.cognitive.azure.com/) demo uses [cosine distance](./how-to/image-retrieval.md#calculate-vector-similarity) to measure similarity.
50+
- Retrieve Images: Use the top _N_ vectors similar to the search query and retrieve images corresponding to those vectors from your photo library to provide as the final result.
5151

52-
## Next steps
52+
## TBD limitaitons section
5353

54-
Enable image retrieval for your search service and follow the steps (add quick start link) to generate vector embeddings for text and images.
55-
* [Call the Analyze Image API](./how-to/image-retrieval.md)
54+
## Next steps
5655

57-
* Creating an Image Retrieval system at scale is challenging and if you’re interested in developing end-to-end image retrieval service with Azure AI for high volume data or have feedback to share, please reach out us at (add email)
56+
Enable image retrieval for your search service and follow the steps to generate vector embeddings for text and images.
57+
* [Call the Image retrieval APIs](./how-to/image-retrieval.md)
58+
* If you’re interested in developing an end-to-end image retrieval service with Azure AI for high volume data or have feedback to share, please reach out us at (tbd email)

0 commit comments

Comments
 (0)