You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: learn/ai_powered_search/multimodal.mdx
+8-6Lines changed: 8 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,24 +5,26 @@ description:
5
5
6
6
# Image search with user-provided embeddings
7
7
8
-
This articles shows the main steps for performing multimodal searches where users use text to search through a database of images with no associated metadata.
8
+
This articles shows the main steps for performing multimodal searches where you can use text to search through a database of images with no associated metadata.
9
9
10
10
## Requirements
11
11
12
12
- A database of images
13
13
- A Meilisearch project
14
+
- An embedding generation tool you can install locally
14
15
15
16
## Configure your local embedding generation pipeline
16
17
17
18
First, set up a system that sends your images to your chosen embedding generation tool.
18
19
19
-
The exact procedure for this depend heavily on your specific setup, but should include these main steps:
20
+
The exact procedure depends heavily on your specific setup, but should include these main steps:
20
21
21
-
1. Choose a provider you can run locally
22
+
1. Choose a tool you can run locally
22
23
2. Choose a model that supports both image and text input
23
-
3. Send your images to the provider
24
+
3. Send your images to the embedding generation tool
24
25
4. Add the returned embeddings to the `_vector` field for each image in your database
25
-
5. Periodically send your vectorized documents to Meilisearch
26
+
27
+
In most cases your system should run these steps periodically or whenever you update your database.
26
28
27
29
## Configure a user-provided embedder
28
30
@@ -60,7 +62,7 @@ Since you are using a `userProvided` embedder, you must also generate the embedd
60
62
61
63
## Vector search with user-provided embeddings
62
64
63
-
Once you have the query's vector, pass it to the `vector` search parameter to perform a semantic AI-powered search:
65
+
Once you have the query's vector, pass it to the `vector` search parameter to perform a semantic AI-powered search:
64
66
65
67
```sh
66
68
curl -X POST -H 'content-type: application/json' \
0 commit comments