Skip to content

Commit bbdff69

Browse files
authored
[Example] Image Search with Vision API (#447)
* backend * frontend * fix settings * Update README.md * Update README.md * refactor: remove cli entry * refactor: remove cli entry * refactor: pass image bytes * merge func * refactor: remove redundant check
1 parent ea47143 commit bbdff69

File tree

16 files changed

+1779
-0
lines changed

16 files changed

+1779
-0
lines changed

examples/image_search_example/.env

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
COCOINDEX_DATABASE_URL="postgresql://cocoindex:[email protected]:5432/cocoindex"
Lines changed: 61 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,61 @@
1+
# Image Search with CocoIndex
2+
3+
![image](https://github.com/user-attachments/assets/3a696344-c9b4-46e8-9413-6229dbb8672a)
4+
5+
- QDrant for Vector Storage
6+
- Ollama Gemma3 (Image to Text)
7+
- CLIP ViT-L/14 - Embeddings Model
8+
9+
## Make sure Postgres and Qdrant are running
10+
```
11+
docker run -d --name qdrant -p 6334:6334 qdrant/qdrant:latest
12+
export COCOINDEX_DATABASE_URL="postgres://cocoindex:cocoindex@localhost/cocoindex"
13+
```
14+
15+
## Create QDrant Collection
16+
```
17+
curl -X PUT
18+
'http://localhost:6333/collections/image_search' \
19+
--header 'Content-Type: application/json' \
20+
--data-raw '{
21+
"vectors": {
22+
"embedding": {
23+
"size": 768,
24+
"distance": "Cosine"
25+
}
26+
}
27+
}'
28+
29+
```
30+
31+
## Run Ollama
32+
```
33+
ollama pull gemma3
34+
ollama serve
35+
```
36+
37+
## Create virtual environment and install dependencies
38+
```
39+
python -m venv .venv
40+
source .venv/bin/activate
41+
pip install -r requirements.txt
42+
```
43+
44+
### Place your images in the `img` directory.
45+
46+
47+
## Run Backend
48+
```
49+
python main.py cocoindex setup
50+
python main.py cocoindex update
51+
uvicorn main:app --reload --host 0.0.0.0 --port 8000
52+
```
53+
54+
## Run Frontend
55+
```
56+
cd frontend
57+
npm install
58+
npm run dev
59+
```
60+
61+
Go to `http://localhost:5174` to search.
Lines changed: 136 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,136 @@
1+
# Logs
2+
logs
3+
*.log
4+
npm-debug.log*
5+
yarn-debug.log*
6+
yarn-error.log*
7+
lerna-debug.log*
8+
.pnpm-debug.log*
9+
10+
# Diagnostic reports (https://nodejs.org/api/report.html)
11+
report.[0-9]*.[0-9]*.[0-9]*.[0-9]*.json
12+
13+
# Runtime data
14+
pids
15+
*.pid
16+
*.seed
17+
*.pid.lock
18+
19+
# Directory for instrumented libs generated by jscoverage/JSCover
20+
lib-cov
21+
22+
# Coverage directory used by tools like istanbul
23+
coverage
24+
*.lcov
25+
26+
# nyc test coverage
27+
.nyc_output
28+
29+
# Grunt intermediate storage (https://gruntjs.com/creating-plugins#storing-task-files)
30+
.grunt
31+
32+
# Bower dependency directory (https://bower.io/)
33+
bower_components
34+
35+
# node-waf configuration
36+
.lock-wscript
37+
38+
# Compiled binary addons (https://nodejs.org/api/addons.html)
39+
build/Release
40+
41+
# Dependency directories
42+
node_modules/
43+
jspm_packages/
44+
45+
# Snowpack dependency directory (https://snowpack.dev/)
46+
web_modules/
47+
48+
# TypeScript cache
49+
*.tsbuildinfo
50+
51+
# Optional npm cache directory
52+
.npm
53+
54+
# Optional eslint cache
55+
.eslintcache
56+
57+
# Optional stylelint cache
58+
.stylelintcache
59+
60+
# Microbundle cache
61+
.rpt2_cache/
62+
.rts2_cache_cjs/
63+
.rts2_cache_es/
64+
.rts2_cache_umd/
65+
66+
# Optional REPL history
67+
.node_repl_history
68+
69+
# Output of 'npm pack'
70+
*.tgz
71+
72+
# Yarn Integrity file
73+
.yarn-integrity
74+
75+
# dotenv environment variable files
76+
.env
77+
.env.development.local
78+
.env.test.local
79+
.env.production.local
80+
.env.local
81+
82+
# parcel-bundler cache (https://parceljs.org/)
83+
.cache
84+
.parcel-cache
85+
86+
# Next.js build output
87+
.next
88+
out
89+
90+
# Nuxt.js build / generate output
91+
.nuxt
92+
dist
93+
94+
# Gatsby files
95+
.cache/
96+
# Comment in the public line in if your project uses Gatsby and not Next.js
97+
# https://nextjs.org/blog/next-9-1#public-directory-support
98+
# public
99+
100+
# vuepress build output
101+
.vuepress/dist
102+
103+
# vuepress v2.x temp and cache directory
104+
.temp
105+
.cache
106+
107+
# vitepress build output
108+
**/.vitepress/dist
109+
110+
# vitepress cache directory
111+
**/.vitepress/cache
112+
113+
# Docusaurus cache and generated files
114+
.docusaurus
115+
116+
# Serverless directories
117+
.serverless/
118+
119+
# FuseBox cache
120+
.fusebox/
121+
122+
# DynamoDB Local files
123+
.dynamodb/
124+
125+
# TernJS port file
126+
.tern-port
127+
128+
# Stores VSCode versions used for testing VSCode extensions
129+
.vscode-test
130+
131+
# yarn v2
132+
.yarn/cache
133+
.yarn/unplugged
134+
.yarn/build-state.yml
135+
.yarn/install-state.gz
136+
.pnp.*
Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
<!DOCTYPE html>
2+
<html lang="en">
3+
<head>
4+
<meta charset="UTF-8" />
5+
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
6+
<title>Image Search</title>
7+
</head>
8+
<body>
9+
<div id="root"></div>
10+
<script type="module" src="/src/main.jsx"></script>
11+
</body>
12+
</html>

0 commit comments

Comments
 (0)