Skip to content

Commit 7303353

Browse files
docs: Chroma source to README.md (#35)
* refactor: Qdrant to Qdrant impl Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: qdrant.PtrOf Signed-off-by: Anush008 <anushshetty90@gmail.com> * Bump golangci/golangci-lint-action from 7 to 8 (#22) Bumps [golangci/golangci-lint-action](https://github.com/golangci/golangci-lint-action) from 7 to 8. - [Release notes](https://github.com/golangci/golangci-lint-action/releases) - [Commits](golangci/golangci-lint-action@v7...v8) --- updated-dependencies: - dependency-name: golangci/golangci-lint-action dependency-version: '8' dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump github.com/grpc-ecosystem/go-grpc-middleware/v2 from 2.3.1 to 2.3.2 (#21) Bumps [github.com/grpc-ecosystem/go-grpc-middleware/v2](https://github.com/grpc-ecosystem/go-grpc-middleware) from 2.3.1 to 2.3.2. - [Release notes](https://github.com/grpc-ecosystem/go-grpc-middleware/releases) - [Commits](grpc-ecosystem/go-grpc-middleware@v2.3.1...v2.3.2) --- updated-dependencies: - dependency-name: github.com/grpc-ecosystem/go-grpc-middleware/v2 dependency-version: 2.3.2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * chore: DRY Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: Prettify table Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: Nitfix Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: comment Signed-off-by: Anush008 <anushshetty90@gmail.com> * refactor: Don't change M Signed-off-by: Anush008 <anushshetty90@gmail.com> * refactor: Updated commons.go Signed-off-by: Anush008 <anushshetty90@gmail.com> * feat: Milvus Source Signed-off-by: Anush008 <anushshetty90@gmail.com> * refactor: Use nested flags Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: file renamed Signed-off-by: Anush008 <anushshetty90@gmail.com> * test: Milvus source Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: Formatting Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Prettify README * docs: CONTRIBUTING.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Update Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: MOre update Signed-off-by: Anush008 <anushshetty90@gmail.com> * Update README.md * chore: Use time.RFC3339 Signed-off-by: Anush008 <anushshetty90@gmail.com> * refactor: Renamed PrepareMigrationOffsetsCollection Signed-off-by: Anush008 <anushshetty90@gmail.com> * DRY Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: Use %q to log withing quotes Signed-off-by: Anush008 <anushshetty90@gmail.com> * refactor: Rename to offsetId Signed-off-by: Anush008 <anushshetty90@gmail.com> * Pinecone Signed-off-by: Anush008 <anushshetty90@gmail.com> * refactor: Pinecone source Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Pinecone source to README.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Notice Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: Lint fixes Signed-off-by: Anush008 <anushshetty90@gmail.com> * Update README.md * chore: Vector names Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Updated README.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: Updated docstring Signed-off-by: Anush008 <anushshetty90@gmail.com> * refactor: No index name Signed-off-by: Anush008 <anushshetty90@gmail.com> * refactor: Move flags Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Simplify examples Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: README.md update Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: README.md update Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: Set CreateCollection to true by default Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Updated README.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * chore: If ID already a valid UUID, use it directly Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: README.md update Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Chroma to README.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * Updated README.dm Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Updated README.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Pinecone source to README.md (#32) * docs: Prettify README * docs: CONTRIBUTING.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Update Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: MOre update Signed-off-by: Anush008 <anushshetty90@gmail.com> * Update README.md * docs: Pinecone source to README.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Notice Signed-off-by: Anush008 <anushshetty90@gmail.com> * Update README.md * docs: Updated README.md Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Simplify examples Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: README.md update Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: README.md update Signed-off-by: Anush008 <anushshetty90@gmail.com> * docs: Updated README.md Signed-off-by: Anush008 <anushshetty90@gmail.com> --------- Signed-off-by: Anush008 <anushshetty90@gmail.com> --------- Signed-off-by: Anush008 <anushshetty90@gmail.com> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 parent 1c9b173 commit 7303353

File tree

1 file changed

+63
-7
lines changed

1 file changed

+63
-7
lines changed

README.md

Lines changed: 63 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -7,9 +7,10 @@ CLI tool for migrating data to [Qdrant](http://qdrant.tech) with support for res
77
88
## Supported Sources
99

10+
* [Chroma](https://trychroma.com/)
1011
* [Pinecone](https://www.pinecone.io/)
11-
* [Milvus](https://milvus.io)
12-
* Another [Qdrant](http://qdrant.tech) instance
12+
* [Milvus](https://milvus.io/)
13+
* Another [Qdrant](http://qdrant.tech/) instance
1314

1415
## Installation
1516

@@ -33,6 +34,62 @@ docker pull registry.cloud.qdrant.io/library/qdrant-migration
3334
3435
<details>
3536

37+
<summary><h3>From Chroma</h3></summary>
38+
39+
Migrate data from a **Chroma** database to **Qdrant**:
40+
41+
### 📥 Example
42+
43+
```bash
44+
migration chroma \
45+
--chroma.url=http://localhost:8000
46+
--chroma.collection 'collection-name' \
47+
--qdrant.url 'https://example.cloud-region.cloud-provider.cloud.qdrant.io:6334' \
48+
--qdrant.api-key 'optional-qdrant-api-key' \
49+
--qdrant.collection 'target-collection' \
50+
--migration.batch-size 64
51+
````
52+
53+
With Docker:
54+
55+
```bash
56+
docker run --net=host --rm -it registry.cloud.qdrant.io/library/qdrant-migration chroma \
57+
--chroma.url=http://localhost:8000
58+
...
59+
```
60+
61+
### Chroma Options
62+
63+
| Flag | Description |
64+
| ----------------------- | ------------------------------------------------------------------------ |
65+
| `--chroma.collection` | Chroma collection name. |
66+
| `--chroma.url` | Chroma server URL Default: `"http://localhost:8000"` |
67+
| `--chroma.tenant` | Chroma tenant. Optional. |
68+
| `--chroma.auth-type` | Authentication type. `"basic"` or `"token"`. Optional. |
69+
| `--chroma.username` | Username for basic authentication. Optional. |
70+
| `--chroma.password` | Password for basic authentication. Optional. |
71+
| `--chroma.token` | Token for token authentication. Optional. |
72+
| `--chroma.token-header` | Token header for authentication. Optional. |
73+
| `--chroma.database` | Database name. Optional. |
74+
75+
### Qdrant Options
76+
77+
| Flag | Description |
78+
| ------------------------- | -------------------------------------------------------------------------------------------------- |
79+
| `--qdrant.collection` | Target collection name. |
80+
| `--qdrant.url` | Qdrant gRPC URL. Default: `"http://localhost:6334"` |
81+
| `--qdrant.api-key` | Qdrant API key. Optional. |
82+
| `--qdrant.dense-vector` | Name of the dense vector in Qdrant. Default: `"dense_vector"` |
83+
| `--qdrant.id-field` | Field storing Pinecone IDs in Qdrant. Default: `"__id__"` |
84+
| `--qdrant.distance` | Distance metric for the Qdrant collection. `"cosine"` or `"dot"` or `"euclid"`. Default: `"euclid"`|
85+
| `--qdrant.document-field` | Field storing Chroma documents in Qdrant. Default: `"document"` |
86+
87+
* See [Shared Migration Options](#shared-migration-options) for common migration parameters.
88+
89+
</details>
90+
91+
<details>
92+
3693
<summary><h3>From Pinecone</h3></summary>
3794

3895
Migrate data from a **Pinecone** database to **Qdrant**:
@@ -57,7 +114,6 @@ With Docker:
57114
```bash
58115
docker run --net=host --rm -it registry.cloud.qdrant.io/library/qdrant-migration pinecone \
59116
--pinecone.host 'https://example-index-12345.svc.region.pinecone.io' \
60-
--pinecone.api-key 'optional-pinecone-api-key' \
61117
...
62118
```
63119
@@ -73,8 +129,8 @@ docker run --net=host --rm -it registry.cloud.qdrant.io/library/qdrant-migration
73129
74130
| Flag | Description |
75131
| ------------------------------- | --------------------------------------------------------------- |
76-
| `--qdrant.url` | Qdrant gRPC URL (e.g. `https://your-qdrant-hostname:6334`) |
77132
| `--qdrant.collection` | Target collection name |
133+
| `--qdrant.url` | Qdrant gRPC URL. Default: `"http://localhost:6334"` |
78134
| `--qdrant.api-key` | Qdrant API key |
79135
| `--qdrant.dense-vector` | Name of the dense vector in Qdrant. Default: `"dense_vector"` |
80136
| `--qdrant.sparse-vector` | Name of the sparse vector in Qdrant. Default: `"sparse_vector"` |
@@ -129,7 +185,7 @@ docker run --net=host --rm -it registry.cloud.qdrant.io/library/qdrant-migration
129185
130186
| Flag | Description |
131187
| ------------------------------- | --------------------------------------------------------------- |
132-
| `--qdrant.url` | Qdrant gRPC URL (e.g. `https://your-qdrant-hostname:6334`) |
188+
| `--qdrant.url` | Qdrant gRPC URL. Default: `"http://localhost:6334"` |
133189
| `--qdrant.collection` | Target collection name |
134190
| `--qdrant.api-key` | Qdrant API key |
135191
@@ -167,16 +223,16 @@ NOTE: If the target collection already exists, its vector size and dimensions mu
167223
168224
| Flag | Description |
169225
| --------------------- | ---------------------------------------------------------- |
170-
| `--source.url` | Source gRPC URL (e.g. `https://your-qdrant-hostname:6334`) |
171226
| `--source.collection` | Source collection name |
227+
| `--source.url` | Source gRPC URL. Default: `"http://localhost:6334"` |
172228
| `--source.api-key` | API key for source instance |
173229
174230
#### Target Qdrant Options
175231
176232
| Flag | Description |
177233
| --------------------- | ---------------------------------------------------------- |
178-
| `--target.url` | Target gRPC URL (e.g. `https://your-qdrant-hostname:6334`) |
179234
| `--target.collection` | Target collection name |
235+
| `--target.url` | Target gRPC URL. Default: `"http://localhost:6334"` |
180236
| `--target.api-key` | API key for target instance |
181237
182238
See [Shared Migration Options](#shared-migration-options) for shared parameters.

0 commit comments

Comments
 (0)