Skip to content

Commit 932dfc3

Browse files
authored
IBM Milvus and watsonx.data connectors: minor how-to updates (#743)
1 parent c919899 commit 932dfc3

File tree

2 files changed

+33
-14
lines changed

2 files changed

+33
-14
lines changed

snippets/general-shared-text/ibm-watsonxdata.mdx

Lines changed: 23 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616
3. On the sidebar, under **Manage identities**, click **API keys**.
1717
4. With the **View** list showing **My IBM Cloud API keys**, click **Create**.
1818
5. Enter some **Name** and an optional **Description** for the API key.
19-
6. Leave **Leaked action** set to **Disable the leaked key** and **Session creation** set to **No**.
19+
6. Leave **Leaked action** set to **Disable the leaked key** and **Session management** set to **No**.
2020
7. Click **Create**.
2121
8. Click **Copy** or **Download** to copy or save the API key to a secure location. You won't be able to access this API key from this screen again.
2222

@@ -112,21 +112,34 @@
112112
8. Under **Storage**, click **IBM Cloud Object Storage**, and then click **Next**.
113113
9. Complete the on-screen instructions to finish creating the Iceberg catalog. This includes providing the following settings:
114114

115+
If you select **Discover COS instance**, you must provide the following settings:
116+
117+
- The name of the target COS instance.
118+
- The name of the target storage object (such as the target bucket) within the COS instance.
119+
- Some display name for the component.
120+
- After you provide this information, do the following:
121+
122+
a. Check the box labelled **Associate Catalog**.<br/>
123+
b. For **Catalog type**, select **Apache Iceberg**.<br/>
124+
c. Enter some **Catalog name**.<br/>
125+
b. Click **Associate**.<br/>
126+
127+
If you select **Register my own**, you must provide the following settings:
128+
115129
- Some display name for the component.
116130
- The name of the target bucket within the target Cloud Object Storage (COS) instance that you noted earlier.
117131
- The region for the target bucket, which you noted earlier.
118132
- The public endpoint for the target bucket, which you noted earlier. For this screen only, be sure to prefix the public endpoint with `https://`.
119133
- The HMAC access key ID for the target COS instance, which you noted earlier.
120134
- The HMAC secret access key for the target COS instance, which you noted earlier.
121-
122-
10. Next to **Connection status**, click **Test connection** to test the connection. Do not proceed until **Successful** is shown. If the connection is
123-
not successful, check the values you entered for the target bucket name, region, endpoint, access key, and secret access key, and try again.
124-
11. Check the box labelled **Associate Catalog**.
125-
12. Check the box labelled **Activate now**.
126-
13. Under **Associated catalog**, for **Catalog type**, select **Apache Iceberg**.
127-
14. Enter some **Catalog name**.
128-
15. Click **Associate**.
129-
16. On the sidebar, click **Infrastructure manager**. Make sure the catalog is associated with the appropriate engines. If it is not, rest your mouse
135+
- After you provide this information, do the following:
136+
137+
a. Check the box labelled **Associate Catalog**.<br/>
138+
b. For **Catalog type**, select **Apache Iceberg**.<br/>
139+
c. Enter some **Catalog name**.<br/>
140+
b. Click **Associate**.<br/>
141+
142+
10. On the sidebar, click **Infrastructure manager**. Make sure the catalog is associated with the appropriate engines. If it is not, rest your mouse
130143
on an unassociated target engine, click the **Manage associations** icon, check the box next to the target catalog's name, and then
131144
click **Save and restart engine**.
132145

snippets/general-shared-text/milvus.mdx

Lines changed: 10 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -84,8 +84,8 @@ The following video shows how to fulfill the minimum set of requirements for Mil
8484
- The [username and password, or token](https://milvus.io/docs/authenticate.md) to access the instance.
8585

8686
All Milvus instances require the target collection to have a defined schema before Unstructured can write to the collection. The minimum viable
87-
schema for Unstructured contains only the fields `element_id`, `embeddings`, and `record_id`, as follows. This example code demonstrates the use of the
88-
[Python SDK for Milvus](https://pypi.org/project/pymilvus/) to create a collection with this minimum viable schema,
87+
schema for Unstructured contains only the fields `element_id`, `embeddings`, and `record_id`, as follows. Adding a `text` field is optional but highly recommended.This example code demonstrates the use of the
88+
[Python SDK for Milvus](https://pypi.org/project/pymilvus/) to create a collection with this schema,
8989
targeting Milvus on IBM watsonx.data. For the `connections.connect` arguments to connect to other types of Milvus deployments, see your Milvus provider's documentation:
9090

9191
```python Python
@@ -126,8 +126,14 @@ record_id = FieldSchema(
126126
max_length=200
127127
)
128128

129+
text = FieldSchema(
130+
name="text",
131+
dtype=DataType.VARCHAR,
132+
max_length=65536
133+
)
134+
129135
schema = CollectionSchema(
130-
fields=[primary_key, vector, record_id],
136+
fields=[primary_key, vector, record_id, text],
131137
enable_dynamic_field=True
132138
)
133139

@@ -138,7 +144,7 @@ collection = Collection(
138144
)
139145

140146
index_params = {
141-
"metric_type": "COSINE",
147+
"metric_type": "L2",
142148
"index_type": "IVF_FLAT",
143149
"params": {"nlist": 1024}
144150
}

0 commit comments

Comments
 (0)