Skip to content

Commit 37eb640

Browse files
authored
Platform: Elasticsearch destination connector (#332)
1 parent d3938b8 commit 37eb640

File tree

5 files changed

+20
-21
lines changed

5 files changed

+20
-21
lines changed

mint.json

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -463,6 +463,7 @@
463463
"platform/destinations/azure-cognitive-search",
464464
"platform/destinations/databricks-volumes",
465465
"platform/destinations/delta-table",
466+
"platform/destinations/elasticsearch",
466467
"platform/destinations/google-cloud",
467468
"platform/destinations/milvus",
468469
"platform/destinations/mongodb",

platform/connectors.mdx

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,7 @@ If your source is not listed here, you might still be able to connect Unstructur
2626
- [Astra DB](/platform/destinations/astradb)
2727
- [Azure Cognitive Search](/platform/destinations/azure-cognitive-search)
2828
- [Delta Table](/platform/destinations/delta-table)
29+
- [Elasticsearch](/platform/destinations/elasticsearch)
2930
- [Google Cloud Storage](/platform/destinations/google-cloud)
3031
- [Milvus](/platform/destinations/milvus)
3132
- [MongoDB](/platform/destinations/mongodb)

platform/destinations/overview.mdx

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ To create a destination connector:
2020
- [Astra DB](/platform/destinations/astradb)
2121
- [Azure Cognitive Search](/platform/destinations/azure-cognitive-search)
2222
- [Delta Table](/platform/destinations/delta-table)
23+
- [Elasticsearch](/platform/destinations/elasticsearch)
2324
- [Google Cloud Storage](/platform/destinations/google-cloud)
2425
- [Milvus](/platform/destinations/milvus)
2526
- [MongoDB](/platform/destinations/mongodb)
Lines changed: 3 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,6 @@
11
Fill in the following fields:
22

33
- **Name** (_required_): A unique name for this connector.
4-
- **URL** (_required_): The Elasticsearch cluster URL.
5-
- **Batch Size** (_required_): The size limit (in bytes) for each batch of items.
6-
- **Index Name** (_required_): The name of the index in the Elasticsearch cluster.
7-
- **Username**: The username for the Elasticsearch cluster, if basic authentication is enabled.
8-
- **Password**: The password associated with the username.
9-
- **Cloud ID**: If using Elastic Cloud, the Cloud ID.
10-
- **API Key**: The Elastic Cloud API key for authentication, if this method is used.
11-
- **API Key ID**: The ID associated with the Elastic Cloud API key.
12-
- **Bearer Auth**: The bearer token for authentication, if this method is used.
13-
- **CA Certs**: The path to the Certificate Authority (CA) file on the instance, if this method is used.
14-
- **SSL Assert Fingerprint**: The certificate fingerprint, if this method is used.
4+
- **Host** (_required_): The endpoint URL for the target cluster.
5+
- **Index Name** (_required_): The name of the target index in the cluster.
6+
- **API Key** (_required_): The Elastic Cloud API key for the target cluster.

snippets/general-shared-text/elasticsearch.mdx

Lines changed: 14 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,20 @@
1-
The Elasticsearch prerequisites:
1+
The Elasticsearch prerequisites.
22

3-
- An Elasticsearch instance, such as an [Elastic Cloud](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#hosted-elasticsearch-service) service instance...
3+
- For the [Unstructured Platform](/platform/overview), only Elastic Cloud instances are supported.
4+
- For [Unstructured Ingest](/ingestion/overview), Elastic Cloud instances and self-manged Elasticsearch instances are supported.
5+
- For Elastic Cloud, you will need an [Elastic Cloud service instance](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#hosted-elasticsearch-service).
46

57
<iframe
68
width="560"
79
height="315"
8-
src="https://www.youtube.com/embed/-bmVLeEti1Q"
10+
src="https://www.youtube.com/embed/HEYIFC7uOus"
911
title="YouTube video player"
1012
frameborder="0"
1113
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture"
1214
allowfullscreen
1315
></iframe>
1416

15-
...or a [self-managed Elasticsearch](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#elasticsearch-deployment-options) instance.
17+
- For self-managed Elasticsearch, you will need a [self-managed Elasticsearch instance](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#elasticsearch-deployment-options).
1618

1719
<iframe
1820
width="560"
@@ -24,7 +26,7 @@ The Elasticsearch prerequisites:
2426
allowfullscreen
2527
></iframe>
2628

27-
- The name of the index on the instance. See [Create index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html) and [Get index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-index.html).
29+
- You will need the name of the index on the instance. See [Create index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html) and [Get index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-index.html).
2830

2931
The Elasticsearch index that you use must have a schema that is compatible with the schema of the documents
3032
that Unstructured produces for you. Unstructured cannot provide a schema that is guaranteed to work in all
@@ -94,8 +96,10 @@ The Elasticsearch prerequisites:
9496
allowfullscreen
9597
></iframe>
9698

97-
- If you're connecting to an Elastic Cloud instance, the Cloud ID and API key. To get these, see your Elasticsearch Service web console.
98-
- If you're connecting to a self-managed instance, the instance's hostname and port number. See [Networking](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-network.html).
99-
- If you're using basic authentication to the instance, the user's name and password.
100-
- If you're using token-based authentication to the instance, the bearer token or API key for the instance. See [Token-based authentication services](https://www.elastic.co/guide/en/elasticsearch/reference/current/token-authentication-services.html) and [Create API key](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-create-api-key.html).
101-
- If you're using certificate, the path to the Certificate Authority (CA) file on the instance, and the certificate fingerprint. See [SSL certificate API](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-ssl.html) and [Where can I see my Certificate Fingerprint?](https://discuss.elastic.co/t/where-can-i-see-my-certificate-fingerprint/319335/3).
99+
- For Elastic Cloud, you will need the Elastic Cloud service instance's API key. If you are using Unstructured Ingest, you will also need the instance's Cloud ID. To get these, see your Elasticsearch Service web console.
100+
- For self-managed Elasticsearch, you will need:
101+
102+
- The self-managed instance's hostname and port number. See [Networking](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-network.html).
103+
- If you're using basic authentication to the self-managed instance, the user's name and password.
104+
- If you're using token-based authentication to the self-managed instance, the bearer token or API key for the instance. See [Token-based authentication services](https://www.elastic.co/guide/en/elasticsearch/reference/current/token-authentication-services.html) and [Create API key](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-create-api-key.html).
105+
- If you're using certificate authentication to the self-managed instance, the path to the Certificate Authority (CA) file on the instance, and the certificate fingerprint. See [SSL certificate API](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-ssl.html) and [Where can I see my Certificate Fingerprint?](https://discuss.elastic.co/t/where-can-i-see-my-certificate-fingerprint/319335/3).

0 commit comments

Comments
 (0)