Skip to content

Commit 14e257d

Browse files
committed
Updates instructions for self-managed connectors
1 parent 84f3199 commit 14e257d

File tree

1 file changed

+59
-41
lines changed

1 file changed

+59
-41
lines changed

serverless/pages/ingest-your-data-ingest-data-through-integrations-connector-client.mdx

Lines changed: 59 additions & 41 deletions
Original file line numberDiff line numberDiff line change
@@ -24,35 +24,35 @@ Connector clients are available for the following third-party data sources:
2424
<DocAccordion buttonContent="Click to expand">
2525

2626
{/* TODO: Update links if these references move*/}
27-
- [Azure Blob Storage](https://www.elastic.co/guide/en/enterprise-search/master/connectors-azure-blob.html)
28-
- [Box](https://www.elastic.co/guide/en/enterprise-search/master/connectors-box.html)
29-
- [Confluence](https://www.elastic.co/guide/en/enterprise-search/master/connectors-confluence.html)
30-
- [Dropbox](https://www.elastic.co/guide/en/enterprise-search/master/connectors-dropbox.html)
31-
- [GitHub](https://www.elastic.co/guide/en/enterprise-search/master/connectors-github.html)
32-
- [Gmail](https://www.elastic.co/guide/en/enterprise-search/master/connectors-gmail.html)
33-
- [Google Cloud Storage](https://www.elastic.co/guide/en/enterprise-search/master/connectors-google-cloud.html)
34-
- [Google Drive](https://www.elastic.co/guide/en/enterprise-search/master/connectors-google-drive.html)
35-
- [GraphQL](https://www.elastic.co/guide/en/enterprise-search/master/connectors-graphql.html)
36-
- [Jira](https://www.elastic.co/guide/en/enterprise-search/master/connectors-jira.html)
37-
- [MicrosoftSQL](https://www.elastic.co/guide/en/enterprise-search/master/connectors-ms-sql.html)
38-
- [MongoDB](https://www.elastic.co/guide/en/enterprise-search/master/connectors-mongodb.html)
39-
- [MySQL](https://www.elastic.co/guide/en/enterprise-search/master/connectors-mysql.html)
40-
- [Network drive](https://www.elastic.co/guide/en/enterprise-search/master/connectors-network-drive.html)
41-
- [Notion](https://www.elastic.co/guide/en/enterprise-search/master/connectors-notion.html)
42-
- [OneDrive](https://www.elastic.co/guide/en/enterprise-search/master/connectors-onedrive.html)
43-
- [OpenText Documentum](https://www.elastic.co/guide/en/enterprise-search/master/connectors-opentext.html)
44-
- [Oracle](https://www.elastic.co/guide/en/enterprise-search/master/connectors-oracle.html)
45-
- [Outlook](https://www.elastic.co/guide/en/enterprise-search/master/connectors-outlook.html)
46-
- [PostgreSQL](https://www.elastic.co/guide/en/enterprise-search/master/connectors-postgresql.html)
47-
- [Redis](https://www.elastic.co/guide/en/enterprise-search/master/connectors-redis.html)
48-
- [S3](https://www.elastic.co/guide/en/enterprise-search/master/connectors-s3.html)
49-
- [Salesforce](https://www.elastic.co/guide/en/enterprise-search/master/connectors-salesforce.html)
50-
- [ServiceNow](https://www.elastic.co/guide/en/enterprise-search/master/connectors-servicenow.html)
51-
- [SharePoint Online](https://www.elastic.co/guide/en/enterprise-search/master/connectors-sharepoint-online.html)
52-
- [SharePoint Server](https://www.elastic.co/guide/en/enterprise-search/master/connectors-sharepoint.html)
53-
- [Slack](https://www.elastic.co/guide/en/enterprise-search/master/connectors-slack.html)
54-
- [Teams](https://www.elastic.co/guide/en/enterprise-search/master/connectors-teams.html)
55-
- [Zoom](https://www.elastic.co/guide/en/enterprise-search/master/connectors-zoom.html)
27+
- [Azure Blob Storage](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-azure-blob.html)
28+
- [Box](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-box.html)
29+
- [Confluence](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-confluence.html)
30+
- [Dropbox](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-dropbox.html)
31+
- [GitHub](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-github.html)
32+
- [Gmail](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-gmail.html)
33+
- [Google Cloud Storage](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-google-cloud.html)
34+
- [Google Drive](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-google-drive.html)
35+
- [GraphQL](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-graphql.html)
36+
- [Jira](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-jira.html)
37+
- [MicrosoftSQL](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-ms-sql.html)
38+
- [MongoDB](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-mongodb.html)
39+
- [MySQL](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-mysql.html)
40+
- [Network drive](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-network-drive.html)
41+
- [Notion](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-notion.html)
42+
- [OneDrive](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-onedrive.html)
43+
- [OpenText Documentum](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-opentext.html)
44+
- [Oracle](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-oracle.html)
45+
- [Outlook](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-outlook.html)
46+
- [PostgreSQL](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-postgresql.html)
47+
- [Redis](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-redis.html)
48+
- [S3](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-s3.html)
49+
- [Salesforce](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-salesforce.html)
50+
- [ServiceNow](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-servicenow.html)
51+
- [SharePoint Online](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-sharepoint-online.html)
52+
- [SharePoint Server](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-sharepoint.html)
53+
- [Slack](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-slack.html)
54+
- [Teams](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-teams.html)
55+
- [Zoom](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors-zoom.html)
5656
</DocAccordion>
5757

5858
## Overview
@@ -82,20 +82,19 @@ You'll need to check the [individual connector documentation](#available-connect
8282
## Initial setup in UI
8383

8484
In your project's UI, go to **((es)) → Connectors**.
85-
Read the high-level instructions under **Create a connector** to make sure you understand the process.
8685
Follow these steps:
8786

8887
1. Select **Create a connector**.
8988
2. Choose a third-party service from the list of connector types.
9089
3. Add a name and optional description to identify the connector.
9190
4. Copy the `connector_id`, `service_type`, and `elasticsearch.host` values printed to the screen.
9291
You'll need to update these values in your [`config.yml`](https://github.com/elastic/connectors/blob/main/config.yml) file.
93-
5. Make a note of your **((es)) endpoint** and **API key** values. You can create a new API key under **Security → API keys**.
94-
6. Run the connector code using one of the [options](#deploy-self-managed-connector) documented on this page.
92+
5. Navigate to **Elasticsearch → Home**, and make a note of your **((es)) endpoint** and **API key** values. You can create a new API key by clicking on **New** in the **API key** section.
93+
6. Run the connector code either from source or with Docker, following the instructions below.
9594

9695
## Deploy your self-managed connector
9796

98-
To use connector clients, you must deploy the connector service so your connector can talk to your ((es)) instance.
97+
To use connector clients, you must deploy the connector service so your connector can talk to your ((es)) instance.
9998
The source code is hosted in the `elastic/connectors` repository.
10099

101100
You have two deployment options:
@@ -104,8 +103,8 @@ You have two deployment options:
104103

105104
<DocCallOut title="">
106105
You'll need the following values handy to update your `config.yml` file:
107-
- `elasticsearch.host`: Your ((es)) endpoint. Find this in the **Get started** step in the UI.
108-
- `elasticsearch.api_key`: Your ((es)) API key. You can create API keys under **Security → API keys**. Once you connector is running, you'll be able to create a new API key that is limited to only access the connector's index.
106+
- `elasticsearch.host`: Your ((es)) endpoint. Printed to the screen when you create a new connector.
107+
- `elasticsearch.api_key`: Your ((es)) API key. You can create API keys by navigating to **Home**, and clicking **New** in the **API key** section. Once your connector is running, you'll be able to create a new API key that is limited to only access the connector's index.
109108
- `connector_id`: Unique id for your connector. Printed to the screen when you create a new connector.
110109
- `service_type`: Original data source type. Printed to the screen when you create a new connector.
111110
</DocCallOut>
@@ -121,8 +120,26 @@ Follow these steps:
121120
```shell
122121
git clone https://github.com/elastic/connectors
123122
```
124-
- Create a `config.yml` configuration file by copying this [example](https://github.com/elastic/connectors/blob/main/config.yml.example).
125-
- Replace the values for `host` (your ((es)) endpoint), `api_key`, `connector_id`, and `service_type`.
123+
- Open the `config.yml.example` file in the `connectors` repository and rename it to `config.yml`.
124+
- Update the following settings to match your environment:
125+
126+
* `elasticsearch.host`
127+
* `elasticsearch.api_key`
128+
* `connector id`
129+
* `service_type`
130+
131+
Your configuration file should look like this:
132+
133+
```yaml
134+
elasticsearch.host: <ELASTICSEARCH_ENDPOINT>
135+
elasticsearch.api_key: <ELASTICSEARCH_API_KEY>
136+
137+
connectors:
138+
-
139+
connector_id: <CONNECTOR_ID_FROM_UI>
140+
service_type: <SERVICE-NAME> # sharepoint_online (example)
141+
api_key: <CONNECTOR_API_KEY> # Optional. If not provided, the connector will use the elasticsearch.api_key instead
142+
```
126143
127144
<DocCallOut title="Tip">
128145
Learn more about the `config.yml` file in the [repo docs](https://github.com/elastic/connectors/blob/main/docs/CONFIG.md).
@@ -142,7 +159,7 @@ In your terminal or IDE:
142159
make run
143160
```
144161

145-
The connector service should now be running in your terminal. Your project's UI will let you know that the connector has successfully connected to your ((es)) instance.
162+
The connector service should now be running in your terminal. If the connection to your ((es)) instance was successful, the **Configure your connector** step will be activated in the project's UI.
146163

147164
Here we're working locally. In a production setup, you'll deploy the connector service to your own infrastructure.
148165

@@ -163,11 +180,12 @@ Change the `--output` argument value to the path where you want to save the conf
163180

164181
**Step 2: Update the configuration file for your self-managed connector**
165182

166-
Update the following settings to match your environment:
183+
- Update the following settings to match your environment:
167184

168185
* `elasticsearch.host`
169186
* `elasticsearch.api_key`
170-
* `connectors`
187+
* `connector id`
188+
* `service_type`
171189

172190
Your configuration file should look like this:
173191

@@ -241,7 +259,7 @@ Learn [how syncing works](https://github.com/elastic/connectors/blob/main/docs/D
241259

242260
## Learn more
243261

244-
- Read the main [Elastic connectors documentation](https://www.elastic.co/guide/en/enterprise-search/current/connectors.html)
262+
- Read the main [Elastic connectors documentation](https://www.elastic.co/guide/en/elasticsearch/reference/master/es-connectors.html)
245263
- The [Elastic connector framework](https://github.com/elastic/connectors/tree/main#connector-framework) enables you to:
246264
- Customize existing connector clients.
247265
- Build your own connector clients.

0 commit comments

Comments
 (0)