Skip to content

Conversation

benironside
Copy link
Contributor

@benironside benironside commented Jul 11, 2025

Fixes internal/34 by documenting the new Content connectors interface, and the setup process for Elastic managed content connectors.

Preview: https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/2113/solutions/security/get-started/content-connectors

@benironside benironside self-assigned this Jul 11, 2025
@benironside benironside requested review from a team as code owners July 11, 2025 15:42
@benironside benironside added documentation Improvements or additions to documentation Team:Security labels Jul 11, 2025
Copy link

github-actions bot commented Jul 11, 2025

🔍 Preview links for changed docs

@dhru42
Copy link
Contributor

dhru42 commented Jul 14, 2025

To see a complete list of the available connectors, follow the setup instructions below.

is there a place where we can link users for full list of connectors? @benironside

Elastic's content connectors allow you to extract, transform, index, and sync data from third-party applications including Github, PagerDuty, Jira, OpsGenie, Teams, Google Drive, Slack, email, and more. To see a complete list of the available connectors, follow the setup instructions below.

## Setup
{{stack}} supports two deployment methods: Elastic managed, and self-managed. {{sec-serverless}} only supports Elastic managed deployments. Self-managed deployments require you to manage the {{elastic-agent}} that forwards data to Elastic and allow you to customize the connector's code, whereas Elastic managed deployments use agentless technology and do not allow customization.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
{{stack}} supports two deployment methods: Elastic managed, and self-managed. {{sec-serverless}} only supports Elastic managed deployments. Self-managed deployments require you to manage the {{elastic-agent}} that forwards data to Elastic and allow you to customize the connector's code, whereas Elastic managed deployments use agentless technology and do not allow customization.
{{stack}} supports two deployment methods for your connectors: Elastic managed, and self-managed. {{sec-serverless}} only supports Elastic managed connectors. Self-managed connectors require you to manage the {{elastic-agent}} that forwards data to Elastic and allow you to customize the connector's code, whereas Elastic managed connectors use agentless technology and do not allow customization.

Suggestion to avoid confusion with stack deployment models

Reading this paragraph, I also wonder about what this page states: https://www.elastic.co/docs/reference/search-connectors/

"As of Elastic 9.0, managed connectors on Elastic Cloud Hosted are no longer available. All connectors must be self-managed."

If I reconcile this paragraph with the sentence from that other page, that gives:

  • Serverless only supports Elastic managed connectors
  • ECH only supports self-managed connectors
  • What about other Stack deployment types?

I think we should try to clarify, as I either misunderstood, or we're giving conflicting/partial information in our various pages.

@leemthompo maybe you can help here?

Copy link
Contributor

@leemthompo leemthompo Jul 16, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes https://www.elastic.co/docs/reference/search-connectors/elastic-managed-connectors will have to be updated because now managed connectors have been revived by the Sec/Obs teams.

You'll need to update this page to mention the availability of managed connectors in certain serverless projects and 9.1+ ECH Obs/Sec navs.

That page is currently accurate for 9.0.

In 9.0:

  • Serverless only supports self-managed connectors
  • ECH only supports self-managed connectors
  • What about other Stack deployment types? You can't run a managed connector on a self-managed deployment.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tldr is self-managed connectors can send data to Elasticsearch instances wherever they may be deployed

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Managed connectors only send data to the serverless/hosted deployment they're deployed within

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this paragraph belongs under Setup btw

Elastic's content connectors allow you to extract, transform, index, and sync data from third-party applications including Github, PagerDuty, Jira, OpsGenie, Teams, Google Drive, Slack, email, and more. To see a complete list of the available connectors, follow the setup instructions below.

## Setup
{{stack}} supports two deployment methods: Elastic managed, and self-managed. {{sec-serverless}} only supports Elastic managed deployments. Self-managed deployments require you to manage the {{elastic-agent}} that forwards data to Elastic and allow you to customize the connector's code, whereas Elastic managed deployments use agentless technology and do not allow customization.
Copy link
Contributor

@leemthompo leemthompo Jul 16, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Connectors have two deployment methods: Elastic managed and self-managed.

Self-managed deployments require you to deploy the connector service on your own infrastructure (i.e. run some Python code on a server you manage). When you use managed connectors Elastic runs that Python service for you within your deployment.

Self-managed connectors can be customized, whereas Elastic managed connectors cannot.

I think the serverless distinction is a bit nuanced:

  • You can use self-managed connectors to send data to Elasticsearch on serverless
  • AFAICT you can now use managed connectors for Obs/Sec projects

Co-authored-by: florent-leborgne <[email protected]>
Co-authored-by: Liam Thompson <[email protected]>
@colleenmcginnis colleenmcginnis removed the request for review from a team July 23, 2025 22:32
Copy link
Contributor

@leemthompo leemthompo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Made a suggestion to clarify the managed versus self-managed issue, because self-managed connectors can send data to any Elasticsearch instance and can be managed independently of your ES instance.

Again I haven't seen the UI, so feel free to add to that section with useful information about the UI experience differences :)


## Setup

To learn about set up for self-managed connectors, refer to [Self managed connectors](elasticsearch://reference/search-connectors/self-managed-connectors.md). To set up an Elastic managed connector:
Copy link
Contributor

@leemthompo leemthompo Jul 31, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe make this into tabs, with Managed instructions as the first tab and link to self-managed instructions elsewhere

serverless: preview
---

# Content connectors
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

General remark, I haven't seen the new security UI, so consider adding a screenshot to this page if it would be helpful here, especially if it differs from previous generation of connector UIs


# Content connectors

Elastic's content connectors allow you to extract, transform, index, and sync data from third-party applications including Github, PagerDuty, Jira, Teams, Google Drive, Slack, email, and more ([view all connectors](elasticsearch://reference/search-connectors/index.md)).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PagerDuty isn't on that list, unless this is a new connector built by Security team?

Comment on lines 11 to 13
{{stack}} supports two deployment methods for your connectors: Elastic managed, and self-managed. Self-managed connectors require you to deploy on your own infrastructure (for example, run some Python code on a server you manage). When you use an Elastic managed connector, Elastic runs the infrastructure for you. Self-managed connectors can be customized, whereas Elastic managed connectors do not allow customization.

{{sec-serverless}} only supports Elastic managed connectors. {{stack}} deployments support either self-managed or Elastic managed deployments.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's ok to leave out of scope of this issue for now, but I see here a good opportunity for a small comparison table to make it easier to understand the differences between both modes.
If you'd rather not do it right now, please create an issue :)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The info should be good per #2113 (comment) at least, but yeah a table might be better format

Co-authored-by: Liam Thompson <[email protected]>
Co-authored-by: florent-leborgne <[email protected]>
Copy link
Contributor

@leemthompo leemthompo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

@florent-leborgne florent-leborgne left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @benironside!

@benironside benironside merged commit fbc5058 into main Jul 31, 2025
8 checks passed
@benironside benironside deleted the 34-Elastic-Connectors-in-Security branch July 31, 2025 16:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants