|
| 1 | +--- |
| 2 | +layout: post |
| 3 | +title: "Introducing reusable Connections in the Debezium Platform" |
| 4 | +date: 2026-01-22 |
| 5 | +tags: [ UI, debezium-platform, integration, debezium operator, debezium, debezium-server ] |
| 6 | +author: indrashukla |
| 7 | +--- |
| 8 | + |
| 9 | +Since introducing the Debezium Management Platform (Debezium Platform), our goal has been to simplify how you build and manage CDC data pipelines—so you can focus on how your data flows, rather than repeatedly configuring the same infrastructure details. |
| 10 | + |
| 11 | +Earlier, connection-related properties (such as hostnames, ports, credentials, or authentication details) were defined directly as part of the Source or Destination configuration. |
| 12 | +While this worked, it often led to duplication, harder maintenance of the same connection details across multiple instances. |
| 13 | + |
| 14 | +To address this, we are introducing **Connections** as a first-class entity in the Debezium Platform. |
| 15 | + |
| 16 | +Connections allow you to define, validate, and reuse connection details independently, and then reference them from any number of Sources and Destinations. |
| 17 | + |
| 18 | +== What are Connections? |
| 19 | + |
| 20 | +A *Connection* represents the configuration required to connect to an external system, such as a source database or a sink endpoint. |
| 21 | + |
| 22 | +Instead of embedding these details inside each Source or Destination: |
| 23 | + |
| 24 | +* You create a Connection once |
| 25 | +* Validate it independently |
| 26 | +* Reuse it across multiple Sources and Destinations |
| 27 | + |
| 28 | +This makes pipelines easier to manage, safer to modify, and faster to set up. |
| 29 | + |
| 30 | +== Why introduce Connections? |
| 31 | + |
| 32 | +Separating connection details from Source and Destination configurations provides several benefits: |
| 33 | + |
| 34 | +**Reusability**:: |
| 35 | +A single Connection can be reused across multiple Sources or Destinations. |
| 36 | + |
| 37 | +**Centralized management**:: |
| 38 | +Update credentials or connection parameters in one place without editing every pipeline. |
| 39 | + |
| 40 | +**Early validation**:: |
| 41 | +Validate a Connection before it is ever used by a Source or Destination. |
| 42 | + |
| 43 | +**Cleaner configurations**:: |
| 44 | +Source and Destination definitions focus only on CDC and data flow logic, not infrastructure details. |
| 45 | + |
| 46 | +== Creating a Connection |
| 47 | + |
| 48 | +You can create a Connection directly from the catalog or during the resource creation flow. |
| 49 | + |
| 50 | +When creating a Connection, you define the connection-specific properties required to communicate with the external system (for example, database host, port, authentication details, or sink endpoint configuration). |
| 51 | + |
| 52 | +Once defined, the Connection can be validated independently to ensure it is correctly configured and reachable. |
| 53 | + |
| 54 | +[.centered-image.responsive-image] |
| 55 | +++++ |
| 56 | +<!-- Screenshot placeholder: Connection creation form --> |
| 57 | +++++ |
| 58 | + |
| 59 | +=== Validating a Connection |
| 60 | + |
| 61 | +A key part of the new Connection workflow is connection validation. |
| 62 | + |
| 63 | +After creating a Connection, you can explicitly validate it to verify that: |
| 64 | + |
| 65 | +* The configuration is complete |
| 66 | +* The platform can successfully connect to the target system |
| 67 | +* Authentication and network settings are correct |
| 68 | + |
| 69 | +This helps catch issues early—before a Source or Destination is created or a pipeline is executed. |
| 70 | + |
| 71 | +[.centered-image.responsive-image] |
| 72 | +++++ |
| 73 | +<!-- Screenshot placeholder: Connection validation result --> |
| 74 | +++++ |
| 75 | + |
| 76 | +== Using Connections in Sources and Destinations |
| 77 | + |
| 78 | +Once a Connection is created and validated, it becomes available for selection when creating Sources and Destinations. |
| 79 | + |
| 80 | +Instead of entering connection properties again, you simply reference an existing Connection. |
| 81 | +The Source or Destination then uses that Connection at runtime. |
| 82 | + |
| 83 | +[.centered-image.responsive-image] |
| 84 | +==== |
| 85 | +++++ |
| 86 | +<img src="/assets/images/2026-01-22-Debezium-platform-connection/connection-selector.gif" style="max-width:100%;" class="responsive-image" alt="Connection selector showing how to select or create a connection when configuring a Source"> |
| 87 | +++++ |
| 88 | +==== |
| 89 | + |
| 90 | +This allows the same Connection to be shared across: |
| 91 | + |
| 92 | +* Multiple Sources or Destination |
| 93 | +* Multiple pipelines |
| 94 | + |
| 95 | +== Updating existing workflows |
| 96 | + |
| 97 | +If you are already familiar with creating Sources and Destinations in the Debezium Platform, the overall workflow remains the same. |
| 98 | + |
| 99 | +The key difference is that connection-related properties are no longer embedded directly in the resource configuration. |
| 100 | +Instead, they are managed through reusable Connections, keeping configurations modular and easier to evolve over time. |
| 101 | + |
| 102 | +== Demo: Connections in action |
| 103 | + |
| 104 | +The following video demonstrates how to: |
| 105 | + |
| 106 | +* Create and validate a Connection |
| 107 | +* Reuse the Connection across multiple Sources and Destinations |
| 108 | +* Build a pipeline using shared Connections |
| 109 | + |
| 110 | +++++ |
| 111 | +<div class="responsive-video"> |
| 112 | +<!-- Video placeholder --> |
| 113 | +</div> |
| 114 | +++++ |
| 115 | + |
| 116 | +== More coming soon! |
| 117 | + |
| 118 | +Connections are a foundational step toward making the Debezium Platform more modular, maintainable, and scalable. |
| 119 | + |
| 120 | +We'll continue to build on this with further improvements and new features in upcoming releases. |
| 121 | + |
| 122 | +As always, feel free to leave a comment below or get in touch with us on the https://groups.google.com/forum/#!forum/debezium[mailing list] or in our https://debezium.zulipchat.com/login/#narrow/stream/302529-users[Zulip chat]. |
0 commit comments