Skip to content

Commit 36150be

Browse files
committed
chore: announce kafka connector group ID generation strategy change
1 parent c9e3b79 commit 36150be

File tree

2 files changed

+25
-0
lines changed

2 files changed

+25
-0
lines changed

docs/components/connectors/out-of-the-box-connectors/kafka.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -291,6 +291,7 @@ In the **Authentication** section, select the **Authentication type**. If you se
291291

292292
In the **Kafka** section, you can configure the following properties:
293293

294+
- **Consumer Group ID**: Set the consumer group ID for this connector. It is strongly recommended to always provide an explicit value. Use a stable, application-specific identifier that represents the logical consumer group (for example, `my-app-order-processor`). If left empty, an ID is auto-generated from the connector's internal deduplication key — this generated ID may change across connector upgrades, causing Kafka to treat the connector as a new consumer group and potentially replay already-processed messages.
294295
- **Schema strategy**: Select the schema strategy for your messages.
295296
- Select **No schema**, **Inline schema** for Avro serialization.
296297
- Select **Schema registry** If you have a Confluent Schema Registry.
@@ -538,6 +539,10 @@ If any of the field is not populated, you must configure your security method fo
538539
enable.auto.commit=false
539540
```
540541

542+
:::caution
543+
The `group.id` value above is auto-generated when no explicit **Consumer Group ID** is configured in the connector. This generated ID is derived from the connector's internal deduplication key, which may change across connector upgrades (for example, when upgrading from 8.8 to 8.9). A changed group ID causes Kafka to treat the connector as a new consumer group, losing committed offsets and potentially replaying messages. It is strongly recommended to always set an explicit Consumer Group ID.
544+
:::
545+
541546
### What is the precedence of client properties loading?
542547

543548
Properties loading consists of three steps:

docs/reference/announcements-release-notes/890/890-announcements.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -543,6 +543,26 @@ For more information on optimizing connector performance with virtual threads, s
543543
</div>
544544
</div>
545545

546+
<div className="release-announcement-row">
547+
<div className="release-announcement-badge">
548+
<span className="badge badge--change">Change</span>
549+
</div>
550+
<div className="release-announcement-content">
551+
552+
#### Kafka Consumer connector: auto-generated consumer group ID format changed
553+
554+
When upgrading from Camunda 8.8 to 8.9, the auto-generated Kafka consumer group ID changes format. This is a side-effect of a runtime improvement that enables cross-version connector deduplication.
555+
556+
- **8.8 format:** `kafka-inbound-connector--<processDefinitionKey>-<elementId>` (numeric key)
557+
- **8.9 format:** `kafka-inbound-connector--<bpmnProcessId>-<hash>` (stable process ID)
558+
559+
Because Kafka treats a changed group ID as a brand-new consumer group, connectors using an auto-generated group ID after upgrading will lose their committed offsets and may reprocess messages.
560+
561+
**Action required:** Before upgrading to 8.9, set an explicit **Consumer Group ID** in each Kafka Consumer connector configuration to preserve consumer group identity. See the [Kafka connector documentation](/components/connectors/out-of-the-box-connectors/kafka.md?kafka=inbound) for details.
562+
563+
</div>
564+
</div>
565+
546566
## Data
547567

548568
<div className="release-announcement-row">

0 commit comments

Comments
 (0)