You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/components/pages/outputs/redpanda_migrator_offsets.adoc
+42-14Lines changed: 42 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,6 +15,8 @@ component_type_dropdown::[]
15
15
Use the `redpanda_migrator_offsets` output in conjunction with a `kafka_franz` input that is configured to read the `__consumer_offsets` topic.
16
16
This output uses the https://github.com/twmb/franz-go[Franz Kafka client library^].
17
17
18
+
Alternatively, use the `redpanda_migrator_bundle` xref:components:inputs/redpanda_migrator_bundle.adoc[input] and xref:components:outputs/redpanda_migrator_bundle.adoc[output] to complete the migration of topics, messages, and schemas to a Redpanda cluster.
19
+
18
20
19
21
ifndef::env-cloud[]
20
22
Introduced in version 4.37.0.
@@ -27,13 +29,16 @@ Common::
27
29
--
28
30
29
31
```yml
30
-
# Common config fields, showing default values
32
+
# Common configuration fields, showing default values
@@ -443,25 +451,45 @@ The maximum period of time after which metadata is refreshed.
443
451
444
452
*Default*: `5m`
445
453
454
+
=== offset_topic
455
+
456
+
The name of the Kafka offset topic to process. This field supports xref:configuration:interpolation.adoc#bloblang-queries[interpolation functions].
457
+
458
+
*Type*: `string`
446
459
447
-
=== `kafka_key`
460
+
*Default*: `${! @kafka_offset_topic }`
448
461
449
-
The Kafka message key.
462
+
=== offset_group
450
463
451
-
This field supports xref:configuration:interpolation.adoc#bloblang-queries[interpolation functions].
464
+
The name of the Kafka offset consumer group to process. This field supports xref:configuration:interpolation.adoc#bloblang-queries[interpolation functions].
452
465
453
466
*Type*: `string`
454
467
455
-
*Default*: `${! @kafka_key }`
468
+
*Default*: `${! @kafka_offset_group }`
456
469
470
+
=== offset_partition
457
471
458
-
=== `max_in_flight`
472
+
The Kafka offset partition ID to process. This field supports xref:configuration:interpolation.adoc#bloblang-queries[interpolation functions].
459
473
460
-
The maximum number of message batches to send in parallel at any given time.
474
+
*Type*: `string`
461
475
462
-
*Type*: `int`
476
+
*Default*: `${! @kafka_offset_partition }`
477
+
478
+
=== offset_commit_timestamp
479
+
480
+
The Kafka offset commit timestamp to process. This field supports xref:configuration:interpolation.adoc#bloblang-queries[interpolation functions].
481
+
482
+
*Type*: `string`
483
+
484
+
*Default*: `${! @kafka_offset_commit_timestamp }`
485
+
486
+
=== offset_metadata
487
+
488
+
The Kafka offset metadata value to process. This field supports xref:configuration:interpolation.adoc#bloblang-queries[interpolation functions].
0 commit comments