[Feature][Connectors-v2] kafka support multiple table sink#10154
[Feature][Connectors-v2] kafka support multiple table sink#10154misi1987107 wants to merge 16 commits intoapache:devfrom
Conversation
|
@misi1987107 retry ci |
|
|
||
| @Slf4j | ||
| public class KafkaMultiTableSinkIT extends TestSuiteBase implements TestResource { | ||
|
|
There was a problem hiding this comment.
There is already KafkaIT in e2e, why add a new KafkaMultiTableSinkIT?
There was a problem hiding this comment.
Ok,I can merge it
docs/zh/connector-v2/sink/Kafka.md
Outdated
| ### 多表写入 | ||
|
|
||
| Kafka Sink 支持将多个表的数据写入到不同的 Kafka topic。当上游数据源产生多个表的数据时，可以在 `topic` 配置中使用 `${table_name}` 占位符，根据表名动态路由数据到对应的 topic。 | ||
|
|
There was a problem hiding this comment.
${database_name} and ${schema_name} should also be supported
There was a problem hiding this comment.
The ${datasample_name} ${schema_name} variable is already supported, I will modify the document
|
@davidzollo Could you please review it, Thanks |
# Conflicts: # docs/en/connectors/sink/Kafka.md # docs/zh/connectors/sink/Kafka.md
# Conflicts: # seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kafka-e2e/src/test/java/org/apache/seatunnel/e2e/connector/kafka/KafkaIT.java
| String jobStatus = container.getJobStatus(String.valueOf(jobId)); | ||
| Assertions.assertEquals("CANCELED", jobStatus); | ||
| Assertions.assertEquals("CANCELING", jobStatus); |
There was a problem hiding this comment.
Why change the state of the original test class
There was a problem hiding this comment.
It cannot be transitioned from CANCELING to CANCELED
related #9995
There was a problem hiding this comment.
2026-02-09T04:29:04.3693872Z Caused by: org.opentest4j.AssertionFailedError: expected: CANCELED but was: CANCELING
2026-02-09T04:29:04.3694221Z at org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)
2026-02-09T04:29:04.3694564Z at org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)
2026-02-09T04:29:04.3694780Z at org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)
2026-02-09T04:29:04.3695186Z at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:182)
2026-02-09T04:29:04.3695447Z at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:177)
2026-02-09T04:29:04.3695648Z at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1141)
2026-02-09T04:29:04.3696146Z at org.apache.seatunnel.e2e.connector.kafka.KafkaKerberosIT.lambda$testNotKerberosConfig$4(KafkaKerberosIT.java:333)
2026-02-09T04:29:04.3696400Z at org.awaitility.core.AssertionCondition.lambda$new$0(AssertionCondition.java:53)
2026-02-09T04:29:04.3696814Z at org.awaitility.core.ConditionAwaiter$ConditionPoller.call(ConditionAwaiter.java:248)
2026-02-09T04:29:04.3697143Z at org.awaitility.core.ConditionAwaiter$ConditionPoller.call(ConditionAwaiter.java:235)
2026-02-09T04:29:04.3697305Z at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2026-02-09T04:29:04.3697659Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2026-02-09T04:29:04.3697899Z at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2026-02-09T04:29:04.3697999Z at java.lang.Thread.run(Thread.java:750)
This comment was marked as outdated.
This comment was marked as outdated.
Sorry, something went wrong.
corgy-w
changed the title
5 participants
Purpose of this pull request
#5652
kafka support multiple table sink
Does this PR introduce any user-facing change?
How was this patch tested?
Check list
New License Guide
incompatible-changes.mdto describe the incompatibility caused by this PR.