Skip to content

[feat][sink][pulsar]: add chunk config in the pulsar sink to support large message #9598

@ericsyh

Description

@ericsyh

Is your feature request related to a problem?

chunking is an important feature in Pulsar support large payload messages by splitting the message into chunks. And b/c TiDB is distributed database and could generate very large binlog so the chunk will be required under this scenario.

Describe the feature you'd like

Since the pulsar-client-go has supported the chunk by PR apache/pulsar-client-go#805 and released in 0.10, TiCDC should be able to add the chunk config to support.

Describe alternatives you've considered

No response

Teachability, Documentation, Adoption, Migration Strategy

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    type/featureIssues about a new feature

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions