Skip to content

Conversation

@shibd
Copy link
Member

@shibd shibd commented Jan 9, 2025

Motivation

Sometimes users want all multi-topics file send to a unified pathPrefix without topic name.

For examples:

  • topic 1: pathPrefix/24.14.23.json
  • topic 2: pathPrefix/24.14.23.json

Modifications

  • Add configuration(partitionerWithTopicName) to exclude topic on file path

Verifying this change

  • Add unit test to cover this.

Documentation

Check the box below.

Need to update docs?

  • doc-required

    (If you need help on updating docs, create a doc issue)

  • no-need-doc

    (Please explain why)

  • doc

    (If this PR contains doc changes)

@shibd shibd requested a review from a team as a code owner January 9, 2025 13:40
@github-actions github-actions bot added the doc This pr contains a document label Jan 9, 2025
@shibd shibd merged commit d0450e2 into streamnative:master Jan 10, 2025
1 check passed
shibd added a commit to shibd/pulsar-io-cloud-storage that referenced this pull request Jan 10, 2025
* Add configuration to exclude topic on file path

* add docs

(cherry picked from commit d0450e2)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

doc This pr contains a document

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants