Bump common-streams to 0.11.0#399
Merged
Enes Aldemir (spenes) merged 1 commit intov2from Feb 13, 2025
Merged
Conversation
bcd976f to
eedeef6
Compare
Enes Aldemir (spenes)
added a commit
that referenced
this pull request
Feb 12, 2025
eedeef6 to
1a9177d
Compare
Enes Aldemir (spenes)
added a commit
that referenced
this pull request
Feb 12, 2025
1a9177d to
b37e0ee
Compare
Enes Aldemir (spenes)
added a commit
that referenced
this pull request
Feb 13, 2025
b37e0ee to
235cc74
Compare
Contributor
|
Hi Enes Aldemir (@spenes) sorry to nitpick... please could you add a commit message that briefly notes the most significant changes in common-streams, and how it affects this loader? Via common-streams, we import some fairly major feature changes to the loaders. So it is helpful to see those feature changes in the git history of the loader. See a couple of good examples of similar PRs: |
Enes Aldemir (spenes)
added a commit
that referenced
this pull request
Feb 13, 2025
common-streams 0.11.0 brings: - Debounce how often we checkpoint progress snowplow-incubator/common-streams#109 - Prefetch from pubsub source when parallelPullCount is 1 snowplow-incubator/common-streams#110 - Dependencies upgrades snowplow-incubator/common-streams#112
235cc74 to
353f078
Compare
Ian Streeter (istreeter)
approved these changes
Feb 13, 2025
Contributor
Ian Streeter (istreeter)
left a comment
There was a problem hiding this comment.
Many thanks :)
common-streams 0.11.0 brings: - Debounce how often we checkpoint progress. It allows to decrease the write-throughput requirements of the DynamoDB table for kinesis source and decrease the number of requests made to the kafka broker for kafka source. snowplow-incubator/common-streams#109 - Prefetch from pubsub source when parallelPullCount is 1. This means the pubsub source behaves more consistently across different parallelisms, and more similar to the other sources. snowplow-incubator/common-streams#110 - Dependencies upgrades snowplow-incubator/common-streams#112
353f078 to
7e80c1b
Compare
Benjamin BENOIST (benjben)
pushed a commit
that referenced
this pull request
Feb 14, 2025
common-streams 0.11.0 brings: - Debounce how often we checkpoint progress. It allows to decrease the write-throughput requirements of the DynamoDB table for kinesis source and decrease the number of requests made to the kafka broker for kafka source. snowplow-incubator/common-streams#109 - Prefetch from pubsub source when parallelPullCount is 1. This means the pubsub source behaves more consistently across different parallelisms, and more similar to the other sources. snowplow-incubator/common-streams#110 - Dependencies upgrades snowplow-incubator/common-streams#112
Benjamin BENOIST (benjben)
pushed a commit
that referenced
this pull request
Feb 14, 2025
common-streams 0.11.0 brings: - Debounce how often we checkpoint progress. It allows to decrease the write-throughput requirements of the DynamoDB table for kinesis source and decrease the number of requests made to the kafka broker for kafka source. snowplow-incubator/common-streams#109 - Prefetch from pubsub source when parallelPullCount is 1. This means the pubsub source behaves more consistently across different parallelisms, and more similar to the other sources. snowplow-incubator/common-streams#110 - Dependencies upgrades snowplow-incubator/common-streams#112
Benjamin BENOIST (benjben)
pushed a commit
that referenced
this pull request
Feb 17, 2025
common-streams 0.11.0 brings: - Debounce how often we checkpoint progress. It allows to decrease the write-throughput requirements of the DynamoDB table for kinesis source and decrease the number of requests made to the kafka broker for kafka source. snowplow-incubator/common-streams#109 - Prefetch from pubsub source when parallelPullCount is 1. This means the pubsub source behaves more consistently across different parallelisms, and more similar to the other sources. snowplow-incubator/common-streams#110 - Dependencies upgrades snowplow-incubator/common-streams#112
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
common-streams 0.11.0 brings: