Skip to content

Bump common-streams to 0.11.0#399

Merged
Enes Aldemir (spenes) merged 1 commit intov2from
common-streams-0.11.0
Feb 13, 2025
Merged

Bump common-streams to 0.11.0#399
Enes Aldemir (spenes) merged 1 commit intov2from
common-streams-0.11.0

Conversation

@spenes
Copy link
Contributor

@spenes Enes Aldemir (spenes) commented Feb 12, 2025

common-streams 0.11.0 brings:

@spenes Enes Aldemir (spenes) force-pushed the common-streams-0.11.0 branch 2 times, most recently from bcd976f to eedeef6 Compare February 12, 2025 12:25
Enes Aldemir (spenes) added a commit that referenced this pull request Feb 12, 2025
@spenes Enes Aldemir (spenes) changed the title Bump common-streams to 0.11.0 Bump dependencies Feb 12, 2025
Enes Aldemir (spenes) added a commit that referenced this pull request Feb 12, 2025
Enes Aldemir (spenes) added a commit that referenced this pull request Feb 13, 2025
@istreeter
Copy link
Contributor

Hi Enes Aldemir (@spenes) sorry to nitpick... please could you add a commit message that briefly notes the most significant changes in common-streams, and how it affects this loader?

Via common-streams, we import some fairly major feature changes to the loaders. So it is helpful to see those feature changes in the git history of the loader.

See a couple of good examples of similar PRs:

Enes Aldemir (spenes) added a commit that referenced this pull request Feb 13, 2025
common-streams 0.11.0 brings:

- Debounce how often we checkpoint progress
  snowplow-incubator/common-streams#109
- Prefetch from pubsub source when parallelPullCount is 1
  snowplow-incubator/common-streams#110
- Dependencies upgrades
  snowplow-incubator/common-streams#112
Copy link
Contributor

@istreeter Ian Streeter (istreeter) left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Many thanks :)

common-streams 0.11.0 brings:

- Debounce how often we checkpoint progress. It allows to decrease the write-throughput
  requirements of the DynamoDB table for kinesis source and decrease the number of
  requests made to the kafka broker for kafka source.
  snowplow-incubator/common-streams#109
- Prefetch from pubsub source when parallelPullCount is 1. This means the pubsub source
  behaves more consistently across different parallelisms, and more similar to the
  other sources.
  snowplow-incubator/common-streams#110
- Dependencies upgrades
  snowplow-incubator/common-streams#112
@spenes Enes Aldemir (spenes) changed the title Bump dependencies Bump common-streams to 0.11.0 Feb 13, 2025
@spenes Enes Aldemir (spenes) merged commit 7e80c1b into v2 Feb 13, 2025
6 checks passed
Benjamin BENOIST (benjben) pushed a commit that referenced this pull request Feb 14, 2025
common-streams 0.11.0 brings:

- Debounce how often we checkpoint progress. It allows to decrease the write-throughput
  requirements of the DynamoDB table for kinesis source and decrease the number of
  requests made to the kafka broker for kafka source.
  snowplow-incubator/common-streams#109
- Prefetch from pubsub source when parallelPullCount is 1. This means the pubsub source
  behaves more consistently across different parallelisms, and more similar to the
  other sources.
  snowplow-incubator/common-streams#110
- Dependencies upgrades
  snowplow-incubator/common-streams#112
Benjamin BENOIST (benjben) pushed a commit that referenced this pull request Feb 14, 2025
common-streams 0.11.0 brings:

- Debounce how often we checkpoint progress. It allows to decrease the write-throughput
  requirements of the DynamoDB table for kinesis source and decrease the number of
  requests made to the kafka broker for kafka source.
  snowplow-incubator/common-streams#109
- Prefetch from pubsub source when parallelPullCount is 1. This means the pubsub source
  behaves more consistently across different parallelisms, and more similar to the
  other sources.
  snowplow-incubator/common-streams#110
- Dependencies upgrades
  snowplow-incubator/common-streams#112
Benjamin BENOIST (benjben) pushed a commit that referenced this pull request Feb 17, 2025
common-streams 0.11.0 brings:

- Debounce how often we checkpoint progress. It allows to decrease the write-throughput
  requirements of the DynamoDB table for kinesis source and decrease the number of
  requests made to the kafka broker for kafka source.
  snowplow-incubator/common-streams#109
- Prefetch from pubsub source when parallelPullCount is 1. This means the pubsub source
  behaves more consistently across different parallelisms, and more similar to the
  other sources.
  snowplow-incubator/common-streams#110
- Dependencies upgrades
  snowplow-incubator/common-streams#112
@benjben Benjamin BENOIST (benjben) deleted the common-streams-0.11.0 branch February 18, 2025 09:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants