Skip to content

Conversation

@antiguru
Copy link
Member

Timely recently gained a broadcast channel. This change switches the broadcast operator to using the broadcast channel. It also tests that Arc can be broadcasted.

This requires us to enable the "rc" feature on serde.

Timely recently gained a broadcast channel. This change switches the
broadcast operator to using the broadcast channel. It also tests that Arc
can be broadcasted.

This requires us to enable the "rc" feature on serde.

Signed-off-by: Moritz Hoffmann <[email protected]>
@antiguru antiguru requested a review from frankmcsherry June 25, 2025 08:20
Signed-off-by: Moritz Hoffmann <[email protected]>
@antiguru
Copy link
Member Author

Tests should be green after #677.

@antiguru antiguru changed the title Use broadcast channel for the operator Use broadcast channel for the broadcast operator Jun 25, 2025
@antiguru
Copy link
Member Author

Unfortunately this is not correct. In its current form it'd confuse progress tracking as each count on the input appears worker-times on the output. It's not a simple fix to change this, as we count before handing data off to a Tee. The pusher only sees what the Tee hands it, but at that time the counts are fixed already. Also, it doesn't have access to the produced counts.

Closing the PR because more work is necessary to enable this functionality.

@antiguru antiguru closed this Jun 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant