Skip to content

Commit c42bc77

Browse files
arunpandianpVardhanThigle
authored andcommitted
[Dataflow Streaming] Enable Windmill GetWork Response Batching by default (apache#33847)
With this change user workers will request batched responses from backend and backend will send multiple WorkItems in the same response proto. Backend changes are rollbacksafe. The feature can be disabled by passing `--windmillRequestBatchedGetWorkResponse=false`
1 parent bac0191 commit c42bc77

File tree

2 files changed

+5
-0
lines changed

2 files changed

+5
-0
lines changed

CHANGES.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,10 @@
8787
* Support the AnyOf Environment for execution in Prism ([#33705](https://github.com/apache/beam/pull/33705))
8888
* This improves support for developing Xlang pipelines, when using a compatible cross language service.
8989
* Partitions are now configurable for the DaskRunner in the Python SDK ([#33805](https://github.com/apache/beam/pull/33805)).
90+
* [Dataflow Streaming] Enable Windmill GetWork Response Batching by default ([#33847](https://github.com/apache/beam/pull/33847)).
91+
* With this change user workers will request batched GetWork responses from backend and backend will send multiple WorkItems in the same response proto.
92+
* The feature can be disabled by passing `--windmillRequestBatchedGetWorkResponse=false`
93+
9094

9195
## Breaking Changes
9296

runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/options/DataflowStreamingPipelineOptions.java

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -137,6 +137,7 @@ public interface DataflowStreamingPipelineOptions extends PipelineOptions {
137137
void setUseSeparateWindmillHeartbeatStreams(Boolean value);
138138

139139
@Description("If true, GetWorkStreams will request multiple work items in a response chunk.")
140+
@Default.Boolean(true)
140141
boolean getWindmillRequestBatchedGetWorkResponse();
141142

142143
void setWindmillRequestBatchedGetWorkResponse(boolean value);

0 commit comments

Comments
 (0)