Skip to content

Commit 81b55ed

Browse files
committed
[flink] Optimize lookup table refresh with full load for snapshot backlog.
1 parent f00936f commit 81b55ed

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

docs/layouts/shortcodes/generated/flink_connector_configuration.html

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -92,6 +92,12 @@
9292
<td>Integer</td>
9393
<td>If the pending snapshot count exceeds the threshold, lookup operator will refresh the table in sync.</td>
9494
</tr>
95+
<tr>
96+
<td><h5>lookup.refresh.full-load-threshold</h5></td>
97+
<td style="word-wrap: break-word;">2147483647</td>
98+
<td>Integer</td>
99+
<td>If the pending snapshot count exceeds this threshold, lookup table will discard incremental updates and refresh the entire table from the latest snapshot. This can improve performance when there are many snapshots pending. Set to a reasonable value (e.g., 10) to enable this optimization. Default is Integer.MAX_VALUE (disabled). </td>
100+
</tr>
95101
<tr>
96102
<td><h5>lookup.refresh.time-periods-blacklist</h5></td>
97103
<td style="word-wrap: break-word;">(none)</td>

0 commit comments

Comments
 (0)