Skip to content

Commit 9b930ce

Browse files
[Pull-based Ingestion] Add pointer-based lag interval setting (#11359)
* add pointer based lag interval setting Signed-off-by: Varun Bharadwaj <[email protected]> * Update _api-reference/document-apis/pull-based-ingestion.md Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Varun Bharadwaj <[email protected]> --------- Signed-off-by: Varun Bharadwaj <[email protected]> Co-authored-by: kolchfa-aws <[email protected]>
1 parent 10d7782 commit 9b930ce

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

_api-reference/document-apis/pull-based-ingestion.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -75,6 +75,7 @@ The `ingestion_source` parameters control how OpenSearch pulls data from the str
7575
| `num_processor_threads` | The number of threads for processing ingested data. Optional. Default is 1. |
7676
| `internal_queue_size` | The size of the internal blocking queue for advanced tuning. Valid values are from 1 to 100,000, inclusive. Optional. Default is 100. |
7777
| `all_active` | Whether to enable the all-active ingestion mode. Cannot be enabled for indexes that use segment replication mode. Default is `false`. See [Ingestion modes](#ingestion-modes). |
78+
| `pointer_based_lag_update_interval` | The interval at which pointer-based lag is calculated. Accepts time units. Default is `10s`. Setting this value to `0` disables pointer-based lag calculation. |
7879
| `param` | Source-specific configuration parameters. Required. <br>&ensp;&#x2022; The `ingest-kafka` plugin requires:<br>&ensp;&ensp;- `topic`: The Kafka topic to consume from<br>&ensp;&ensp;- `bootstrap_servers`: The Kafka server addresses<br>&ensp;&ensp;Optionally, you can provide additional standard Kafka consumer parameters (such as `fetch.min.bytes`). These parameters are passed directly to the Kafka consumer. <br>&ensp;&#x2022; The `ingest-kinesis` plugin requires:<br>&ensp;&ensp;- `stream`: The Kinesis stream name<br>&ensp;&ensp;- `region`: The AWS Region<br>&ensp;&ensp;- `access_key`: The AWS access key<br>&ensp;&ensp;- `secret_key`: The AWS secret key<br>&ensp;&ensp;Optionally, you can provide an `endpoint_override`. |
7980

8081

0 commit comments

Comments
 (0)