Skip to content

OpenSearch source for Serverless should default to point-in-time #6335

@dlvenable

Description

@dlvenable

Is your feature request related to a problem? Please describe.

When the opensearch source was originally created, Amazon OpenSearch Serverless did not support point-in-time. So the default behavior for the search is to use none rather than point-in-time (PIT). For other types, the source detects whether the cluster support PIT and then uses it if it does.

Describe the solution you'd like

Data Prepper's opensearch source should use PIT for Serverless by default.

Describe alternatives you've considered (Optional)

This can be done either as a breaking change in Data Prepper 3.0. Or it could just be done in the next minor version release.

If we change this in a minor version release, there is the possibility that existing pipelines will have different behavior if the pipeline is heavily designed with the expectation that PIT is not in use. But, I'm unsure if there really would be a significant pipeline configuration for such scenarios.

Additional context

N/A

Metadata

Metadata

Assignees

No one assigned

    Labels

    breaking changeAny change which may break existing configurations and deploymentsease-of-useImproving the ease-of-use for an existing feature

    Type

    No type

    Projects

    Status

    Unplanned

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions