Skip to content

Indexing Pressure should also account for the parsing memory #121651

@albertzaharovits

Description

@albertzaharovits

Description

Indexing pressure does not currently account for the extra heap memory required for parsing indexed documents, i.e. by the index.mapper.SourceToParse and jackson.core.util.ReadConstrainedTextBuffer classes. In the worst cases, the extra memory can be 1x and 2x, respectively, the memory of the indexed document (the memory that's accounted by the IndexingPressure).
In some cases this can OOM the node rather than reject the indexing request.

Metadata

Metadata

Assignees

No one assigned

    Labels

    :Distributed Indexing/CRUDA catch all label for issues around indexing, updating and getting a doc by id. Not search.>enhancementTeam:Distributed IndexingMeta label for Distributed Indexing team

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions