Skip to content

Conversation

@nielsbauman
Copy link
Contributor

Ensures the history store is able to index documents into a non-default project, but it doesn't actually work with multiple concurrent projects.

Ensures the history store is able to index documents into a non-default
project, but it doesn't actually work with multiple concurrent projects.
@nielsbauman nielsbauman added >non-issue :Data Management/ILM+SLM Index and Snapshot lifecycle management labels Jun 24, 2025
Comment on lines +186 to +188
// Even though this looks project-aware, it's not really. The bulk processor flushes the history items at "arbitrary" moments,
// meaning it will send bulk requests with history items of multiple projects, but the _bulk API will index everything into
// the project of the last history item that came in.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I plan to add an annotation and use it here before I merge this PR.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess the same conversation as on the other PR about assertions applies here?

@elasticsearchmachine elasticsearchmachine added v9.1.0 Team:Data Management Meta label for data/management team labels Jun 24, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

Copy link
Member

@PeteGillinElastic PeteGillinElastic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM pending the discussion on whether we can assert.

Comment on lines +186 to +188
// Even though this looks project-aware, it's not really. The bulk processor flushes the history items at "arbitrary" moments,
// meaning it will send bulk requests with history items of multiple projects, but the _bulk API will index everything into
// the project of the last history item that came in.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess the same conversation as on the other PR about assertions applies here?

@nielsbauman nielsbauman enabled auto-merge (squash) June 27, 2025 13:12
@nielsbauman nielsbauman merged commit e955872 into elastic:main Jun 27, 2025
33 checks passed
@nielsbauman nielsbauman deleted the ilm-history-mp branch June 27, 2025 14:46
mridula-s109 pushed a commit to mridula-s109/elasticsearch that referenced this pull request Jul 3, 2025
Ensures the history store is able to index documents into a non-default
project, but it doesn't actually work with multiple concurrent projects.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Data Management/ILM+SLM Index and Snapshot lifecycle management >non-issue Team:Data Management Meta label for data/management team v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants