-
Notifications
You must be signed in to change notification settings - Fork 25.6k
Make ILMHistoryStore semi-project-aware
#129933
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Ensures the history store is able to index documents into a non-default project, but it doesn't actually work with multiple concurrent projects.
| // Even though this looks project-aware, it's not really. The bulk processor flushes the history items at "arbitrary" moments, | ||
| // meaning it will send bulk requests with history items of multiple projects, but the _bulk API will index everything into | ||
| // the project of the last history item that came in. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I plan to add an annotation and use it here before I merge this PR.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I guess the same conversation as on the other PR about assertions applies here?
|
Pinging @elastic/es-data-management (Team:Data Management) |
PeteGillinElastic
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM pending the discussion on whether we can assert.
| // Even though this looks project-aware, it's not really. The bulk processor flushes the history items at "arbitrary" moments, | ||
| // meaning it will send bulk requests with history items of multiple projects, but the _bulk API will index everything into | ||
| // the project of the last history item that came in. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I guess the same conversation as on the other PR about assertions applies here?
Ensures the history store is able to index documents into a non-default project, but it doesn't actually work with multiple concurrent projects.
Ensures the history store is able to index documents into a non-default project, but it doesn't actually work with multiple concurrent projects.