-
Notifications
You must be signed in to change notification settings - Fork 25.6k
Fix setOnce in EmbeddingRequestChunker #114900
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| var errorResult = new ErrorChunkedInferenceResults(e); | ||
| for (var pos : positions) { | ||
| errors.setOnce(pos.inputIndex(), errorResult); | ||
| errors.set(pos.inputIndex(), errorResult); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Multiple chunks of the same input text can fail. In that case pos.inputIndex is the same and setOnce fails, leading to Elasticsearch crashing.
|
Pinging @elastic/ml-core (Team:ML) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
💔 Backport failedThe backport operation could not be completed due to the following error: You can use sqren/backport to manually backport by running |
No description provided.