Skip to content

Conversation

@dnhatn
Copy link
Member

@dnhatn dnhatn commented Feb 7, 2025

When a node is shutting down, scheduling tasks for the Driver can result in a rejection exception. In this case, we drain and close all operators. However, we don't clear the pending tasks in the scheduler, which can lead to a pending task being triggered unexpectedly, causing a ConcurrentModificationException

@dnhatn dnhatn force-pushed the fix-driver-exceptions branch 2 times, most recently from 264efe6 to 20904e8 Compare February 7, 2025 23:53
@dnhatn dnhatn added v9.0.1 v8.19.0 v8.18.1 >non-issue :Analytics/ES|QL AKA ESQL auto-backport Automatically create backport pull requests when merged labels Feb 7, 2025
@dnhatn dnhatn marked this pull request as ready for review February 7, 2025 23:56
@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Feb 7, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@dnhatn dnhatn requested review from nik9000 and smalyshev February 7, 2025 23:57
@dnhatn
Copy link
Member Author

dnhatn commented Feb 8, 2025

Thanks @smalyshev

@dnhatn dnhatn merged commit 2355103 into elastic:main Feb 8, 2025
17 checks passed
@dnhatn dnhatn deleted the fix-driver-exceptions branch February 8, 2025 05:13
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Feb 8, 2025
When a node is shutting down, scheduling tasks for the Driver can result 
in a rejection exception. In this case, we drain and close all
operators. However, we don't clear the pending tasks in the scheduler,
which can lead to a pending task being triggered unexpectedly, causing a
ConcurrentModificationException.
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Feb 8, 2025
When a node is shutting down, scheduling tasks for the Driver can result 
in a rejection exception. In this case, we drain and close all
operators. However, we don't clear the pending tasks in the scheduler,
which can lead to a pending task being triggered unexpectedly, causing a
ConcurrentModificationException.
@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
8.18
8.x
9.0

dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Feb 8, 2025
When a node is shutting down, scheduling tasks for the Driver can result 
in a rejection exception. In this case, we drain and close all
operators. However, we don't clear the pending tasks in the scheduler,
which can lead to a pending task being triggered unexpectedly, causing a
ConcurrentModificationException.
elasticsearchmachine pushed a commit that referenced this pull request Feb 8, 2025
When a node is shutting down, scheduling tasks for the Driver can result 
in a rejection exception. In this case, we drain and close all
operators. However, we don't clear the pending tasks in the scheduler,
which can lead to a pending task being triggered unexpectedly, causing a
ConcurrentModificationException.
elasticsearchmachine pushed a commit that referenced this pull request Feb 8, 2025
When a node is shutting down, scheduling tasks for the Driver can result 
in a rejection exception. In this case, we drain and close all
operators. However, we don't clear the pending tasks in the scheduler,
which can lead to a pending task being triggered unexpectedly, causing a
ConcurrentModificationException.
elasticsearchmachine pushed a commit that referenced this pull request Feb 8, 2025
When a node is shutting down, scheduling tasks for the Driver can result 
in a rejection exception. In this case, we drain and close all
operators. However, we don't clear the pending tasks in the scheduler,
which can lead to a pending task being triggered unexpectedly, causing a
ConcurrentModificationException.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL auto-backport Automatically create backport pull requests when merged >non-issue Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v8.18.1 v8.19.0 v9.0.1 v9.1.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants