Skip to content

Conversation

ivancea
Copy link
Contributor

@ivancea ivancea commented Aug 1, 2025

Manual 8.17 backport of #132260

…ic#132260)

`DriverStatus` is an immutable record created by the Driver. However, its components are not inherently immutable.

This PR fixes a live collection used by the Driver, that was being directly put into the status, leading to `ConcurrentModificationException`s when reading it (Through the Task list API, for example).

Some example errors:
```
java.util.ConcurrentModificationException
	at java.base/java.util.ArrayList$Itr.checkForComodification(ArrayList.java:1096)
	at java.base/java.util.ArrayList$Itr.next(ArrayList.java:1050)
	at org.elasticsearch.compute.operator.DriverStatus.toXContent(DriverStatus.java:134)
	at [email protected]/org.elasticsearch.xcontent.XContentBuilder.value(XContentBuilder.java:993)
	at [email protected]/org.elasticsearch.xcontent.XContentBuilder.field(XContentBuilder.java:978)
	at [email protected]/org.elasticsearch.tasks.TaskInfo.toXContent(TaskInfo.java:113)
	at [email protected]/org.elasticsearch.action.admin.cluster.node.tasks.list.TaskGroup.toXContent(TaskGroup.java:63)
	at [email protected]/org.elasticsearch.action.admin.cluster.node.tasks.list.TaskGroup.toXContent(TaskGroup.java:67)
	at [email protected]/org.elasticsearch.action.admin.cluster.node.tasks.list.ListTasksResponse.lambda$groupedByParent$10(ListTasksResponse.java:183)
```
And:
```
java.util.ConcurrentModificationException
	at java.base/java.util.ArrayList$Itr.checkForComodification(ArrayList.java:1096)
	at java.base/java.util.ArrayList$Itr.next(ArrayList.java:1050)
	at org.elasticsearch.compute.operator.DriverStatus.documentsFound(DriverStatus.java:157)
	at org.elasticsearch.compute.operator.DriverStatus.toXContent(DriverStatus.java:129)
	at [email protected]/org.elasticsearch.xcontent.XContentBuilder.value(XContentBuilder.java:993)
	at [email protected]/org.elasticsearch.xcontent.XContentBuilder.field(XContentBuilder.java:978)
	at [email protected]/org.elasticsearch.tasks.TaskInfo.toXContent(TaskInfo.java:113)
	at org.elasticsearch.server@9.2.0org.elasticsearch.action.admin.cluster.node.tasks.list.TaskGroup.toXContent(TaskGroup.java:63)
	at [email protected]/org.elasticsearch.action.admin.cluster.node.tasks.list.TaskGroup.toXContent(TaskGroup.java:67)
	at [email protected]/org.elasticsearch.action.admin.cluster.node.tasks.list.ListTasksResponse.lambda$groupedByParent$10(ListTasksResponse.java:183)

```

Also, this looks like the source of this issue, with another similar case:
Fixes elastic#131564
@ivancea ivancea added >bug backport Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) :Analytics/ES|QL AKA ESQL v8.17.10 labels Aug 1, 2025
@ivancea ivancea merged commit 89b4ddd into elastic:8.17 Aug 4, 2025
16 checks passed
@ivancea ivancea deleted the backport-8.17-esql-driver-status-concurrency branch August 4, 2025 08:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL backport >bug Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v8.17.10

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant