Skip to content

Conversation

dnhatn
Copy link
Member

@dnhatn dnhatn commented Feb 12, 2025

With #117410, each remote sink now has its own listener, and the main query won't finish until all remote sink listeners have completed. As a result, we no longer need to wait for the exchange source to finish.

This change removes the completion listener to simplify the exchange service. The completion listener could previously return prematurely while remote sinks were still being registered.

Closes #122408

@dnhatn dnhatn added the auto-backport Automatically create backport pull requests when merged label Feb 13, 2025
@dnhatn dnhatn marked this pull request as ready for review February 13, 2025 00:51
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Feb 13, 2025
@dnhatn
Copy link
Member Author

dnhatn commented Feb 13, 2025

Thanks @smalyshev

@dnhatn dnhatn merged commit 03d7d34 into elastic:main Feb 13, 2025
17 checks passed
@dnhatn dnhatn deleted the no-callback branch February 13, 2025 01:57
@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Feb 13, 2025

dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Feb 13, 2025
With elastic#117410, each remote sink now has its own listener, and the main
query won't finish until all remote sink listeners have completed. As a
result, we no longer need to wait for the exchange source to finish.

This change removes the completion listener to simplify the exchange
service. The completion listener could previously return prematurely
while remote sinks were still being registered.

Closes elastic#122408
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Feb 13, 2025
With elastic#117410, each remote sink now has its own listener, and the main
query won't finish until all remote sink listeners have completed. As a
result, we no longer need to wait for the exchange source to finish.

This change removes the completion listener to simplify the exchange
service. The completion listener could previously return prematurely
while remote sinks were still being registered.

Closes elastic#122408
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Feb 13, 2025
With elastic#117410, each remote sink now has its own listener, and the main
query won't finish until all remote sink listeners have completed. As a
result, we no longer need to wait for the exchange source to finish.

This change removes the completion listener to simplify the exchange
service. The completion listener could previously return prematurely
while remote sinks were still being registered.

Closes elastic#122408
elasticsearchmachine pushed a commit that referenced this pull request Feb 13, 2025
)

With #117410, each remote sink now has its own listener, and the main
query won't finish until all remote sink listeners have completed. As a
result, we no longer need to wait for the exchange source to finish.

This change removes the completion listener to simplify the exchange
service. The completion listener could previously return prematurely
while remote sinks were still being registered.

Closes #122408
elasticsearchmachine pushed a commit that referenced this pull request Feb 13, 2025
)

With #117410, each remote sink now has its own listener, and the main
query won't finish until all remote sink listeners have completed. As a
result, we no longer need to wait for the exchange source to finish.

This change removes the completion listener to simplify the exchange
service. The completion listener could previously return prematurely
while remote sinks were still being registered.

Closes #122408
elasticsearchmachine pushed a commit that referenced this pull request Feb 13, 2025
)

With #117410, each remote sink now has its own listener, and the main
query won't finish until all remote sink listeners have completed. As a
result, we no longer need to wait for the exchange source to finish.

This change removes the completion listener to simplify the exchange
service. The completion listener could previously return prematurely
while remote sinks were still being registered.

Closes #122408
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL auto-backport Automatically create backport pull requests when merged >non-issue Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v8.18.1 v8.19.0 v9.0.1 v9.1.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CI] ExchangeServiceTests testExchangeSourceContinueOnFailure failing

3 participants