Skip to content

Conversation

julian-elastic
Copy link
Contributor

@julian-elastic julian-elastic commented Oct 7, 2025

• Added Full Text Functions Support in Lookup Join Expressions: Extended lookup join functionality to support full-text functions like MATCH() as part of join conditions, enabling text search capabilities within lookup operations.
• Enhanced Lucene Pushable Filters Support. Implemented support for any Lucene pushable filters that contain only fields from the right side of the lookup join, allowing for more complex filtering conditions. At least one condition relating the left and right side of the Lookup Join is still required.

Full text function

FROM left_table
| LOOKUP JOIN right_table ON left_id == right_id AND MATCH(right_field, "search_term")

OR of Lucene pushable filters on fields from the lookup index

FROM left_table
| LOOKUP JOIN right_table ON left_id == right_id AND (right_field like "*pattern" OR right_value > 1000)

OR and NOT of Lucene pushable filters on fields from the lookup index

FROM left_table
| LOOKUP JOIN right_table ON (MATCH(right_field, "search_term") AND right_value < 5000 OR NOT (right_field != "exclude1" AND right_field != "exclude2")) AND left_id == right_id

@elasticsearchmachine elasticsearchmachine added needs:triage Requires assignment of a team area label v9.3.0 labels Oct 7, 2025
@julian-elastic julian-elastic self-assigned this Oct 7, 2025
@elasticsearchmachine elasticsearchmachine added Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) and removed needs:triage Requires assignment of a team area label labels Oct 7, 2025
@elasticsearchmachine
Copy link
Collaborator

Hi @julian-elastic, I've created a changelog YAML for you.

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

Copy link
Member

@carlosdelest carlosdelest left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM from the full text functions perspective 👍 :

  • Changes imply adding checks for lookup join conditions
  • IT tests have been updated with relevant tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL >enhancement Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v9.3.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants