Skip to content

Conversation

@lkts
Copy link
Contributor

@lkts lkts commented Mar 14, 2025

This PR adds a generic implementation of FallbackSyntheticSourceBlockLoader for all spatial fields and uses them for shape and geo_shape. Points are not included to limit the size of the change.

This PR also integrates new shape fields into the LogsDB challenge tests as a proof of concept of defining new field types outside of the main data generation code base. It required a rework of some parts of data generation and testing infra.

@lkts lkts added >enhancement auto-backport Automatically create backport pull requests when merged :StorageEngine/Mapping The storage related side of mappings v8.19.0 labels Mar 14, 2025
@lkts lkts requested review from dnhatn and martijnvg March 14, 2025 21:45
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@elasticsearchmachine
Copy link
Collaborator

Hi @lkts, I've created a changelog YAML for you.

Copy link
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Sasha 👍 - good to see geoshape being added to test data generation.

Copy link
Member

@dnhatn dnhatn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks Sasha!

@lkts lkts merged commit 033d28e into elastic:main Mar 18, 2025
17 checks passed
@lkts lkts deleted the synthetic_source_block_loader_geo2 branch March 18, 2025 15:49
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.x Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 124927

@lkts
Copy link
Contributor Author

lkts commented Mar 18, 2025

#122891 is not backported, that's why the backport fails

@lkts
Copy link
Contributor Author

lkts commented Mar 18, 2025

I am going to backport only test changes from #122891 here since it was not intended to be backported

@lkts
Copy link
Contributor Author

lkts commented Mar 18, 2025

💚 All backports created successfully

Status Branch Result
8.x

Questions ?

Please refer to the Backport tool documentation

lkts added a commit that referenced this pull request Mar 19, 2025
…124927) (#125164)

* Use FallbackSyntheticSourceBlockLoader for shape and geo_shape (#124927)

(cherry picked from commit 033d28e)

# Conflicts:
#	server/src/test/java/org/elasticsearch/index/mapper/blockloader/BooleanFieldBlockLoaderTests.java
#	server/src/test/java/org/elasticsearch/index/mapper/blockloader/DateFieldBlockLoaderTests.java
#	server/src/test/java/org/elasticsearch/index/mapper/blockloader/KeywordFieldBlockLoaderTests.java
#	test/framework/src/main/java/org/elasticsearch/index/mapper/BlockLoaderTestCase.java
#	test/framework/src/main/java/org/elasticsearch/index/mapper/NumberFieldBlockLoaderTestCase.java

* fix merge

* fix

* fix more

* fix more

* properly sync BlockLoaderTestCase

* iter

* iter

* [CI] Auto commit changes from spotless

* f

* f

---------

Co-authored-by: elasticsearchmachine <[email protected]>
omricohenn pushed a commit to omricohenn/elasticsearch that referenced this pull request Mar 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged backport pending >enhancement :StorageEngine/Mapping The storage related side of mappings Team:StorageEngine v8.19.0 v9.1.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants