Skip to content

Conversation

@gmarouli
Copy link
Contributor

@gmarouli gmarouli commented May 8, 2025

Backport of #127752.

When downsampling an index that has a mapping with passthrough dimensions the downsampling process identifies the wrapper object as a dimension and it fails when it tried to retrieve the type.

We did some prework to establish a shared framework in the internalClusterTest. For now it only includes setting up time series data stream helpers and a limited assertion helper for dimensions and metrics. This allows us to setup an internalClusterTest that captures this issue during downsampling in #125156.

To fix this we refine the check that determines if a field is dimension, to skip wrapper field.

Fixes #125156.

  • Have you signed the contributor license agreement?
  • Have you followed the contributor guidelines?
  • If submitting code, have you built your formula locally prior to submission with gradle check?
  • If submitting code, is your pull request against main? Unless there is a good reason otherwise, we prefer pull requests against main and will backport as needed.
  • If submitting code, have you checked that your submission is for an OS and architecture that we support?
  • If you are submitting this code for a class then read our policy for that.

When downsampling an index that has a mapping with passthrough dimensions the downsampling process identifies the wrapper object as a dimension and it fails when it tried to retrieve the type.

We did some prework to establish a shared framework in the internalClusterTest. For now it only includes setting up time series data stream helpers and a limited assertion helper for dimensions and metrics. This allows us to setup an internalClusterTest that captures this issue during downsampling in elastic#125156.

To fix this we refine the check that determines if a field is dimension, to skip wrapper field.

Fixes elastic#125156.
@gmarouli gmarouli added backport :StorageEngine/TSDB You know, for Metrics labels May 8, 2025
@gmarouli gmarouli added auto-backport Automatically create backport pull requests when merged v8.17.7 auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) labels May 8, 2025
@elasticsearchmachine elasticsearchmachine merged commit b3b2d12 into elastic:8.18 May 8, 2025
15 checks passed
@gmarouli gmarouli deleted the backport/8.18/pr-127752 branch May 8, 2025 08:32
gmarouli added a commit to gmarouli/elasticsearch that referenced this pull request May 8, 2025
…stic#127890)

When downsampling an index that has a mapping with passthrough dimensions the downsampling process identifies the wrapper object as a dimension and it fails when it tried to retrieve the type.

We did some prework to establish a shared framework in the internalClusterTest. For now it only includes setting up time series data stream helpers and a limited assertion helper for dimensions and metrics. This allows us to setup an internalClusterTest that captures this issue during downsampling in elastic#125156.

To fix this we refine the check that determines if a field is dimension, to skip wrapper field.

Fixes elastic#125156.
@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
8.17

elasticsearchmachine pushed a commit that referenced this pull request May 8, 2025
…7890) (#127905)

* Change the handling of passthrough dimenensions (#127752) (#127890)

When downsampling an index that has a mapping with passthrough dimensions the downsampling process identifies the wrapper object as a dimension and it fails when it tried to retrieve the type.

We did some prework to establish a shared framework in the internalClusterTest. For now it only includes setting up time series data stream helpers and a limited assertion helper for dimensions and metrics. This allows us to setup an internalClusterTest that captures this issue during downsampling in #125156.

To fix this we refine the check that determines if a field is dimension, to skip wrapper field.

Fixes #125156.

* Adjust the test to match this version of the code
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport :StorageEngine/TSDB You know, for Metrics v8.17.7 v8.18.2

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants