Skip to content

Conversation

felixbarny
Copy link
Member

Disables the index.dimensions tsid creation optimization If dynamic templates are used to define dimensions.
There are edge cases that would lead us to include more fields into the tsid than we should (see code comments and tests).

While there may be ways we could try to only fall back in these problematic cases, it seems better to just always fall back in dynamic templates that define dimensions are involved. Otherwise, it'll be very hard to explain and debug this. For OTel metrics, we're not using dynamic templates to define dimensions, only passthrough fields.

Addresses #132566 (comment)

@felixbarny felixbarny self-assigned this Sep 22, 2025
@felixbarny felixbarny added the :StorageEngine/TSDB You know, for Metrics label Sep 22, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@elasticsearchmachine elasticsearchmachine added Team:StorageEngine v9.2.0 external-contributor Pull request authored by a developer outside the Elasticsearch team labels Sep 22, 2025
@felixbarny felixbarny merged commit 75901a1 into elastic:main Sep 23, 2025
34 checks passed
@felixbarny felixbarny deleted the index-dimensions-exclude-dynamic-templates branch September 23, 2025 11:30
phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Sep 23, 2025
BASE=e89c613dc36998037d5915f79c1cc92e9c249e76
HEAD=d2b174cfb1581cc6bf445eee1962a2a8a9918cb4
Branch=main
phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Oct 2, 2025
BASE=e89c613dc36998037d5915f79c1cc92e9c249e76
HEAD=d2b174cfb1581cc6bf445eee1962a2a8a9918cb4
Branch=main
phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Oct 7, 2025
BASE=e89c613dc36998037d5915f79c1cc92e9c249e76
HEAD=d2b174cfb1581cc6bf445eee1962a2a8a9918cb4
Branch=main
phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Oct 17, 2025
BASE=e89c613dc36998037d5915f79c1cc92e9c249e76
HEAD=d2b174cfb1581cc6bf445eee1962a2a8a9918cb4
Branch=main
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

external-contributor Pull request authored by a developer outside the Elasticsearch team >non-issue :StorageEngine/TSDB You know, for Metrics Team:StorageEngine v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants