Skip to content

[ENG-9697] index granularity#93

Merged
aaxelb merged 10 commits intoCenterForOpenScience:mainfrom
aaxelb:9697-granularity
Mar 17, 2026
Merged

[ENG-9697] index granularity#93
aaxelb merged 10 commits intoCenterForOpenScience:mainfrom
aaxelb:9697-granularity

Conversation

@aaxelb
Copy link
Copy Markdown
Collaborator

@aaxelb aaxelb commented Mar 13, 2026

  • configurable timeseries index granularity (for elastic8 and forward; elastic6 left as-is)
    • instead of arbitrary date patterns, use more constrained "timedepth", a count of the time values used in timeseries index names (e.g. 1 for yearly "YYYY", 2 for monthly "YYYY_MM", etc)
    • per-app setting: DJELME_DEFAULT_TIMEDEPTH (default 3, daily indexes)
    • per-recordtype setting:
      class MyRecord(elasticsearch_metrics.imps.elastic8.EventRecord):
          class Meta:
              timedepth = 2  # monthly indexes for this type
  • improve and tidy docs, tests, comments, annotations

@aaxelb aaxelb marked this pull request as ready for review March 13, 2026 17:21
@aaxelb aaxelb requested a review from felliott March 13, 2026 17:21
@aaxelb aaxelb force-pushed the 9697-granularity branch from 461fb60 to 20b7080 Compare March 16, 2026 14:38
Copy link
Copy Markdown
Member

@felliott felliott left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Glorious!

@aaxelb aaxelb merged commit aef1276 into CenterForOpenScience:main Mar 17, 2026
16 checks passed
@aaxelb aaxelb deleted the 9697-granularity branch March 17, 2026 13:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants