Skip to content

Add Auto-configure curator retention rule for indexPerNamespace #2887

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
chi-quita-a merged 1 commit into from
Dec 11, 2025
Merged

Add Auto-configure curator retention rule for indexPerNamespace #2887

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions config/sc-config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1009,6 +1009,11 @@ opensearch:
# Config for https://www.elastic.co/guide/en/elasticsearch/client/curator/5.8/about.html
curator:
enabled: true
# Defaults used for automatic index-per-namespace patterns in the curator values:
# - "^[^.].*" (non-system indices)
# - ".orphaned*" (orphaned indices from removed namespaces)
indexPerNamespaceDefaultSizeGB: 5000
indexPerNamespaceDefaultAgeDays: 30
retention:
- pattern: other-*
sizeGB: 5000
Expand Down
10 changes: 10 additions & 0 deletions config/schemas/config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6485,6 +6485,16 @@ properties:
title: OpenSearch Curator Enabled
type: boolean
default: true
indexPerNamespaceDefaultSizeGB:
title: OpenSearch Curator Index-Per-Namespace Default Size GB
description: Default size threshold in GB for automatically generated index-per-namespace patterns.
type: number
default: 5000
indexPerNamespaceDefaultAgeDays:
title: OpenSearch Curator Index-Per-Namespace Default Age Days
description: Default age threshold in days for automatically generated index-per-namespace patterns.
type: number
default: 30
retention:
title: OpenSearch Curator Retention
description: Configures the retention of indices in OpenSearch.
Expand Down
1 change: 0 additions & 1 deletion helmfile.d/charts/opensearch/curator/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,6 @@ opensearch:

startingDeadlineSeconds: 300
activeDeadlineSeconds: 1800

failedJobsHistoryLimit: 3
successfulJobsHistoryLimit: 1

Expand Down
15 changes: 14 additions & 1 deletion helmfile.d/values/opensearch/curator.yaml.gotmpl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,20 @@ tolerations: {{- toYaml .Values.opensearch.curator.tolerations | nindent 2 }}
nodeSelector: {{- toYaml .Values.opensearch.curator.nodeSelector | nindent 2 }}
resources: {{- toYaml .Values.opensearch.curator.resources | nindent 2 }}

retention: {{ toYaml .Values.opensearch.curator.retention | nindent 2 }}
retention:
{{- if .Values.opensearch.indexPerNamespace }}
- pattern: "^[^.].*"
sizeGB: {{ .Values.opensearch.curator.indexPerNamespaceDefaultSizeGB }}
ageDays: {{ .Values.opensearch.curator.indexPerNamespaceDefaultAgeDays }}
- pattern: ".orphaned*"
sizeGB: {{ .Values.opensearch.curator.indexPerNamespaceDefaultSizeGB }}
ageDays: {{ .Values.opensearch.curator.indexPerNamespaceDefaultAgeDays }}
{{- end }}
{{- range .Values.opensearch.curator.retention }}
- pattern: {{ .pattern | quote }}
sizeGB: {{ .sizeGB }}
ageDays: {{ .ageDays }}
{{- end }}

{{- $global := dict
"registry" (ternary (dig "uri" "" .Values.images.global.registry) "" .Values.images.global.registry.enabled)
Expand Down
Loading