Skip to content

Pipeline Helm Charts #3237

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kunal-511 wants to merge 22 commits into
base: master
Choose a base branch
from
+7,823 −122
Open

Pipeline Helm Charts #3237

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
ab6fe9d
Pipline Helm Charts
kunal-511 Sep 8, 2025
c0b1ad0
Update helm charts
kunal-511 Sep 22, 2025
a2299ea
Update helm charts to reduce differences
kunal-511 Sep 24, 2025
3c003e3
modified labels and env
kunal-511 Sep 25, 2025
392fa8d
update labels and env
kunal-511 Sep 25, 2025
f61404a
Update values
kunal-511 Sep 26, 2025
de24196
Fix syntax
kunal-511 Sep 28, 2025
29ef1d2
fix syntax and naming
kunal-511 Sep 28, 2025
0013b5e
naming change
kunal-511 Sep 28, 2025
9a1a9e6
Update image tag and add addition env
kunal-511 Sep 29, 2025
c850fee
Add missing resources
kunal-511 Oct 1, 2025
6567202
remove extra resources
kunal-511 Oct 3, 2025
2d6ed41
update labels and comparision script
kunal-511 Oct 9, 2025
4d25bcb
update kserve configmap helm charts
kunal-511 Oct 12, 2025
37c79be
remove charts dependencies
kunal-511 Oct 12, 2025
5544d2d
step to build dependency for pipelines
kunal-511 Oct 12, 2025
566729b
Remove cloud specific templates
kunal-511 Oct 19, 2025
7d54114
remove cloud speific templates from comparision
kunal-511 Oct 19, 2025
0b0082d
Update helm charts according to v2.15.0 and support only 2 flavors
kunal-511 Dec 1, 2025
2a4ba75
update pod security
kunal-511 Dec 1, 2025
20c0a62
Update katib helm charts with v0.19.0
kunal-511 Dec 5, 2025
893d4b1
Update model registry helm charts for v0.3.3
kunal-511 Dec 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .github/workflows/helm-kustomize-comparison.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,10 @@ jobs:
rm get_helm.sh
- name: Install Kustomize
run: ./tests/kustomize_install.sh
- name: Build Helm dependencies for pipelines
run: |
cd experimental/helm/charts/pipelines
helm dependency build
- name: Run all scenarios comparison
env:
VERBOSE: "true"
Expand Down
4 changes: 2 additions & 2 deletions experimental/helm/charts/katib/Chart.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,9 @@ name: katib

description: A Helm chart for Katib - AutoML on Kubernetes

version: 0.16.0
version: 0.19.0

appVersion: 0.16.0
appVersion: 0.19.0

keywords:
- automl
Expand Down
33 changes: 17 additions & 16 deletions experimental/helm/charts/katib/ci/values-cert-manager.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

global:
namespace: kubeflow
imageTag: v0.18.0
imageTag: v0.19.0

# Enable kustomize compatibility mode
kustomizeMode:
Expand Down Expand Up @@ -77,6 +77,7 @@ config:
controller:
webhookPort: 8443
trialResources:
- TrainJob.v1alpha1.trainer.kubeflow.org
- Job.v1.batch
- TFJob.v1.kubeflow.org
- PyTorchJob.v1.kubeflow.org
Expand All @@ -85,40 +86,40 @@ config:
runtime:
metricsCollectors:
- kind: StdOut
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: File
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: TensorFlowEvent
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.19.0
resources:
limits:
memory: 1Gi
suggestions:
- algorithmName: random
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: tpe
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: grid
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: hyperband
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.19.0
- algorithmName: bayesianoptimization
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.19.0
- algorithmName: cmaes
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: sobol
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: multivariate-tpe
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: enas
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.19.0
resources:
limits:
memory: 400Mi
- algorithmName: darts
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.19.0
- algorithmName: pbt
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.19.0
persistentVolumeClaimSpec:
accessModes:
- ReadWriteMany
Expand All @@ -127,7 +128,7 @@ config:
storage: 5Gi
earlyStoppings:
- algorithmName: medianstop
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.18.0
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.19.0

# RBAC
rbac:
Expand Down
67 changes: 65 additions & 2 deletions experimental/helm/charts/katib/ci/values-external-db.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

global:
namespace: kubeflow
imageTag: v0.18.0
imageTag: v0.19.0

# Enable kustomize compatibility mode
kustomizeMode:
Expand Down Expand Up @@ -57,4 +57,67 @@ namespaceCreate:
rbac:
create: true
kubeflow:
enabled: false
enabled: false

# Katib configuration
config:
katibConfig: |
apiVersion: config.kubeflow.org/v1beta1
kind: KatibConfig
init:
certGenerator:
enable: true
controller:
webhookPort: 8443
trialResources:
- Job.v1.batch
- TFJob.v1.kubeflow.org
- PyTorchJob.v1.kubeflow.org
- MPIJob.v1.kubeflow.org
- XGBoostJob.v1.kubeflow.org
runtime:
metricsCollectors:
- kind: StdOut
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: File
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: TensorFlowEvent
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.19.0
resources:
limits:
memory: 1Gi
suggestions:
- algorithmName: random
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: tpe
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: grid
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: hyperband
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.19.0
- algorithmName: bayesianoptimization
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.19.0
- algorithmName: cmaes
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: sobol
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: multivariate-tpe
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: enas
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.19.0
resources:
limits:
memory: 400Mi
- algorithmName: darts
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.19.0
- algorithmName: pbt
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.19.0
persistentVolumeClaimSpec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 5Gi
earlyStoppings:
- algorithmName: medianstop
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.19.0
35 changes: 18 additions & 17 deletions experimental/helm/charts/katib/ci/values-kubeflow.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

global:
namespace: kubeflow
imageTag: v0.18.0
imageTag: v0.19.0

# Enable kustomize compatibility mode
kustomizeMode:
Expand Down Expand Up @@ -111,6 +111,7 @@ config:
controller:
webhookPort: 8443
trialResources:
- TrainJob.v1alpha1.trainer.kubeflow.org
- Job.v1.batch
- TFJob.v1.kubeflow.org
- PyTorchJob.v1.kubeflow.org
Expand All @@ -119,40 +120,40 @@ config:
runtime:
metricsCollectors:
- kind: StdOut
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: File
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: TensorFlowEvent
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.18.0
resources:
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.19.0
resources:
limits:
memory: 1Gi
suggestions:
- algorithmName: random
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: tpe
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: grid
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: hyperband
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.19.0
- algorithmName: bayesianoptimization
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.19.0
- algorithmName: cmaes
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: sobol
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: multivariate-tpe
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: enas
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.19.0
resources:
limits:
memory: 400Mi
- algorithmName: darts
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.19.0
- algorithmName: pbt
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.19.0
persistentVolumeClaimSpec:
accessModes:
- ReadWriteMany
Expand All @@ -161,7 +162,7 @@ config:
storage: 5Gi
earlyStoppings:
- algorithmName: medianstop
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.18.0
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.19.0

# Security features - disabled for CI simplicity
networkPolicy:
Expand Down
32 changes: 16 additions & 16 deletions experimental/helm/charts/katib/ci/values-leader-election.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

global:
namespace: kubeflow
imageTag: v0.18.0
imageTag: v0.19.0

# Enable kustomize compatibility mode
kustomizeMode:
Expand Down Expand Up @@ -110,40 +110,40 @@ config:
runtime:
metricsCollectors:
- kind: StdOut
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: File
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: TensorFlowEvent
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.19.0
resources:
limits:
memory: 1Gi
suggestions:
- algorithmName: random
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: tpe
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: grid
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: hyperband
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.19.0
- algorithmName: bayesianoptimization
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.19.0
- algorithmName: cmaes
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: sobol
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: multivariate-tpe
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: enas
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.19.0
resources:
limits:
memory: 400Mi
- algorithmName: darts
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.19.0
- algorithmName: pbt
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.19.0
persistentVolumeClaimSpec:
accessModes:
- ReadWriteMany
Expand All @@ -152,4 +152,4 @@ config:
storage: 5Gi
earlyStoppings:
- algorithmName: medianstop
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.18.0
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.19.0
Loading
Loading