Pipeline Helm Charts #3237

kunal-511 · 2025-09-08T17:52:26Z

Pull Request Template for Kubeflow Manifests

✏️ Summary of Changes

Add kubeflow-pipeline Helm Charts

📦 Dependencies

List any dependencies or related PRs (e.g., "Depends on #123").

🐛 Related Issues

Link any issues that are resolved or affected by this PR.

✅ Contributor Checklist

I have tested these changes with kustomize. See Installation Prerequisites.
All commits are signed-off to satisfy the DCO check.
I have considered adding my company to the adopters page to support Kubeflow and help the community, since I expect help from the community for my issue (see 1. and 2.).

You can join the CNCF Slack and access our meetings at the Kubeflow Community website. Our channel on the CNCF Slack is here #kubeflow-platform.

google-oss-prow · 2025-09-08T17:52:32Z

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign kimwnasptd for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

juliusvonkohout · 2025-09-26T13:07:10Z

Please rebase to master

kunal-511 · 2025-10-12T07:32:33Z

@juliusvonkohout It is now ready for review

juliusvonkohout · 2025-10-19T12:10:40Z

@kunal-511 i think you have to remove the AWS and GCP specific stuff, because it it more than basic integration and could violate the charter. It is also mostly remove in upstream KFP now.

kunal-511 · 2025-10-22T06:57:40Z

/retest

juliusvonkohout · 2025-10-23T08:50:13Z

The kfp 2.15 release with fundamental changes is supposed to be close in the next week and manged by @HumairAK @droctothorpe and other maintainers. @kunal-511 do you want to wait for it before we merge ?

kunal-511 · 2025-10-23T09:15:56Z

Yes we can wait for that

kromanow94 · 2025-11-11T14:17:55Z

Hey, I have some experience with Helm Charts and Kubeflow. I created one Kubeflow Helm Chart some time ago as a PoC to show at least one possible approach for this initiative. My approach was to have One Big Helm Chart with a series of parameterizations. I see the approach here is to have separate Helm Charts which also makes sense. Just FYI, my work is available here:

https://github.com/kromanow94/kubeflow-manifests/releases/tag/kubeflow-0.5.0

I want to let you know that I have some time to get back to the idea of Kubeflow Helm Chart and I'm willing to help with this initiative.

In the next few days I'm planning to have a closer look at this PR and try to find some place where I could help. Let me know if there is something on your mind that I could do.

Best,
Roman

juliusvonkohout · 2025-11-21T17:42:59Z

@kromanow94

# Multi tenant platform installation:
helm install ./charts/kubeflow-namespaces (kubeflow-namespaces/base)
helm install ./charts/kubeflow-platform (common/{kubeflow-roles, networkpolicies, security})
helm install ./charts/cert-manager # wrapper for https://github.com/kromanow94/kubeflow-manifests/blob/e04359ab1d4603faffbdd02df78ebf8df88fae2b/example/helm/quickstart.helm.local.sh#L71
helm install ./charts/istio --values=myvaluefile # wrapper helm chart for https://github.com/kromanow94/kubeflow-manifests/blob/e04359ab1d4603faffbdd02df78ebf8df88fae2b/example/helm/quickstart.helm.local.sh#L89
helm install ./charts/oauth2-proxy # wrapper for https://github.com/kromanow94/kubeflow-manifests/blob/e04359ab1d4603faffbdd02df78ebf8df88fae2b/example/helm/quickstart.helm.local.sh#L139
# Copy most items from here https://github.com/kromanow94/kubeflow-manifests/blob/helmcharts/example/helm/quickstart.helm.local.sh#L81
helm upgrade ./charts/dex # wrapper for https://github.com/kromanow94/kubeflow-manifests/blob/e04359ab1d4603faffbdd02df78ebf8df88fae2b/example/helm/quickstart.helm.local.sh#L80

Above is what you can work on first.
helm install ./charts/kubeflow-dashboard --set installation_mode=platform
helm install ./charts/kubeflow-pipelines (contains argo, ...) --set installation_mode=platform
helm install ./charts/kubeflow-notebooks --set installation_mode=platform
helm install ./charts/knative-serving (needed for kserve) --set installation_mode=platform
helm install ./charts/kserve (should we have knative-serving as dependency here) --set installation_mode=platform
helm install ./charts/kubeflow-trainer --set installation_mode=platform
...

# Standalone installation of individual components:
helm install kubeflow-trainer --set installation_mode=standalone
helm install kubeflow-katib --set installation_mode=standalone
...

juliusvonkohout · 2025-11-25T14:47:56Z

kunal-511 · 2025-11-26T11:21:11Z

rebase this due to #3283

juliusvonkohout · 2025-11-26T19:58:56Z

rebase this due to #3283

Thank you.

First you can remove a lot of stuff. We deleted some environments and files such as sync.py changed completely which is not reflected here. I think many files are outdated now also with old image tags imageTag: "2.14.3".

Also we need to find a way to cut the lines in this PR by roughly 75 %. For example most security contexts are already PSS restricted, so the should not be configurable. That already saves a few hundred lines. Also minio is gone entirely and we should only support seaweedfs. Also postgresql is not needed right now i would say. So most of the value files in the ci folder can also go. In the end we only need to support 2 flavors:

manifests/example/kustomization.yaml

Lines 70 to 72 in 9e1d4d2

    
           # Kubeflow Pipelines (SeaweedFS as default S3 storage) 
        
           - ../applications/pipeline/upstream/env/cert-manager/platform-agnostic-multi-user  # Pipeline definitions stored in the database 
        
           # - ../applications/pipeline/upstream/env/cert-manager/platform-agnostic-multi-user-k8s-native # Pipeline Definitions Stored as Kubernetes Resources

and then we should expose the basic configurationmaps, usernames and passwords for seaweedfs / databases. We can step by step expose more if needed by customers, but lets start with a minimal setup that is easy to maintain and good enough for 80 % of users with 20% effort.

Signed-off-by: kunal-511 <[email protected]>

kunal-511 · 2025-12-01T17:54:53Z

@juliusvonkohout I have updated the pipelines helm charts to support only 2 flavors and according to the new version

Signed-off-by: kunal-511 <[email protected]>

juliusvonkohout · 2025-12-02T16:15:58Z

experimental/helm/charts/pipelines/Chart.yaml

+
+description: A Helm chart for Kubeflow Pipelines - ML Workflows on Kubernetes
+
+version: 2.14.3


We are at 2.15.0 please make sure to update all files. You really need to check each file in this PR.

juliusvonkohout · 2025-12-02T16:18:01Z

experimental/helm/charts/pipelines/ci/values-platform-agnostic-multi-user-k8s-native.yaml

+scheduledWorkflow:
+  additionalEnv:
+  - name: NAMESPACE
+    value: ""


For what do we need this empty value ?

juliusvonkohout · 2025-12-02T16:18:10Z

experimental/helm/charts/pipelines/ci/values-platform-agnostic-multi-user-k8s-native.yaml

+persistenceAgent:
+  additionalEnv:
+  - name: NAMESPACE
+    value: ""


For what do we need this empty value ?

This is directly picked from env where it is mentioned:- Empty namespace let viewer controller watch all namespaces

juliusvonkohout · 2025-12-02T16:18:56Z

experimental/helm/charts/pipelines/ci/values-platform-agnostic-multi-user.yaml

+crds:
+  install: true
+  application: false
+  webhook: false


Should this not depend on pipelineDefinition:
storage: database ?

I will add a comments in both values files that crds.webhook should match pipelineDefinition.storage for consistency, even though templates check pipelineDefinition.storage directly

juliusvonkohout · 2025-12-02T16:24:18Z

experimental/helm/charts/pipelines/templates/cache/rolebinding.yaml

+subjects:
+- kind: ServiceAccount
+  name: {{ include "kubeflow-pipelines.cache.serviceAccountName" . }}
+  namespace: {{ include "kubeflow-pipelines.namespace" . }}


It must anyway the same namespace. All KFP components must be in the same namespace so you can use a shared variable across all resources.

juliusvonkohout · 2025-12-02T16:25:29Z

experimental/helm/charts/pipelines/templates/cache/rolebinding.yaml

+  name: kubeflow-pipelines-cache-role
+subjects:
+- kind: ServiceAccount
+  name: {{ include "kubeflow-pipelines.cache.serviceAccountName" . }}


Are you sure that KFP does not break if we change that? Please only make things configurable that are actually configurable.

Signed-off-by: kunal-511 <[email protected]>

google-oss-prow bot requested review from juliusvonkohout and kimwnasptd September 8, 2025 17:52

kunal-511 marked this pull request as draft September 8, 2025 17:52

google-oss-prow bot added size/XXL do-not-merge/work-in-progress labels Sep 8, 2025

kunal-511 force-pushed the pipeline-helm-charts branch from 7c85ed8 to d75fc35 Compare September 28, 2025 09:31

kunal-511 marked this pull request as ready for review October 12, 2025 07:32

google-oss-prow bot removed the do-not-merge/work-in-progress label Oct 12, 2025

kunal-511 force-pushed the pipeline-helm-charts branch from 2b438e5 to 1345f9e Compare November 26, 2025 11:20

kunal-511 added 9 commits December 1, 2025 23:23

Pipline Helm Charts

ab6fe9d

Signed-off-by: kunal-511 <[email protected]>

Update helm charts

c0b1ad0

Signed-off-by: kunal-511 <[email protected]>

Update helm charts to reduce differences

a2299ea

Signed-off-by: kunal-511 <[email protected]>

modified labels and env

3c003e3

Signed-off-by: kunal-511 <[email protected]>

update labels and env

392fa8d

Signed-off-by: kunal-511 <[email protected]>

Update values

f61404a

Signed-off-by: kunal-511 <[email protected]>

Fix syntax

de24196

Signed-off-by: kunal-511 <[email protected]>

fix syntax and naming

29ef1d2

Signed-off-by: kunal-511 <[email protected]>

naming change

0013b5e

Signed-off-by: kunal-511 <[email protected]>

kunal-511 added 10 commits December 1, 2025 23:23

Update image tag and add addition env

9a1a9e6

Signed-off-by: kunal-511 <[email protected]>

Add missing resources

c850fee

Signed-off-by: kunal-511 <[email protected]>

remove extra resources

6567202

Signed-off-by: kunal-511 <[email protected]>

update labels and comparision script

2d6ed41

Signed-off-by: kunal-511 <[email protected]>

update kserve configmap helm charts

4d25bcb

Signed-off-by: kunal-511 <[email protected]>

remove charts dependencies

37c79be

Signed-off-by: kunal-511 <[email protected]>

step to build dependency for pipelines

5544d2d

Signed-off-by: kunal-511 <[email protected]>

Remove cloud specific templates

566729b

Signed-off-by: kunal-511 <[email protected]>

remove cloud speific templates from comparision

7d54114

Signed-off-by: kunal-511 <[email protected]>

Update helm charts according to v2.15.0 and support only 2 flavors

0b0082d

Signed-off-by: kunal-511 <[email protected]>

kunal-511 force-pushed the pipeline-helm-charts branch from 333302c to 0b0082d Compare December 1, 2025 17:54

update pod security

2a4ba75

Signed-off-by: kunal-511 <[email protected]>

juliusvonkohout reviewed Dec 2, 2025

View reviewed changes

kunal-511 added 2 commits December 6, 2025 00:49

Update katib helm charts with v0.19.0

20c0a62

Signed-off-by: kunal-511 <[email protected]>

Update model registry helm charts for v0.3.3

893d4b1

Signed-off-by: kunal-511 <[email protected]>


		description: A Helm chart for Kubeflow Pipelines - ML Workflows on Kubernetes

		version: 2.14.3

Pipeline Helm Charts #3237

Are you sure you want to change the base?

Pipeline Helm Charts #3237

Uh oh!

Conversation

kunal-511 commented Sep 8, 2025

Pull Request Template for Kubeflow Manifests

✏️ Summary of Changes

📦 Dependencies

🐛 Related Issues

✅ Contributor Checklist

Uh oh!

google-oss-prow bot commented Sep 8, 2025

Uh oh!

juliusvonkohout commented Sep 26, 2025

Uh oh!

kunal-511 commented Oct 12, 2025

Uh oh!

juliusvonkohout commented Oct 19, 2025

Uh oh!

kunal-511 commented Oct 22, 2025

Uh oh!

juliusvonkohout commented Oct 23, 2025

Uh oh!

kunal-511 commented Oct 23, 2025

Uh oh!

kromanow94 commented Nov 11, 2025

Uh oh!

juliusvonkohout commented Nov 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

juliusvonkohout commented Nov 25, 2025

Uh oh!

kunal-511 commented Nov 26, 2025

Uh oh!

juliusvonkohout commented Nov 26, 2025

Uh oh!

kunal-511 commented Dec 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

juliusvonkohout commented Nov 21, 2025 •

edited

Loading

kunal-511 commented Dec 1, 2025 •

edited

Loading