feat(backend/sdk): Add input parameterization for various k8s resources (kubeflow#11770)

* add backend support for k8s platform inputs

This change adds driver support for input parameter support for the
kubernetes platform spec. Input resolution change is extracted and made
more generic so it may be re-used when building out the container spec
for the k8s config.

Also add unit tests for constant & runtime input parameters.
TaskOutput parameter support are omitted due to a lack of appropriate
mlmd mock framework.

Signed-off-by: Humair Khan <[email protected]>

* add sdk implementation for k8s params inputs

Signed-off-by: Humair Khan <[email protected]>

* add tests for k8s input params

Signed-off-by: Humair Khan <[email protected]>

* add setup/teardown of prereqs and secret tests

and update/re-enable secret env tests

Signed-off-by: Humair Khan <[email protected]>

* have kfp sample tests use local python pkgs

Signed-off-by: Humair Khan <[email protected]>

* use a better configmap k8s name input...

Add support for multiple input types for pull secrets.
Clarify toleration docstring
Remove unnecessary resolve function

Signed-off-by: Humair Khan <[email protected]>

---------

Signed-off-by: Humair Khan <[email protected]>
(cherry picked from commit fd1b48b)

Author: HumairAK

.github/workflows/kfp-samples.yml

@@ -31,6 +31,35 @@ jobs:
       with:
         python-version: 3.9
 
+    - name: apt-get update
+      run: sudo apt-get update
+
+    - name: Install protobuf-compiler
+      run: sudo apt-get install protobuf-compiler -y
+
+    - name: Install setuptools
+      run: |
+        pip3 install setuptools
+        pip3 freeze
+
+    - name: Install Wheel
+      run: pip3 install wheel==0.42.0
+
+    - name: Install protobuf
+      run: pip3 install protobuf==4.25.3
+
+    - name: Generate API proto files
+      working-directory: ./api
+      run: make python
+
+    - name: Install kfp-pipeline-spec from source
+      run: |
+        python3 -m pip install api/v2alpha1/python
+
+    - name: Generate, Build, and Install Kubernetes API proto files & packages
+      working-directory: ./kubernetes_platform
+      run: make python && pip install python/dist/*.whl
+
     - name: Create KFP cluster
       uses: ./.github/actions/kfp-cluster
       with:
@@ -65,4 +94,3 @@ jobs:
       with:
         name: kfp-samples-tests-artifacts-k8s-${{ matrix.k8s_version }}
         path: /tmp/tmp*/*
-