KFLUXINFRA-2161: Control AWS IP requests using Kueue (#7773)

* KFLUXINFRA-2161: Control AWS IP requests using Kueue

For each requested platform from AWS, request an IP by specifying
the "aws-ip" resource in the pipeline's annotation using tekton-kueue
CEL expressions.

This change will affect only the development overlay.

Requires: konflux-ci/tekton-kueue#91
Assisted-By: Cursor
Signed-off-by: Gal Ben Haim <[email protected]>

* Update components/kueue/development/tekton-kueue/config.yaml

Co-authored-by: Francesco Ilario <[email protected]>

* Update components/kueue/development/tekton-kueue/config.yaml

Co-authored-by: Hugo Arès <[email protected]>

* Update components/kueue/development/tekton-kueue/config.yaml

Co-authored-by: Francesco Ilario <[email protected]>

* Use development in test-tekton-kueue-config.py

Use development overlay in test-tekton-kueue-config.py when reading the tekton-kueue image

* Fix pathtest-tekton-kueue-config.py

* Update test-tekton-kueue-config.py

Fix the expected results

---------

Signed-off-by: Gal Ben Haim <[email protected]>
Co-authored-by: Francesco Ilario <[email protected]>
Co-authored-by: Hugo Arès <[email protected]>

Author: 3 people

components/kueue/development/queue-config/cluster-queue.yaml

@@ -38,6 +38,7 @@ spec:
       - linux-amd64
       - linux-s390x
       - linux-ppc64le
+      - aws-ip
       flavors:
       - name: default-flavor
         resources:
@@ -51,6 +52,8 @@ spec:
           nominalQuota: "10"
         - name: linux-ppc64le
           nominalQuota: "10"
+        - name: aws-ip
+          nominalQuota: "250"
         # When a Workload doesn't have cpu or memory requests, if there is a limit range
         # in the namespace, Kueue will assign the requests from it to the Workload.
         # We don't care about the cpu/memory for PipelineRuns, thus setting a high value for both.

components/kueue/development/tekton-kueue/config.yaml

@@ -6,11 +6,34 @@ cel:
         has(pipelineRun.spec.params) &&
         pipelineRun.spec.params.exists(p, p.name == 'build-platforms') ?
         pipelineRun.spec.params.filter(
-          p, 
+          p,
           p.name == 'build-platforms')[0]
         .value.map(
           p,
-          annotation("kueue.konflux-ci.dev/requests-" + replace(replace(p, "/", "-"), "_", "-"), "1")
+          resource(replace(replace(p, "/", "-"), "_", "-"), 1)
+        ) : []
+
+    # Request AWS IP for AWS-based platforms
+    - |
+        has(pipelineRun.spec.params) &&
+        pipelineRun.spec.params.exists(p, p.name == 'build-platforms') ?
+        pipelineRun.spec.params.filter(
+          p,
+          p.name == 'build-platforms')[0]
+        .value.filter(
+          p,
+          !(
+            p in [
+              'linux/ppc64le',
+              'linux/s390x',
+              'linux/x86_64',
+              'local',
+              'localhost',
+            ]
+          )
+        ).map(
+          p,
+          resource('aws-ip', 1)
         ) : []
 
     # Set resource requests for multi platform pipelines which doesn't use the build-platforms parameter (old style)
@@ -24,7 +47,33 @@ cel:
       .filter(p, p.size() > 0)
       .map(
         p,
-        annotation("kueue.konflux-ci.dev/requests-" + replace(replace(p[0].value, "/", "-"), "_", "-"), "1")
+        resource(replace(replace(p[0].value, "/", "-"), "_", "-"), 1)
+      ) : []
+
+    # Request AWS IP for AWS-based platforms which doesn't use the build-platforms parameter (old style)
+    - |
+      has(pipelineRun.spec.pipelineSpec) &&
+      pipelineRun.spec.pipelineSpec.tasks.size() > 0 ?
+      pipelineRun.spec.pipelineSpec.tasks.map(
+        task,
+        has(task.params) ? task.params.filter(p, p.name == 'PLATFORM') : []
+      )
+      .filter(p, p.size() > 0)
+      .filter(
+        p,
+        !(
+          p[0].value in [
+            'linux/ppc64le',
+            'linux/s390x',
+            'linux/x86_64',
+            'local',
+            'localhost',
+          ]
+        )
+      )
+      .map(
+        p,
+        resource('aws-ip', 1)
       ) : []
 
     # Set the pipeline priority