Skip to content

Move from Make to Task #238

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
gene-redpanda wants to merge 9 commits into
base: main
Choose a base branch
from
Open

Move from Make to Task #238

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
0ec4e33
chore: bump client dockerfile versions
gene-redpanda Oct 8, 2025
5f68882
feat: move to task from make
gene-redpanda Oct 8, 2025
bb57f91
ci: pipeline to use taskfile
gene-redpanda Oct 8, 2025
2d93d19
ci: yamllint config
gene-redpanda Oct 8, 2025
7a1dce7
chore: update grafana role
gene-redpanda Oct 8, 2025
0c42971
chore: delete makefile
gene-redpanda Oct 8, 2025
882a1f6
test
gene-redpanda Oct 9, 2025
29e9743
fix: ensures no ssh regen
gene-redpanda Oct 9, 2025
7d3f336
ci: move citsubus to new concurrency group to reduce test time
gene-redpanda Oct 9, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
72 changes: 38 additions & 34 deletions .buildkite/pipeline.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ steps:
key: aws-up-ubuntu
concurrency_group: aws-ub
concurrency: 1
command: make ci-aws-rp -e DEPLOYMENT_ID=ci-bs-ub-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=ubuntu-focal --keep-going
command: DEPLOYMENT_ID=ci-bs-ub-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=ubuntu-focal task ci:aws:basic
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand All @@ -22,14 +22,14 @@ steps:
key: aws-up-ubuntu-tiered
concurrency_group: aws-ub
concurrency: 1
command: make ci-aws-rp-tiered -e DEPLOYMENT_ID=ci-ts-ub-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=ubuntu-focal --keep-going
command: DEPLOYMENT_ID=ci-ts-ub-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=ubuntu-focal task ci:aws:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand All @@ -39,14 +39,14 @@ steps:
key: aws-up-ubuntu-ts-large
concurrency_group: aws-ub
concurrency: 1
command: make ci-aws-rp-tiered -e DEPLOYMENT_ID=ci-ts-ub-lg-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=ubuntu-focal -e INSTANCE_TYPE_AWS=is4gen.4xlarge -e MACHINE_ARCH=arm64 --keep-going
command: DEPLOYMENT_ID=ci-ts-ub-lg-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=ubuntu-focal INSTANCE_TYPE_AWS=is4gen.4xlarge MACHINE_ARCH=arm64 task ci:aws:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand All @@ -56,30 +56,31 @@ steps:
key: aws-up-fedora
concurrency_group: aws-fd
concurrency: 1
command: make ci-aws-rp -e DEPLOYMENT_ID=ci-bs-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=Fedora-Cloud-Base-39 --keep-going
command: DEPLOYMENT_ID=ci-bs-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=Fedora-Cloud-Base-39 DISABLE_GRAFANA_GPG_CHECK=true task ci:aws:basic
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
- AWS_DEFAULT_REGION
- DISABLE_GRAFANA_GPG_CHECK
- label: aws fedora connect
key: aws-up-fed-con
concurrency_group: aws-fd-cn
concurrency: 1
command: make ci-aws-rp-connect -e DEPLOYMENT_ID=ci-cn-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=Fedora-Cloud-Base-39 --keep-going
command: DEPLOYMENT_ID=ci-cn-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=Fedora-Cloud-Base-39 task ci:aws:connect
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand All @@ -89,31 +90,32 @@ steps:
key: aws-up-fedora-tiered
concurrency_group: aws-fd
concurrency: 1
command: make ci-aws-rp-tiered -e DEPLOYMENT_ID=ci-ts-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=Fedora-Cloud-Base-39 --keep-going
command: DEPLOYMENT_ID=ci-ts-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=Fedora-Cloud-Base-39 DISABLE_GRAFANA_GPG_CHECK=true task ci:aws:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
- REDPANDA_LICENSE
- AWS_DEFAULT_REGION
- DISABLE_GRAFANA_GPG_CHECK
- label: aws fedora tiered connect
key: aws-up-fed-cts
concurrency_group: aws-fd-cn
concurrency: 1
command: make ci-aws-rp-ts-connect -e DEPLOYMENT_ID=ci-ct-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=Fedora-Cloud-Base-39 --keep-going
command: DEPLOYMENT_ID=ci-ct-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=Fedora-Cloud-Base-39 task ci:aws:mirror
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand All @@ -124,14 +126,14 @@ steps:
key: aws-up-fedora-ts-large
concurrency_group: aws-fd
concurrency: 1
command: make ci-aws-rp-tiered -e DEPLOYMENT_ID=ci-ts-fd-lg-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=Fedora-Cloud-Base-39 -e INSTANCE_TYPE_AWS=is4gen.4xlarge -e MACHINE_ARCH=arm64 --keep-going
command: DEPLOYMENT_ID=ci-ts-fd-lg-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=Fedora-Cloud-Base-39 INSTANCE_TYPE_AWS=is4gen.4xlarge MACHINE_ARCH=arm64 task ci:aws:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand All @@ -141,73 +143,75 @@ steps:
key: gcp-up-ubuntu
concurrency_group: gcp-ub
concurrency: 1
command: make ci-gcp-rp -e GCP_IMAGE="ubuntu-os-cloud/ubuntu-2204-lts" -e DEPLOYMENT_ID="ci-bs-ub-`tr -dc a-z0-9 </dev/urandom | head -c 4`" --keep-going
command: GCP_IMAGE="ubuntu-os-cloud/ubuntu-2204-lts" DEPLOYMENT_ID="ci-bs-ub-`tr -dc a-z0-9 </dev/urandom | head -c 4`" task ci:gcp:basic
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- GCP_CREDS
- label: gcp ubuntu tiered
key: gcp-up-ubuntu-tiered
concurrency_group: gcp-ub
concurrency: 1
command: make ci-gcp-rp-tiered -e GCP_IMAGE="ubuntu-os-cloud/ubuntu-2204-lts" -e DEPLOYMENT_ID="ci-ts-ub-`tr -dc a-z0-9 </dev/urandom | head -c 4`" --keep-going
command: GCP_IMAGE="ubuntu-os-cloud/ubuntu-2204-lts" DEPLOYMENT_ID="ci-ts-ub-`tr -dc a-z0-9 </dev/urandom | head -c 4`" task ci:gcp:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
pre-exit: make destroy-gcp
image: glrp/atgt:v1.0.8
pre-exit: task cloud:gcp-down
environment:
- GCP_CREDS
- REDPANDA_LICENSE
- label: gcp fedora basic
key: gcp-up-fedora
concurrency_group: gcp-fd
concurrency: 1
command: make ci-gcp-rp -e GCP_IMAGE="fedora-cloud/fedora-cloud-39" -e DEPLOYMENT_ID="ci-bs-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4`" --keep-going
command: GCP_IMAGE="fedora-cloud/fedora-cloud-39" DEPLOYMENT_ID="ci-bs-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4`" DISABLE_GRAFANA_GPG_CHECK=true task ci:gcp:basic
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- GCP_CREDS
- DISABLE_GRAFANA_GPG_CHECK
- label: gcp fedora tiered
key: gcp-up-fedora-tiered
concurrency_group: gcp-fd
concurrency: 1
command: make ci-gcp-rp-tiered -e GCP_IMAGE="fedora-cloud/fedora-cloud-39" -e DEPLOYMENT_ID="ci-ud-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4`" --keep-going
command: GCP_IMAGE="fedora-cloud/fedora-cloud-39" DEPLOYMENT_ID="ci-ud-fd-`tr -dc a-z0-9 </dev/urandom | head -c 4`" DISABLE_GRAFANA_GPG_CHECK=true task ci:gcp:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- GCP_CREDS
- REDPANDA_LICENSE
- DISABLE_GRAFANA_GPG_CHECK
- label: unstable aws fedora tiered
key: aws-us-fedora-tiered
concurrency_group: unstable
concurrency: 1
command: make ci-aws-rp-tiered -e DEPLOYMENT_ID=ci-ts-fd-us-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=Fedora-Cloud-Base-39 -e IS_USING_UNSTABLE=true --keep-going
command: DEPLOYMENT_ID=ci-ts-fd-us-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=Fedora-Cloud-Base-39 IS_USING_UNSTABLE=true task ci:aws:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand All @@ -217,14 +221,14 @@ steps:
key: aws-us-fedora-ts-large
concurrency_group: unstable
concurrency: 1
command: make ci-aws-rp-tiered -e DEPLOYMENT_ID=ci-ts-fd-us-lg-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=Fedora-Cloud-Base-39 -e IS_USING_UNSTABLE=true -e INSTANCE_TYPE_AWS=is4gen.4xlarge -e MACHINE_ARCH=arm64 --keep-going
command: DEPLOYMENT_ID=ci-ts-fd-us-lg-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=Fedora-Cloud-Base-39 IS_USING_UNSTABLE=true INSTANCE_TYPE_AWS=is4gen.4xlarge MACHINE_ARCH=arm64 task ci:aws:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand All @@ -234,31 +238,31 @@ steps:
key: aws-us-ubuntu-tiered
concurrency_group: unstable
concurrency: 1
command: make ci-aws-rp-tiered -e DEPLOYMENT_ID=ci-ts-ub-us-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=ubuntu-focal -e IS_USING_UNSTABLE=true --keep-going
command: DEPLOYMENT_ID=ci-ts-ub-us-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=ubuntu-focal IS_USING_UNSTABLE=true task ci:aws:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
- REDPANDA_LICENSE
- AWS_DEFAULT_REGION
- label: unstable aws ubuntu tiered large
key: aws-us-ubuntu-ts-large
concurrency_group: unstable
concurrency_group: aws-ub
concurrency: 1
command: make ci-aws-rp-tiered -e DEPLOYMENT_ID=ci-ts-ub-us-lg-`tr -dc a-z0-9 </dev/urandom | head -c 4` -e DISTRO=ubuntu-focal -e IS_USING_UNSTABLE=true -e INSTANCE_TYPE_AWS=is4gen.4xlarge -e MACHINE_ARCH=arm64 --keep-going
command: DEPLOYMENT_ID=ci-ts-ub-us-lg-`tr -dc a-z0-9 </dev/urandom | head -c 4` DISTRO=ubuntu-focal IS_USING_UNSTABLE=true INSTANCE_TYPE_AWS=is4gen.4xlarge MACHINE_ARCH=arm64 task ci:aws:tiered
plugins:
- seek-oss/aws-sm#v2.3.2:
json-to-env:
- json-key: .
secret-id: sdlc/prod/buildkite/deployment_automation
- docker#v5.8.0:
image: glrp/atgt:latest
image: glrp/atgt:v1.0.8
environment:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Expand Down
Loading