Skip to content

Conversation

@NickLarsenNZ
Copy link
Member

@NickLarsenNZ NickLarsenNZ commented Dec 12, 2024

Description

Stagger jobs between the following schedules (different hours every second day from the first or second of the month):

Concurrent Groups

# The listings below are modified from the out of of:
# grep -r "cron: '0" | sort -k2

cron: '0 0 1/2 * *' # https://crontab.guru/#0_0_1/2_*_*
- build_airflow.yaml
- build_java-base.yaml
- build_nifi.yaml
- build_testing-tools.yaml

cron: '0 0 2/2 * *' # https://crontab.guru/#0_0_2/2_*_*
- build_hbase.yaml
- build_kafka.yaml
- build_spark-k8s.yaml
- build_trino.yaml

cron: '0 1 1/2 * *' # https://crontab.guru/#0_1_1/2_*_*
- build_druid.yaml
- build_java-devel.yaml
- build_omid.yaml
- build_tools.yaml

cron: '0 1 2/2 * *' # https://crontab.guru/#0_1_2/2_*_*
- build_hello-world.yaml
- build_kcat.yaml
- build_stackable-base.yaml
- build_vector.yaml

cron: '0 2 1/2 * *' # https://crontab.guru/#0_2_1/2_*_*
- build_hadoop.yaml
- build_kafka-testing-tools.yaml
- build_opa.yaml
- build_trino-cli.yaml

cron: '0 2 2/2 * *' # https://crontab.guru/#0_2_2/2_*_*
- build_hive.yaml
- build_krb5.yaml
- build_superset.yaml
- build_zookeeper.yaml

@NickLarsenNZ NickLarsenNZ self-assigned this Dec 12, 2024
@NickLarsenNZ NickLarsenNZ added this pull request to the merge queue Dec 13, 2024
Merged via the queue into main with commit 34a11e4 Dec 13, 2024
3 checks passed
@NickLarsenNZ NickLarsenNZ deleted the ci/stagger-scheduled-builds branch December 13, 2024 09:05
NickLarsenNZ added a commit that referenced this pull request Dec 13, 2024
* ci: remove redundant usages of the free-disk-space action

Co-authored-by: Techassi <[email protected]>

* ci: Add attempt number to the workflow run name, and URL in the slack message (#941)

Co-authored-by: Techassi <[email protected]>

* ci: register a dummy test_build_images workflow which will be completed in a separate PR (#947)

* Use our build-repo for Maven downloads & other updates (#953)

* Use our build-repo for Maven downloads

* ci(build): Continue matrix builds on failure so there is less jobs to rerun when there are transient failures

* Update Spark Mvn build as well

* Hopefully silence Spark build

* Update FMPP version

This is because FMPP Maven Plugin depends on FMPP in version 0.9.14
which itself depends on a Freemarker version that has not been pinned.
Instead it specifies a "range" which resolves to a SNAPSHOT version
which we don't want.

* Add Stackable repo to Kafka build as well

* Update changelog

* Update CHANGELOG.md

Co-authored-by: Nick <[email protected]>

---------

Co-authored-by: Nick Larsen <[email protected]>
Co-authored-by: Nick <[email protected]>

* ci: Fix static analysis errors (#955)

* ci: Fix high severity errors

* ci: Set persist-credentials to false

* ci: Move step output to env var

* chore: Add changelog entry

* ci(build): stagger the scheduled builds to ease load on external systems (#954)

---------

Co-authored-by: Techassi <[email protected]>
Co-authored-by: Lars Francke <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants