Skip to content

set-matrix: smarter autoscaling#352

Merged
theihor merged 1 commit intomasterfrom
smarter-autoscaling
Mar 25, 2025
Merged

set-matrix: smarter autoscaling#352
theihor merged 1 commit intomasterfrom
smarter-autoscaling

Conversation

@theihor
Copy link
Contributor

@theihor theihor commented Mar 25, 2025

Currently we always run kernel builds on AWS CodeBuild, which autoscales on demand. However, we still have to maintain bare metal self-hosted runners in order to run selftests. If builds always run on CodeBuild, then the provisioned runners are underutilized.

Implement autoscaling logic in the set-matrix script:

  • query github about the status of self-hosted runners
  • if they are not busy, use them for builds
  • otherwise use CodeBuild

The threshold is set at 80% of online suitable runners being busy.

@theihor theihor force-pushed the smarter-autoscaling branch from b536a4c to 3ecbaa7 Compare March 25, 2025 19:37
Currently we always run kernel builds on AWS CodeBuild, which
autoscales on demand. However, we still have to maintain bare metal
self-hosted runners in order to run selftests. If builds always run on
CodeBuild, then the provisioned runners are underutilized.

Implement autoscaling logic in the set-matrix script:
* query github about the status of self-hosted runners
* if they are not busy, use them for builds
* otherwise use CodeBuild

The threshold is set at 80% of online suitable runners being busy.
@theihor theihor force-pushed the smarter-autoscaling branch from 3ecbaa7 to ba53e53 Compare March 25, 2025 19:56
@theihor theihor merged commit a162eae into master Mar 25, 2025
57 checks passed
@theihor theihor deleted the smarter-autoscaling branch March 25, 2025 22:30
theihor added a commit that referenced this pull request Mar 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant