OpenStack Provider Support

[revgit12]

Background

We are using BuildBarn for Remote Build Execution (RBE) with Bazel builds in our environment and are interested in leveraging bb-autoscaler for dynamic worker scaling. Currently, our infrastructure runs on OpenStack, but bb-autoscaler only supports EKS, AWS Auto Scaling Groups, and Kubernetes as per ReadMe.

Use Case

• Environment: OpenStack-based infrastructure
• Workload: Bazel builds using BuildBarn RBE
• Requirement: Automatic scaling of bb-worker instances based on build queue demand
• Goal: Cost optimization and efficient resource utilization

Current Limitations

bb-autoscaler currently supports:

• EKS (Elastic Kubernetes Service)
• AWS Auto Scaling Groups
• Generic Kubernetes clusters

Proposed Solution

We would like to know if we can extend bb-autoscaler to support OpenStack as a provider, enabling:

• Dynamic VM provisioning using OpenStack with bb-autoscaler

Questions

1. Extensibility: Is the current bb-autoscaler architecture designed to support additional cloud providers?
2. Implementation Guidance: Are there specific interfaces or extension points for adding new providers?
3. Alternative Approaches: Are there recommended workarounds or alternative architectures for OpenStack environments?

[EdSchouten]

Hi Revanth,

As you observed correctly, bb-autoscaler does not support OpenStack. However, it is a pretty simple tool, so feel free to submit a pull request to add support for this. bb-autoscaler is a fairly simple tool. It's Go source file is only 263 lines of code:

https://github.com/buildbarn/bb-autoscaler/blob/master/cmd/bb_autoscaler/main.go

To add OpenStack support, you likely only need to look for the 'switch' statements in this file and add corresponding blocks for OpenStack.

[revgit12]

Hi Revanth,

As you observed correctly, bb-autoscaler does not support OpenStack. However, it is a pretty simple tool, so feel free to submit a pull request to add support for this. bb-autoscaler is a fairly simple tool. It's Go source file is only 263 lines of code:

https://github.com/buildbarn/bb-autoscaler/blob/master/cmd/bb_autoscaler/main.go

To add OpenStack support, you likely only need to look for the 'switch' statements in this file and add corresponding blocks for OpenStack.

Thank you for the information @EdSchouten . I will work on creating the PR for this. Thank you.