Webhook autoscaling does not work as expected. #2806
Kananideel
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Concern:
We have seen a pattern where the auto scaling does not spin up pods as and when needed.
Jobs which request for self-hosted runners are in waiting state for 15-20 minutes on an average, even when the auto-scaling is in place.
We currently have runners based on summerwind/actions-runner:latest
Datadog Shows that we have an average of 30 pods running.
Auto Scaling has been set to 100 pods.
2 webhook Deployments are in place. (actions-runner-controller-github-webhook-server)
Arc version is on Latest Version, 0.23.3.
Steps to reproduce the problem.
execute multiple(30) workflows which internally has multiple jobs(3) calling the same runner.
Expected behavior:-
The runner should auto scale and pod should be allocated to jobs quickly.
Current behavior:-
The workflow jobs are in pending state for an average 15-20 minutes.
Beta Was this translation helpful? Give feedback.
All reactions