Listener pods gets removed when AutoscalingRunnerSet is patched

[hanikesn]

Checks

• I've already read https://docs.github.com/en/actions/hosting-your-own-runners/managing-self-hosted-runners-with-actions-runner-controller/troubleshooting-actions-runner-controller-errors and I'm sure my issue is not covered in the troubleshooting guide.
• I am using charts that are officially provided

Controller Version

0.12.1

Deployment Method

ArgoCD

Checks

• This isn't a question or user support case (For Q&A and community support, go to Discussions).
• I've read the Changelog before submitting this issue and I'm sure it's not due to any recently-introduced backward-incompatible changes

To Reproduce

1.  
        - kubectl
        - patch
        - autoscalingrunnerset.actions.github.com
        - $(AUTOSCALING_RUNNER_SET_NAME)
        - '--namespace'
        - $(NAMESPACE)
        - '--type=merge'
        - '--patch'
        - |
          {"spec":{"minRunners": $(MIN_RUNNERS)}}

Describe the bug

The pods exit/crash and don't get recreated. To recreated them deleting an ephemeral runner works.

Listener Logs

2025-08-07 10:02:43.284	2025/08/07 08:02:43 Application returned an error: http: Server closed
2025-08-07 10:02:42.578	2025-08-07T08:02:42Z	INFO	listener-app	getting Actions tenant URL and JWT	{"registrationURL": "https://api.github.com/actions/runner-registration"}
2025-08-07 10:02:42.386	2025-08-07T08:02:42Z	INFO	listener-app	getting runner registration token	{"registrationTokenURL": "https://api.github.com/orgs/XXX/actions/runners/registration-token"}
2025-08-07 10:02:42.198	2025-08-07T08:02:42Z	INFO	listener-app	getting access token for GitHub App auth	{"accessTokenURL": "https://api.github.com/app/installations/XXXXXX/access_tokens"}
2025-08-07 10:02:42.196	2025-08-07T08:02:42Z	INFO	listener-app.metrics exporter.metrics	stopping metrics server	{"err": "context canceled"}
2025-08-07 10:02:42.196	2025-08-07T08:02:42Z	INFO	listener-app	refreshing token	{"githubConfigUrl": "https://github.com/XXX"}
2025-08-07 10:02:42.196	2025-08-07T08:02:42Z	INFO	listener-app.listener	Deleting message session
2025-08-07 10:02:42.196		golang.org/x/sync@v0.12.0/errgroup/errgroup.go:78
2025-08-07 10:02:42.196	golang.org/x/sync/errgroup.(*Group).Go.func1
2025-08-07 10:02:42.196		github.com/actions/actions-runner-controller/cmd/ghalistener/app/app.go:130
2025-08-07 10:02:42.196	github.com/actions/actions-runner-controller/cmd/ghalistener/app.(*App).Run.func1
2025-08-07 10:02:42.196		github.com/actions/actions-runner-controller/cmd/ghalistener/listener/listener.go:163
2025-08-07 10:02:42.196	github.com/actions/actions-runner-controller/cmd/ghalistener/listener.(*Listener).Listen
2025-08-07 10:02:42.196		github.com/actions/actions-runner-controller/cmd/ghalistener/listener/listener.go:272
2025-08-07 10:02:42.196	github.com/actions/actions-runner-controller/cmd/ghalistener/listener.(*Listener).getMessage
2025-08-07 10:02:42.196		github.com/actions/actions-runner-controller/github/actions/client.go:578
2025-08-07 10:02:42.196	github.com/actions/actions-runner-controller/github/actions.(*Client).GetMessage
2025-08-07 10:02:42.196		github.com/actions/actions-runner-controller/github/actions/client.go:275
2025-08-07 10:02:42.196	github.com/actions/actions-runner-controller/github/actions.(*Client).Do
2025-08-07 10:02:42.196		net/http/client.go:587
2025-08-07 10:02:42.196	net/http.(*Client).Do
2025-08-07 10:02:42.196		net/http/client.go:728
2025-08-07 10:02:42.196	net/http.(*Client).do
2025-08-07 10:02:42.196		net/http/client.go:180
2025-08-07 10:02:42.196	net/http.(*Client).send
2025-08-07 10:02:42.196		net/http/client.go:259
2025-08-07 10:02:42.196	net/http.send
2025-08-07 10:02:42.196		github.com/hashicorp/go-retryablehttp@v0.7.7/roundtripper.go:47
2025-08-07 10:02:42.196	github.com/hashicorp/go-retryablehttp.(*RoundTripper).RoundTrip
2025-08-07 10:02:42.196		github.com/hashicorp/go-retryablehttp@v0.7.7/client.go:718
2025-08-07 10:02:42.196	github.com/hashicorp/go-retryablehttp.(*Client).Do
2025-08-07 10:02:42.196		github.com/actions/actions-runner-controller/github/actions/client.go:78
2025-08-07 10:02:42.196	github.com/actions/actions-runner-controller/github/actions.(*clientLogger).Error
2025-08-07 10:02:42.196	2025-08-07T08:02:42Z	ERROR	listener-app	Retryable client error	{"error": "Get \"https://broker.actions.githubusercontent.com/scalesets/message?lastMessageId=100000062\": context canceled", "method": "GET", "url": "https://broker.actions.githubusercontent.com/scalesets/message?lastMessageId=100000062", "error": "request failed"}
2025-08-07 10:02:33.038	2025-08-07T08:02:33Z	INFO	listener-app.listener	Getting next message	{"lastMessageID": 100000062}
2025-08-07 10:02:33.038	2025-08-07T08:02:33Z	INFO	listener-app.worker.kubernetesworker	Ephemeral runner set scaled.	{"namespace": "gha-runners", "name": "XXX-generic-25smc", "replicas": 1}
2025-08-07 10:02:32.881	2025-08-07T08:02:32Z	INFO	listener-app.worker.kubernetesworker	Preparing EphemeralRunnerSet update	{"json": "{\"spec\":{\"patchID\":0,\"replicas\":1}}"}
2025-08-07 10:02:32.880	2025-08-07T08:02:32Z	INFO	listener-app.worker.kubernetesworker	Compare	{"original": "{\"metadata\":{\"creationTimestamp\":null},\"spec\":{\"replicas\":-1,\"patchID\":-1,\"ephemeralRunnerSpec\":{\"metadata\":{\"creationTimestamp\":null},\"spec\":{\"containers\":null}}},\"status\":{\"currentReplicas\":0,\"pendingEphemeralRunners\":0,\"runningEphemeralRunners\":0,\"failedEphemeralRunners\":0}}", "patch": "{\"metadata\":{\"creationTimestamp\":null},\"spec\":{\"replicas\":1,\"patchID\":0,\"ephemeralRunnerSpec\":{\"metadata\":{\"creationTimestamp\":null},\"spec\":{\"containers\":null}}},\"status\":{\"currentReplicas\":0,\"pendingEphemeralRunners\":0,\"runningEphemeralRunners\":0,\"failedEphemeralRunners\":0}}"}
2025-08-07 10:02:32.880	2025-08-07T08:02:32Z	INFO	listener-app.worker.kubernetesworker	Calculated target runner count	{"assigned job": 0, "decision": 1, "min": 1, "max": 12, "currentRunnerCount": 1, "jobsCompleted": 0}

Describe the expected behavior

listener pods stay alive

Additional Context

The same error can be seen in #4154, but it's not clear whether the two issues are related.

Controller Logs

2025-08-07 10:02:44.835	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Successfully removed finalizer after cleanup	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.835	2025-08-07T08:02:44Z	INFO	AutoscalingRunnerSet	Creating a new AutoscalingListener is waiting for the running and pending runners to finish. Waiting for the running and pending runners to finish:	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}, "running": 1, "pending": 0}
2025-08-07 10:02:44.834	2025-08-07T08:02:44Z	INFO	AutoscalingRunnerSet	AutoscalingListener does not exist.	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}}
2025-08-07 10:02:44.834	2025-08-07T08:02:44Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}, "name": "XXXXXX-generic-25smc", "specHash": "6c9f5d9b47"}
2025-08-07 10:02:44.813	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.813	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener service account is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.813	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Cleaning up the listener service account	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.813	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener role is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.813	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener role binding is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.807	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener pod is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.807	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.807	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.806	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.778	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Deleting the listener service account	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.778	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Cleaning up the listener service account	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.778	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener role is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.778	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener role binding is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.771	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener pod is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.771	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.770	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.770	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.758	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Deleting the listener role	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.758	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener role binding is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.752	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener pod is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.752	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.752	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.752	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.739	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Deleting the listener role binding	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.731	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Listener pod is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.731	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:44.731	2025-08-07T08:02:44Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.897	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.886	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Deleting the listener config secret	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.874	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Listener pod is deleted	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.874	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.874	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.860	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.859	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.859	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.528	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.528	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.528	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.450	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.449	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:43.449	2025-08-07T08:02:43Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.808	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.808	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.808	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.487	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.487	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.487	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.326	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.326	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.326	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.244	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.244	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.244	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.204	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.203	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.203	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.193	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.193	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.193	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.193	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.193	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.193	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.193	2025-08-07T08:02:42Z	INFO	AutoscalingRunnerSet	Deleted RunnerScaleSetListener since existing one is out of date	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}}
2025-08-07 10:02:42.172	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.144	2025-08-07T08:02:42Z	INFO	AutoscalingRunnerSet	RunnerScaleSetListener is out of date. Deleting it so that it is recreated	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}, "name": "XXXXXX-generic-d69d8c8c-listener"}
2025-08-07 10:02:42.143	2025-08-07T08:02:42Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}, "name": "XXXXXX-generic-25smc", "specHash": "6c9f5d9b47"}
2025-08-07 10:02:42.142	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.142	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.142	2025-08-07T08:02:42Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.1", "autoscalinglistener": {"name":"XXXXXX-generic-d69d8c8c-listener","namespace":"gha-runner-system"}}
2025-08-07 10:02:42.140	2025-08-07T08:02:42Z	INFO	AutoscalingRunnerSet	Deleted RunnerScaleSetListener since existing one is out of date	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}}
2025-08-07 10:02:42.122	2025-08-07T08:02:42Z	INFO	AutoscalingRunnerSet	RunnerScaleSetListener is out of date. Deleting it so that it is recreated	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}, "name": "XXXXXX-generic-d69d8c8c-listener"}
2025-08-07 10:02:42.122	2025-08-07T08:02:42Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-generic","namespace":"gha-runners"}, "name": "XXXXXX-generic-25smc", "specHash": "6c9f5d9b47"}
2025-08-07 10:02:26.539	2025-08-07T08:02:26Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.1", "autoscalingrunnerset": {"name":"XXXXXX-build-2g","namespace":"gha-runners"}, "name": "XXXXXX-build-2g-6d4pr", "specHash": "7dd89cf484"}
2025-08-07 10:02:26.539	2025-08-07T08:02:26Z	INFO	EphemeralRunnerSet	Scaling comparison	{"version": "0.12.1", "ephemeralrunnerset": {"name":"XXXXXX-build-2g-6d4pr","namespace":"gha-runners"}, "current": 3, "desired": 3}
2025-08-07 10:02:26.539	2025-08-07T08:02:26Z	INFO	EphemeralRunnerSet	Ephemeral runner counts	{"version": "0.12.1", "ephemeralrunnerset": {"name":"XXXXXX-build-2g-6d4pr","namespace":"gha-runners"}, "pending": 0, "running": 3, "finished": 0, "failed": 0, "deleting": 0}

Runner Pod Logs

not relevant

[nsudhakar-devcloud]

I'm also getting simlar issue, my listener pod is not stable, i've specified in my runner scale-set like min=0,max=5.
But listener pod is not stable. due that even though the runner-ser shows in github, its not taking any job[stuck state]. Any immediate fix for this?

@hanikesn Do you have anything say here?

2025-08-07T04:55:48Z	ERROR	listener-app	Retryable client error	{"error": "Get \"https://broker.actions.githubusercontent.com/scalesets/message\": context canceled", "method": "GET", "url": "https://broker.actions.githubusercontent.com/scalesets/message", "error": "request failed"}
github.com/actions/actions-runner-controller/github/actions.(*clientLogger).Error
	github.com/actions/actions-runner-controller/github/actions/client.go:78
github.com/hashicorp/go-retryablehttp.(*Client).Do
	github.com/hashicorp/go-retryablehttp@v0.7.7/client.go:718
github.com/hashicorp/go-retryablehttp.(*RoundTripper).RoundTrip
	github.com/hashicorp/go-retryablehttp@v0.7.7/roundtripper.go:47
net/http.send
	net/http/client.go:259
net/http.(*Client).send
	net/http/client.go:180
net/http.(*Client).do
	net/http/client.go:728
net/http.(*Client).Do
	net/http/client.go:587
github.com/actions/actions-runner-controller/github/actions.(*Client).Do
	github.com/actions/actions-runner-controller/github/actions/client.go:275
github.com/actions/actions-runner-controller/github/actions.(*Client).GetMessage
	github.com/actions/actions-runner-controller/github/actions/client.go:578
github.com/actions/actions-runner-controller/cmd/ghalistener/listener.(*Listener).getMessage
	github.com/actions/actions-runner-controller/cmd/ghalistener/listener/listener.go:272
github.com/actions/actions-runner-controller/cmd/ghalistener/listener.(*Listener).Listen
	github.com/actions/actions-runner-controller/cmd/ghalistener/listener/listener.go:163
github.com/actions/actions-runner-controller/cmd/ghalistener/app.(*App).Run.func1
	github.com/actions/actions-runner-controller/cmd/ghalistener/app/app.go:130
golang.org/x/sync/errgroup.(*Group).Go.func1
	golang.org/x/sync@v0.12.0/errgroup/errgroup.go:78
2025-08-07T04:55:48Z	INFO	listener-app.listener	Deleting message session
2025/08/07 04:55:48 Application returned an error: failed to get message: failed to get next message: failed to issue the request: client request failed: Get "https://broker.actions.githubusercontent.com/scalesets/message": GET https://broker.actions.githubusercontent.com/scalesets/message giving up after 1 attempt(s): context canceled

[nsudhakar-devcloud]

@hanikesn Have you implemented any workaround so far to move forward?

[nsudhakar-devcloud]

If I keep min-runners=1, its working for me