Runners not in sync and new runners not coming up

[sravula84]

HI Team
am using ARC from past 2 years , recently we installed in GKE cluster and after a month starts seeing when the new runners pods not initializing and job waiting long time .

Cannot connect to the Docker daemon at unix:///run/docker.sock. Is the docker daemon running?
Cannot connect to the Docker daemon at unix:///run/docker.sock. Is the docker daemon running?
Cannot connect to the Docker daemon at unix:///run/docker.sock. Is the docker daemon running?
Cannot connect to the Docker daemon at unix:///run/docker.sock. Is the docker daemon running?
Cannot connect to the Docker daemon at unix:///run/docker.sock. Is the docker daemon running?

and another error -

runnerpod	Failed to delete pod within 1m0s. This is typically the case when a Kubernetes node became unreachable and the kube controller started evicting nodes. Forcefully deleting the pod to not get stuck.	{"runnerpod": "actions-runner-systems/github-action-np-jfc84-bkzdt", "podDeletionTimestamp": "2024-01-10 00:55:51 +0000 UTC", "currentTime": "2024-01-10T00:57:12Z", "configuredDeletionTimeout": "1m0s"}

2024-01-10T00:57:48Z DEBUG horizontalrunnerautoscaler Suggested desired replicas of 20 by PercentageRunnersBusy {"replicas_desired_before": 20, "replicas_desired": 20, "num_runners": 20, "num_runners_registered": 14, "num_runners_busy": 9, "num_terminating_busy": 0, "namespace": "actions-runner-systems", "kind": "runnerdeployment", "name": "github-action-np", "horizontal_runner_autoscaler": "example-runner-deployment-autoscaler", "enterprise": "", "organization": "prosperllc", "repository": ""}
2024-01-10T00:57:48Z DEBUG horizontalrunnerautoscaler Calculated desired replicas of 20 {"horizontalrunnerautoscaler": "actions-runner-systems/example-runner-deployment-autoscaler", "suggested": 20, "reserved": 0, "min": 10, "max": 50}