running multiple runners with custom labels not scaling.

[lacion]

Hello, I'm trying to run multiple runners with custom levels and different resource requirements that match to EC2 spot instances handled by karpenter.

if i run a single runnerdeploymnet everything works but as soon as i go to multiples it gets tricky

---
apiVersion: actions.summerwind.dev/v1alpha1
kind: RunnerDeployment
metadata:
  name: org-runner-xlarge
  namespace: actions-runner-system
spec:
  template:
    metadata:
      namespace: actions-runner-system
      annotations:
        cluster-autoscaler.kubernetes.io/safe-to-evict: "true"
    spec:
      labels:
        - xlarge
      nodeSelector:
        application: "github-ci"
      organization: xxx
      image: summerwind/actions-runner-dind
      dockerdWithinRunnerContainer: true
      serviceAccountName: github-actions-runner
      resources:
        limits:
          cpu: "4"
          memory: "15Gi"
        requests:
          cpu: "4"
          memory: "14Gi"
---
apiVersion: actions.summerwind.dev/v1alpha1
kind: RunnerDeployment
metadata:
  name: org-runner-2xlarge
  namespace: actions-runner-system
spec:
  template:
    metadata:
      namespace: actions-runner-system
      annotations:
        cluster-autoscaler.kubernetes.io/safe-to-evict: "true"
    spec:
      labels:
        - 2xlarge
      nodeSelector:
        application: "github-ci"
      organization: xxx
      image: summerwind/actions-runner-dind
      dockerdWithinRunnerContainer: true
      serviceAccountName: github-actions-runner
      resources:
        limits:
          cpu: "8"
          memory: "29Gi"
        requests:
          cpu: "8"
          memory: "32Gi"
---
apiVersion: actions.summerwind.dev/v1alpha1
kind: RunnerDeployment
metadata:
  name: org-runner-4xlarge
  namespace: actions-runner-system
spec:
  template:
    metadata:
      namespace: actions-runner-system
      annotations:
        cluster-autoscaler.kubernetes.io/safe-to-evict: "true"
    spec:
      labels:
        - 4xlarge
      nodeSelector:
        application: "github-ci"
      organization: xxx
      image: summerwind/actions-runner-dind
      dockerdWithinRunnerContainer: true
      serviceAccountName: github-actions-runner
      resources:
        limits:
          cpu: "16"
          memory: "60Gi"
        requests:
          cpu: "16"
          memory: "32Gi"
---
apiVersion: actions.summerwind.dev/v1alpha1
kind: RunnerDeployment
metadata:
  name: org-runner-8xlarge
  namespace: actions-runner-system
spec:
  template:
    metadata:
      namespace: actions-runner-system
      annotations:
        cluster-autoscaler.kubernetes.io/safe-to-evict: "true"
    spec:
      labels:
        - 8xlarge
      nodeSelector:
        application: "github-ci"
      organization: xxx
      image: summerwind/actions-runner-dind
      dockerdWithinRunnerContainer: true
      serviceAccountName: github-actions-runner
      resources:
        limits:
          cpu: "32"
          memory: "120Gi"
        requests:
          cpu: "32"
          memory: "64Gi"

---
apiVersion: actions.summerwind.dev/v1alpha1
kind: HorizontalRunnerAutoscaler
metadata:
  name: org-runner-autoscaler-xlarge
  namespace: actions-runner-system
spec:
  scaleDownDelaySecondsAfterScaleOut: 300
  scaleTargetRef:
    kind: RunnerDeployment
    name: org-runner-xlarge
  minReplicas: 0
  maxReplicas: 10
  scaleUpTriggers:
    - githubEvent:
        workflowJob: {}
      duration: "30m"
---
apiVersion: actions.summerwind.dev/v1alpha1
kind: HorizontalRunnerAutoscaler
metadata:
  name: org-runner-autoscaler-2xlarge
  namespace: actions-runner-system
spec:
  scaleDownDelaySecondsAfterScaleOut: 300
  scaleTargetRef:
    kind: RunnerDeployment
    name: org-runner-2xlarge
  minReplicas: 0
  maxReplicas: 10
  scaleUpTriggers:
    - githubEvent:
        workflowJob: {}
      duration: "30m"
---
apiVersion: actions.summerwind.dev/v1alpha1
kind: HorizontalRunnerAutoscaler
metadata:
  name: org-runner-autoscaler-4xlarge
  namespace: actions-runner-system
spec:
  scaleDownDelaySecondsAfterScaleOut: 300
  scaleTargetRef:
    kind: RunnerDeployment
    name: org-runner-4xlarge
  minReplicas: 0
  maxReplicas: 10
  scaleUpTriggers:
    - githubEvent:
        workflowJob: {}
      duration: "30m"
---
apiVersion: actions.summerwind.dev/v1alpha1
kind: HorizontalRunnerAutoscaler
metadata:
  name: org-runner-autoscaler-8xlarge
  namespace: actions-runner-system
spec:
  scaleDownDelaySecondsAfterScaleOut: 300
  scaleTargetRef:
    kind: RunnerDeployment
    name: org-runner-8xlarge
  minReplicas: 0
  maxReplicas: 10
  scaleUpTriggers:
    - githubEvent:
        workflowJob: {}
      duration: "30m"

and i always get the same errors

{"event": "workflow_job", "hookID": "390836522", "delivery": "03c3d5b0-77e7-11ed-9e94-badf6eba2d8a", "workflowJob.status": "completed", "workflowJob.labels": ["xlarge"], "repository.name": "xxx", "repository.owner.login": "xxx", "repository.owner.type": "Organization", "enterprise.slug": "", "action": "completed", "repository": "xxx/xxx", "organization": "xxx", "enterprises": ""}
2022-12-09T17:29:20Z	DEBUG	controllers.webhookbasedautoscaler	groups	{"event": "workflow_job", "hookID": "390836522", "delivery": "03c3d5b0-77e7-11ed-9e94-badf6eba2d8a", "workflowJob.status": "completed", "workflowJob.labels": ["4xlarge"], "repository.name": "xxx", "repository.owner.login": "xxx", "repository.owner.type": "Organization", "enterprise.slug": "", "action": "completed", "groups": ""}
2022-12-09T17:29:20Z	DEBUG	controllers.webhookbasedautoscaler	no repository/organizational/enterprise runner found	{"event": "workflow_job", "hookID": "390836522", "delivery": "03c3d5b0-77e7-11ed-9e94-badf6eba2d8a", "workflowJob.status": "completed", "workflowJob.labels": ["4xlarge"], "repository.name": "xxx", "repository.owner.login": "xxx", "repository.owner.type": "Organization", "enterprise.slug": "", "action": "completed", "repository": "xxx/xxx", "organization": "xxx", "enterprise": ""}
2022-12-09T17:29:20Z	DEBUG	controllers.webhookbasedautoscaler	Scale target not found. If this is unexpected, ensure that there is exactly one repository-wide or organizational runner deployment that matches this webhook event	{"event": "workflow_job", "hookID": "390836522", "delivery": "03c3d5b0-77e7-11ed-9e94-badf6eba2d8a", "workflowJob.status": "completed", "workflowJob.labels": ["4xlarge"], "repository.name": "xxx", "repository.owner.login": "xxx", "repository.owner.type": "Organization", "enterprise.slug": "", "action": "completed"}
2022-12-09T17:35:06Z	DEBUG	controllers.webhookbasedautoscaler	Found 0 HRAs by key	{"key": "xxx/xxx"}

im sure im doing something wrong, im just not sure what

[lacion]

this was just miss configuration

i had a typo in the namespace the controller watched.