The arc-gha-rs-controller is using a wrong registration token API endpoint

[SimonWoidig]

Hello! I tried installing the Actions Runner Controller with the help of "Quickstart for Actions Runner Controller". I auth'd it using a GitHub App I have created and installed into our org. I deployed the controller just fine. I created the needed secret with keys github_app_id, github_app_installation_id and github_app_private_key set correctly.
When I deployed the actual scale-set, nothing seemed to be happening. Then I checked the logs of the controller. These are the logs:

2023-09-07T09:22:39Z    INFO    Update strategy set to: {"updateStrategy": "immediate"}
2023-09-07T09:22:39Z    INFO    AutoscalingListener image pull policy changed   {"ImagePullPolicy": "IfNotPresent"}
2023-09-07T09:22:39Z    INFO    AutoscalingListener logging parameters changed  {"LogLevel": "debug", "LogFormat": "text"}
2023-09-07T09:22:39Z    INFO    Registering scale set metrics
2023-09-07T09:22:39Z    INFO    starting manager
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "autoscalingrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingRunnerSet", "source": "kind source: *v1alpha1.AutoscalingRunnerSet"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "autoscalingrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingRunnerSet", "source": "kind source: *v1alpha1.EphemeralRunnerSet"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "autoscalingrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingRunnerSet", "source": "kind source: *v1alpha1.AutoscalingListener"}
2023-09-07T09:22:39Z    INFO    Starting Controller     {"controller": "autoscalingrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingRunnerSet"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "ephemeral-runner-controller", "controllerGroup": "actions.github.com", "controllerKind": "EphemeralRunner", "source": "kind source: *v1alpha1.EphemeralRunner"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "ephemeral-runner-controller", "controllerGroup": "actions.github.com", "controllerKind": "EphemeralRunner", "source": "kind source: *v1.Pod"}
2023-09-07T09:22:39Z    INFO    Starting Controller     {"controller": "ephemeral-runner-controller", "controllerGroup": "actions.github.com", "controllerKind": "EphemeralRunner"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "autoscalinglistener", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingListener", "source": "kind source: *v1alpha1.AutoscalingListener"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "autoscalinglistener", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingListener", "source": "kind source: *v1.Pod"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "autoscalinglistener", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingListener", "source": "kind source: *v1.ServiceAccount"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "ephemeralrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "EphemeralRunnerSet", "source": "kind source: *v1alpha1.EphemeralRunnerSet"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "autoscalinglistener", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingListener", "source": "kind source: *v1.Role"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "ephemeralrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "EphemeralRunnerSet", "source": "kind source: *v1alpha1.EphemeralRunner"}
2023-09-07T09:22:39Z    INFO    Starting EventSource    {"controller": "autoscalinglistener", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingListener", "source": "kind source: *v1.RoleBinding"}
2023-09-07T09:22:39Z    INFO    Starting Controller     {"controller": "autoscalinglistener", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingListener"}
2023-09-07T09:22:39Z    INFO    Starting Controller     {"controller": "ephemeralrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "EphemeralRunnerSet"}
2023-09-07T09:22:39Z    INFO    Starting workers        {"controller": "ephemeralrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "EphemeralRunnerSet", "worker count": 1}
2023-09-07T09:22:39Z    INFO    Starting workers        {"controller": "autoscalinglistener", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingListener", "worker count": 1}
2023-09-07T09:22:39Z    INFO    Starting workers        {"controller": "ephemeral-runner-controller", "controllerGroup": "actions.github.com", "controllerKind": "EphemeralRunner", "worker count": 1}
2023-09-07T09:22:39Z    INFO    Starting workers        {"controller": "autoscalingrunnerset", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingRunnerSet", "worker count": 1}
2023-09-07T09:22:39Z    INFO    AutoscalingRunnerSet    Runner scale set id annotation does not exist. Creating a new runner scale set. {"autoscalingrunnerset": "arc-runners/MYORG-runners"}
2023-09-07T09:22:39Z    INFO    AutoscalingRunnerSet    Creating a new runner scale set {"autoscalingrunnerset": "arc-runners/MYORG-runners"}
2023-09-07T09:22:39Z    INFO    actions-clients retrieve actions client {"githubConfigURL": "https://github.com/organizations/MYORG", "namespace": "arc-runners"}
2023-09-07T09:22:39Z    INFO    actions-clients creating new client     {"githubConfigURL": "https://github.com/organizations/MYORG", "namespace": "arc-runners"}
2023-09-07T09:22:39Z    INFO    actions-clients successfully created new client {"githubConfigURL": "https://github.com/organizations/MYORG", "namespace": "arc-runners"}
2023-09-07T09:22:39Z    INFO    actions-clients refreshing token        {"githubConfigUrl": "https://github.com/organizations/MYORG"}
2023-09-07T09:22:39Z    INFO    actions-clients getting access token for GitHub App auth        {"accessTokenURL": "https://api.github.com/app/installations/INSTALLATIONID/access_tokens"}
2023-09-07T09:22:39Z    INFO    actions-clients getting runner registration token       {"registrationTokenURL": "https://api.github.com/repos/organizations/MYORG/actions/runners/registration-token"}
2023-09-07T09:22:40Z    ERROR   AutoscalingRunnerSet    Failed to get runner scale set from Actions service     {"autoscalingrunnerset": "arc-runners/MYORG-runners", "runnerGroupId": "1", "runnerScaleSetName": "MYORG-runners", "error": "failed to get runner registration token on refresh: unexpected response from Actions service during registration token call: 404 - {\"message\":\"Not Found\",\"documentation_url\":\"https://docs.github.com/rest/actions/self-hosted-runners#create-a-registration-token-for-a-repository\"}"}
github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet
        github.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:435
github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile
        github.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:192
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
        sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
        sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
        sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
        sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:235

So it seems, that the registration URL is wrong - it should actually be https://api.github.com/orgs/MYORG/actions/runners/registration-token and not https://api.github.com/repos/organizations/MYORG/actions/runners/registration-token. When I manually tried the "wrong" URL, it returned 404 and the "correct" returned 403 (without a token).
Am I missing something or is this a bug? Thanks!

[SimonWoidig]

Can anyone help me with this? We really want to migrate to GitHub, but we need our own runners.

[nikola-jokic]

Hey, it seems like your githubConfigUrl value is set to https://github.com/organizations/MYORG
If you are registering on org level, it should be https://github.com/MYORG

[SimonWoidig]

Ok, I am gonna try it as soon as I can. Thanks!