kube-apiserver logs show error message: 'failed to download v1alpha1.data.packaging.carvel.dev: resource not found'

[a-varma]

What steps did you take:
Checked the logs of kube-apiserver and noticed that the log shows the following error messages:

I0415 07:18:39.156692       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.
E0415 07:20:39.161403       1 controller.go:102] loading OpenAPI spec for "v1alpha1.data.packaging.carvel.dev" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
I0415 07:20:39.161435       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.
E0415 07:22:38.180983       1 controller.go:146] Error updating APIService "v1alpha1.data.packaging.carvel.dev" with err: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
E0415 07:22:39.183071       1 controller.go:102] loading OpenAPI spec for "v1alpha1.data.packaging.carvel.dev" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
I0415 07:22:39.185778       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.
E0415 07:23:39.190351       1 controller.go:102] loading OpenAPI spec for "v1alpha1.data.packaging.carvel.dev" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
I0415 07:23:39.190384       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.
E0415 07:25:39.195101       1 controller.go:102] loading OpenAPI spec for "v1alpha1.data.packaging.carvel.dev" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
I0415 07:25:39.195127       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.
E0415 07:27:38.178927       1 controller.go:146] Error updating APIService "v1alpha1.data.packaging.carvel.dev" with err: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
E0415 07:27:39.180914       1 controller.go:102] loading OpenAPI spec for "v1alpha1.data.packaging.carvel.dev" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
I0415 07:27:39.180937       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.
E0415 07:28:39.185838       1 controller.go:102] loading OpenAPI spec for "v1alpha1.data.packaging.carvel.dev" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
I0415 07:28:39.185872       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.
E0415 07:30:39.190595       1 controller.go:102] loading OpenAPI spec for "v1alpha1.data.packaging.carvel.dev" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
I0415 07:30:39.190629       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.
E0415 07:32:38.189805       1 controller.go:146] Error updating APIService "v1alpha1.data.packaging.carvel.dev" with err: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
E0415 07:32:39.192166       1 controller.go:102] loading OpenAPI spec for "v1alpha1.data.packaging.carvel.dev" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found
I0415 07:32:39.192200       1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.

What happened:
No impact on package installations. But the logs are filled with above error message.

What did you expect:
No error message because there is no affect on package installations.

Anything else you would like to add:

• kubectl get pkgi -A shows that all the installed packages are reconciling successfully.

• Increased the verbosity of kube-apiserver logs to v=6 and It looks like the request for processingv1alpha1.data.packaging.carvel.dev goes to two endpoints: openapi/v2 and openapi/v3. The request for ‘openapi/v2’ fails with resource not found but ‘openapi/v3’ completes successfully. See the attached screenshot.

Environment:

• kapp Controller version (execute kubectl get deployment -n kapp-controller kapp-controller -o yaml and the annotation is kbld.k14s.io/images): v0.50.0
• Kubernetes version (use kubectl version): v1.30.1

---

Vote on this request

This is an invitation to the community to vote on issues, to help us prioritize our backlog. Use the "smiley face" up to the right of this comment to vote.

👍 "I would like to see this addressed as soon as possible"
👎 "There are other more important things to focus on right now"

We are also happy to receive and review Pull Requests if you want to help working on this issue.

[100mik]

I believe what happens here is that api-server prioritises v3 specs that are being served, we should dig in and ensure that we are not surfacing false errors.
This does not effect reconciliation of package installation and apps 🤔