[FAILED] Timed out after 300.000s.
HelmReleaseProxy quick-start-lte5im/nutanix-csi-storage-quick-start-khnadeqvve53jsjx8fkix19faxdjbxk failed to become ready and have up to date revision: ready condition = &{Type:Ready Status:False Severity:Error LastTransitionTime:2025-11-01 05:08:07 +0000 UTC Reason:HelmInstallOrUpgradeFailed Message:Kubernetes cluster unreachable: Get "https://10.23.132.56:6443/version?timeout=10s": tls: failed to verify certificate: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "kubernetes")}, revision = 1, full object is:
&{TypeMeta:{Kind:HelmReleaseProxy APIVersion:addons.cluster.x-k8s.io/v1alpha1} ObjectMeta:{Name:nutanix-csi-storage-quick-start-khnadeqvve53jsjx8fkix19faxdjbxk GenerateName:nutanix-csi-storage-quick-start-khnadeqvve53jsjx8fkix19fax5v5zu457vg4zbm7e0tfzvrare- Namespace:quick-start-lte5im SelfLink: UID:e5715ae6-0aaf-43ee-a859-b0af668d227f ResourceVersion:6146 Generation:1 CreationTimestamp:2025-11-01 05:04:33 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[cluster.x-k8s.io/cluster-name:quick-start-khnadeqvve53jsjx8fkix19fax5v5zu457vg4zbm7e0tfzvrare helmreleaseproxy.addons.cluster.x-k8s.io/helmchartproxy-name:nutanix-csi-019a3dca-0905-73fe-a10e-6d4eca7f4e6c] Annotations:map[] OwnerReferences:[{APIVersion:addons.cluster.x-k8s.io/v1alpha1 Kind:HelmChartProxy Name:nutanix-csi-019a3dca-0905-73fe-a10e-6d4eca7f4e6c UID:34c8544e-174c-44f8-9d27-9c59f5979156 Controller:0xc001080be7 BlockOwnerDeletion:0xc001080be6}] Finalizers:[helmreleaseproxy.addons.cluster.x-k8s.io] ManagedFields:[{Manager:manager Operation:Update APIVersion:addons.cluster.x-k8s.io/v1alpha1 Time:2025-11-01 05:04:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:finalizers":{".":{},"v:\"helmreleaseproxy.addons.cluster.x-k8s.io\"":{}},"f:generateName":{},"f:labels":{".":{},"f:cluster.x-k8s.io/cluster-name":{},"f:helmreleaseproxy.addons.cluster.x-k8s.io/helmchartproxy-name":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"34c8544e-174c-44f8-9d27-9c59f5979156\"}":{}}},"f:spec":{".":{},"f:chartName":{},"f:clusterRef":{},"f:namespace":{},"f:options":{".":{},"f:enableClientCache":{},"f:install":{".":{},"f:createNamespace":{}},"f:timeout":{},"f:upgrade":{".":{},"f:maxHistory":{}}},"f:releaseName":{},"f:repoURL":{},"f:tlsConfig":{".":{},"f:caSecret":{}},"f:values":{},"f:version":{}}} Subresource:} {Manager:manager Operation:Update APIVersion:addons.cluster.x-k8s.io/v1alpha1 Time:2025-11-01 05:08:07 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{".":{},"f:conditions":{},"f:observedGeneration":{},"f:revision":{},"f:status":{}}} Subresource:status}]} Spec:{ClusterRef:{Kind:Cluster Namespace:quick-start-lte5im Name:quick-start-khnadeqvve53jsjx8fkix19fax5v5zu457vg4zbm7e0tfzvrare UID: APIVersion:cluster.x-k8s.io/v1beta1 ResourceVersion: FieldPath:} ChartName:nutanix-csi-storage RepoURL:oci://helm-repository.caren-system.svc/charts ReleaseName:nutanix-csi ReleaseNamespace:ntnx-system Version:3.3.8 Values:# Disable creating the Prism Central credentials Secret, the Secret will be created by the handler.
createPrismCentralSecret: false
# Disable creating the Prism Element credentials Secret, it won't be used the CSI driver as configured here.
createSecret: false
pcSecretName: nutanix-csi-credentials

tolerations:
  - key: CriticalAddonsOnly
    operator: Exists
  - effect: NoExecute
    operator: Exists
    tolerationSeconds: 300
  - effect: NoSchedule
    operator: Exists ReconcileStrategy: Options:{DisableHooks:false Wait:false WaitForJobs:false DependencyUpdate:false Timeout:&Duration{Duration:10m0s,} SkipCRDs:false SubNotes:false DisableOpenAPIValidation:false Atomic:false Install:{CreateNamespace:true IncludeCRDs:false} Upgrade:{Force:false ResetValues:false ReuseValues:false ResetThenReuseValues:false Recreate:false MaxHistory:10 CleanupOnFail:false} Uninstall:<nil> EnableClientCache:false} Credentials:<nil> TLSConfig:0xc002c033a0} Status:{Conditions:[{Type:Ready Status:False Severity:Error LastTransitionTime:2025-11-01 05:08:07 +0000 UTC Reason:HelmInstallOrUpgradeFailed Message:Kubernetes cluster unreachable: Get "https://10.23.132.56:6443/version?timeout=10s": tls: failed to verify certificate: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "kubernetes")} {Type:ClusterAvailable Status:True Severity: LastTransitionTime:2025-11-01 05:04:35 +0000 UTC Reason: Message:} {Type:HelmReleaseReady Status:False Severity:Error LastTransitionTime:2025-11-01 05:08:07 +0000 UTC Reason:HelmInstallOrUpgradeFailed Message:Kubernetes cluster unreachable: Get "https://10.23.132.56:6443/version?timeout=10s": tls: failed to verify certificate: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "kubernetes")}] Status:failed Revision:1 ObservedGeneration:1}}
`
Expected
    <bool>: false
to be true
In [It] at: /home/runner/_work/cluster-api-runtime-extensions-nutanix/cluster-api-runtime-extensions-nutanix/test/e2e/helmreleaseproxy_helpers.go:60 @ 11/01/25 05:13:51.292

There were additional failures detected after the initial failure. These are visible in the timeline

[FAILED] Timed out after 300.001s.
HelmReleaseProxy quick-start-r4w24i/nutanix-csi-storage-quick-start-78upcgpupchpkldu0mg9y3c012s89cv failed to become ready and have up to date revision: ready condition = &{Type:Ready Status:False Severity:Info LastTransitionTime:2025-11-01 05:05:08 +0000 UTC Reason:PreparingToHelmInstall Message:Preparing to to install Helm chart}, revision = 0, full object is:
&{TypeMeta:{Kind:HelmReleaseProxy APIVersion:addons.cluster.x-k8s.io/v1alpha1} ObjectMeta:{Name:nutanix-csi-storage-quick-start-78upcgpupchpkldu0mg9y3c012s89cv GenerateName:nutanix-csi-storage-quick-start-78upcgpupchpkldu0mg9y3c0122sx3y2lnl7juh1vdj9yp46dsf- Namespace:quick-start-r4w24i SelfLink: UID:31008a6c-6444-4250-8723-a56aeaa76ad6 ResourceVersion:4846 Generation:1 CreationTimestamp:2025-11-01 05:05:08 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[cluster.x-k8s.io/cluster-name:quick-start-78upcgpupchpkldu0mg9y3c0122sx3y2lnl7juh1vdj9yp46dsf helmreleaseproxy.addons.cluster.x-k8s.io/helmchartproxy-name:nutanix-csi-019a3dca-08a6-7ae3-b328-1703d773d846] Annotations:map[] OwnerReferences:[{APIVersion:addons.cluster.x-k8s.io/v1alpha1 Kind:HelmChartProxy Name:nutanix-csi-019a3dca-08a6-7ae3-b328-1703d773d846 UID:4ad63593-55e2-42f7-9add-a2e04be9533f Controller:0xc000f6635d BlockOwnerDeletion:0xc000f6635c}] Finalizers:[helmreleaseproxy.addons.cluster.x-k8s.io] ManagedFields:[{Manager:manager Operation:Update APIVersion:addons.cluster.x-k8s.io/v1alpha1 Time:2025-11-01 05:05:08 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:finalizers":{".":{},"v:\"helmreleaseproxy.addons.cluster.x-k8s.io\"":{}},"f:generateName":{},"f:labels":{".":{},"f:cluster.x-k8s.io/cluster-name":{},"f:helmreleaseproxy.addons.cluster.x-k8s.io/helmchartproxy-name":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"4ad63593-55e2-42f7-9add-a2e04be9533f\"}":{}}},"f:spec":{".":{},"f:chartName":{},"f:clusterRef":{},"f:namespace":{},"f:options":{".":{},"f:enableClientCache":{},"f:install":{".":{},"f:createNamespace":{}},"f:timeout":{},"f:upgrade":{".":{},"f:maxHistory":{}}},"f:releaseName":{},"f:repoURL":{},"f:tlsConfig":{".":{},"f:caSecret":{}},"f:values":{},"f:version":{}}} Subresource:} {Manager:manager Operation:Update APIVersion:addons.cluster.x-k8s.io/v1alpha1 Time:2025-11-01 05:05:08 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{".":{},"f:conditions":{},"f:observedGeneration":{}}} Subresource:status}]} Spec:{ClusterRef:{Kind:Cluster Namespace:quick-start-r4w24i Name:quick-start-78upcgpupchpkldu0mg9y3c0122sx3y2lnl7juh1vdj9yp46dsf UID: APIVersion:cluster.x-k8s.io/v1beta1 ResourceVersion: FieldPath:} ChartName:nutanix-csi-storage RepoURL:oci://helm-repository.caren-system.svc/charts ReleaseName:nutanix-csi ReleaseNamespace:ntnx-system Version:3.3.8 Values:# Disable creating the Prism Central credentials Secret, the Secret will be created by the handler.
createPrismCentralSecret: false
# Disable creating the Prism Element credentials Secret, it won't be used the CSI driver as configured here.
createSecret: false
pcSecretName: nutanix-csi-credentials

tolerations:
  - key: CriticalAddonsOnly
    operator: Exists
  - effect: NoExecute
    operator: Exists
    tolerationSeconds: 300
  - effect: NoSchedule
    operator: Exists ReconcileStrategy: Options:{DisableHooks:false Wait:false WaitForJobs:false DependencyUpdate:false Timeout:&Duration{Duration:10m0s,} SkipCRDs:false SubNotes:false DisableOpenAPIValidation:false Atomic:false Install:{CreateNamespace:true IncludeCRDs:false} Upgrade:{Force:false ResetValues:false ReuseValues:false ResetThenReuseValues:false Recreate:false MaxHistory:10 CleanupOnFail:false} Uninstall:<nil> EnableClientCache:false} Credentials:<nil> TLSConfig:0xc000a18550} Status:{Conditions:[{Type:Ready Status:False Severity:Info LastTransitionTime:2025-11-01 05:05:08 +0000 UTC Reason:PreparingToHelmInstall Message:Preparing to to install Helm chart} {Type:HelmReleaseReady Status:False Severity:Info LastTransitionTime:2025-11-01 05:05:08 +0000 UTC Reason:PreparingToHelmInstall Message:Preparing to to install Helm chart}] Status: Revision:0 ObservedGeneration:1}}
`
Expected
    <bool>: false
to be true
In [It] at: /home/runner/_work/cluster-api-runtime-extensions-nutanix/cluster-api-runtime-extensions-nutanix/test/e2e/helmreleaseproxy_helpers.go:60 @ 11/01/25 05:15:09.036

[FAILED] Timed out after 600.000s.
No Control Plane machines came into existence. 
Expected
    <bool>: false
to be true
In [It] at: /home/runner/go/pkg/mod/sigs.k8s.io/cluster-api/[email protected]/framework/controlplane_helpers.go:153 @ 11/01/25 05:11:06.206

[FAILED] Timed out after 300.000s.
HelmReleaseProxy quick-start-gljscv/konnector-agent-quick-start-nt2n0q0c5903ei21dhiinh27umcy54p25nv failed to become ready and have up to date revision: ready condition = &{Type:Ready Status:False Severity:Info LastTransitionTime:2025-11-01 05:04:36 +0000 UTC Reason:HelmReleasePending Message:Helm release is in a pending state: pending-install}, revision = 1, full object is:
&{TypeMeta:{Kind:HelmReleaseProxy APIVersion:addons.cluster.x-k8s.io/v1alpha1} ObjectMeta:{Name:konnector-agent-quick-start-nt2n0q0c5903ei21dhiinh27umcy54p25nv GenerateName:konnector-agent-quick-start-nt2n0q0c5903ei21dhiinh27umcy54nu86dx9h7qpy3zj6jmwli- Namespace:quick-start-gljscv SelfLink: UID:56b94e91-a953-4c7e-bda2-282acba3cf1a ResourceVersion:4230 Generation:1 CreationTimestamp:2025-11-01 05:04:31 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[cluster.x-k8s.io/cluster-name:quick-start-nt2n0q0c5903ei21dhiinh27umcy54nu86dx9h7qpy3zj6jmwli helmreleaseproxy.addons.cluster.x-k8s.io/helmchartproxy-name:konnector-agent-019a3dca-08a4-7cfc-b31e-35ec6061541e] Annotations:map[] OwnerReferences:[{APIVersion:addons.cluster.x-k8s.io/v1alpha1 Kind:HelmChartProxy Name:konnector-agent-019a3dca-08a4-7cfc-b31e-35ec6061541e UID:a20d7c3d-30c7-4506-8d46-6f1c0d97db16 Controller:0xc000acaa4d BlockOwnerDeletion:0xc000acaa4c}] Finalizers:[helmreleaseproxy.addons.cluster.x-k8s.io] ManagedFields:[{Manager:manager Operation:Update APIVersion:addons.cluster.x-k8s.io/v1alpha1 Time:2025-11-01 05:04:31 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:finalizers":{".":{},"v:\"helmreleaseproxy.addons.cluster.x-k8s.io\"":{}},"f:generateName":{},"f:labels":{".":{},"f:cluster.x-k8s.io/cluster-name":{},"f:helmreleaseproxy.addons.cluster.x-k8s.io/helmchartproxy-name":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a20d7c3d-30c7-4506-8d46-6f1c0d97db16\"}":{}}},"f:spec":{".":{},"f:chartName":{},"f:clusterRef":{},"f:namespace":{},"f:options":{".":{},"f:enableClientCache":{},"f:install":{".":{},"f:createNamespace":{}},"f:timeout":{},"f:upgrade":{".":{},"f:maxHistory":{}}},"f:releaseName":{},"f:repoURL":{},"f:tlsConfig":{".":{},"f:caSecret":{}},"f:values":{},"f:version":{}}} Subresource:} {Manager:manager Operation:Update APIVersion:addons.cluster.x-k8s.io/v1alpha1 Time:2025-11-01 05:04:36 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{".":{},"f:conditions":{},"f:observedGeneration":{},"f:revision":{},"f:status":{}}} Subresource:status}]} Spec:{ClusterRef:{Kind:Cluster Namespace:quick-start-gljscv Name:quick-start-nt2n0q0c5903ei21dhiinh27umcy54nu86dx9h7qpy3zj6jmwli UID: APIVersion:cluster.x-k8s.io/v1beta1 ResourceVersion: FieldPath:} ChartName:konnector-agent RepoURL:oci://helm-repository.caren-system.svc/charts ReleaseName:konnector-agent ReleaseNamespace:ntnx-system Version:1.3.0-rc.1 Values:agent:
  name: konnector-agent
  image:
    repository: quay.io/karbon
    name: k8s-agent
pc:
  port: 9440
  insecure: true #set this to true if PC does not have https enabled
  endpoint: pc.ci.nkp.sh # eg: ip or fqdn
k8sClusterName: quick-start-nt2n0q0c5903ei21dhiinh27umcy
k8sDistribution: NKP
createSecret: false ReconcileStrategy: Options:{DisableHooks:false Wait:false WaitForJobs:false DependencyUpdate:false Timeout:&Duration{Duration:10m0s,} SkipCRDs:false SubNotes:false DisableOpenAPIValidation:false Atomic:false Install:{CreateNamespace:true IncludeCRDs:false} Upgrade:{Force:false ResetValues:false ReuseValues:false ResetThenReuseValues:false Recreate:false MaxHistory:10 CleanupOnFail:false} Uninstall:<nil> EnableClientCache:false} Credentials:<nil> TLSConfig:0xc0006db5a0} Status:{Conditions:[{Type:Ready Status:False Severity:Info LastTransitionTime:2025-11-01 05:04:36 +0000 UTC Reason:HelmReleasePending Message:Helm release is in a pending state: pending-install} {Type:ClusterAvailable Status:True Severity: LastTransitionTime:2025-11-01 05:04:32 +0000 UTC Reason: Message:} {Type:HelmReleaseReady Status:False Severity:Info LastTransitionTime:2025-11-01 05:04:36 +0000 UTC Reason:HelmReleasePending Message:Helm release is in a pending state: pending-install}] Status:pending-install Revision:1 ObservedGeneration:1}}
`
Expected
    <bool>: false
to be true
In [It] at: /home/runner/_work/cluster-api-runtime-extensions-nutanix/cluster-api-runtime-extensions-nutanix/test/e2e/helmreleaseproxy_helpers.go:60 @ 11/01/25 05:15:11.45

There were additional failures detected after the initial failure. These are visible in the timeline