Add wait for add_ons to become available

[aliabbasjaffri]

Currently setting wait for add_ons for minikube cluster with docker driver is not working. I am setting the wait as wait = ["all", "apps_running"], however that does not work and other helm charts start getting applied to the cluster before waiting for add_ons to be installed, and failing, as add_ons are necessary to be available, such as ingress controller.

[scott-the-programmer]

Thanks for reporting this! I'm reasonably confident this PR will fix the issue.

I'll try polish up the PR later tonight and cut a new release 👍🏽

[aliabbasjaffri]

thank you so much for promptly replying back! I'm working on a feature that allows users to deploy MLOps tools locally on their system using minikube. This fix will be a great to have :-)

[aliabbasjaffri]

What should be the right option for the wait variable here? I'm still seeing the same issue with the error:

* Internal error occurred: failed calling webhook "validate.nginx.ingress.kubernetes.io": failed to call webhook: Post "https://ingress-nginx-controller-admission.ingress-nginx.svc:443/networking/v1/ingresses?timeout=10s": dial tcp 10.109.190.7:443: connect: connection refused

[scott-the-programmer]

What should be the right option for the wait variable here? I'm still seeing the same issue with the error:

* Internal error occurred: failed calling webhook "validate.nginx.ingress.kubernetes.io": failed to call webhook: Post "https://ingress-nginx-controller-admission.ingress-nginx.svc:443/networking/v1/ingresses?timeout=10s": dial tcp 10.109.190.7:443: connect: connection refused

You can try wait = [ "all" ] which will wait for all components. I think in this case, the ingress is coming up and marked as running, but the pod isn't yet healthy. I don't think there's a way in minikube to wait for the ingress to be healthy - but i think you could achieve it via

 resource "kubernetes_job" "wait_for_ingress_nginx" {
  metadata {
    name      = "wait-for-ingress-nginx"
    namespace = "kube-system"
  }

  spec {
    template {
      metadata {
        name = "wait-for-ingress-nginx"
      }
      spec {
        container {
          name    = "kubectl"
          image   = "bitnami/kubectl:latest"
          command = ["/bin/sh", "-c"]
          args = [
            "kubectl wait --namespace ingress-nginx --for=condition=ready pod --selector=app.kubernetes.io/component=controller --timeout=300s"
          ]
        }
        restart_policy = "Never"
      }
    }
    backoff_limit = 4
  }

  wait_for_completion = true

  timeouts {
    create = "5m"
  }
}

[aliabbasjaffri]

I just tried setting wait to ["all"] and i get the following error:

Error: invalid wait option(s): all

However thanks for the tip above, i managed to make it work :-)