fix: Create a separate controller for generating availability/pricing metrics

[jonathan-innis]

Fixes #7758

Description

This updates our pricing and availability metrics to be generated by a separate controller. This controller polls every minute, pulls all NodePools on the cluster, and unions their results to generate the pricing and availability information globally.

Note that this now means that if no NodePool selects on a specific subnet through their referenced EC2NodeClasses, that that offering will now report as unavailable. Pricing data should be consistent across NodePools and will continue to be reported regardless if the offering is available or not.

How was this change tested?

make presubmit
/karpenter snapshot

Does this change impact docs?

• Yes, PR includes docs updates
• Yes, issue opened: #
• No

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[netlify]

✅ Deploy Preview for karpenter-docs-prod canceled.

Name	Link
🔨 Latest commit	5de23f0
🔍 Latest deploy log	https://app.netlify.com/sites/karpenter-docs-prod/deploys/67d9c17cf4730e0009cc939c

[coveralls]

Pull Request Test Coverage Report for Build 13931262486

Details

• 64 of 75 (85.33%) changed or added relevant lines in 5 files are covered.
• No unchanged relevant lines lost coverage.
• Overall coverage decreased (-0.3%) to 66.74%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
pkg/controllers/controllers.go	0	1	0.0%
pkg/controllers/metrics/controller.go	44	54	81.48%

Totals
Change from base Build 13930011851:	-0.3%
Covered Lines:	6710
Relevant Lines:	10054

---

💛 - Coveralls

[jonathan-innis]

/karpenter snapshot

[github-actions]

Snapshot successfully published to oci://021119463062.dkr.ecr.us-east-1.amazonaws.com/karpenter/snapshot/karpenter:0-c5e1766c957926bb4f20ab1fe2dfe6e96ec65524.
To install you must login to the ECR repo with an AWS account:

aws ecr get-login-password --region us-east-1 | docker login --username AWS --password-stdin 021119463062.dkr.ecr.us-east-1.amazonaws.com

helm upgrade --install karpenter oci://021119463062.dkr.ecr.us-east-1.amazonaws.com/karpenter/snapshot/karpenter --version "0-c5e1766c957926bb4f20ab1fe2dfe6e96ec65524" --namespace "kube-system" --create-namespace \
  --set "settings.clusterName=${CLUSTER_NAME}" \
  --set "settings.interruptionQueue=${CLUSTER_NAME}" \
  --set controller.resources.requests.cpu=1 \
  --set controller.resources.requests.memory=1Gi \
  --set controller.resources.limits.cpu=1 \
  --set controller.resources.limits.memory=1Gi \
  --wait

[jonathan-innis]

/karpenter snapshot

[github-actions]

Snapshot successfully published to oci://021119463062.dkr.ecr.us-east-1.amazonaws.com/karpenter/snapshot/karpenter:0-6e28c43e6700612914332cfd103d14c972b556c4.
To install you must login to the ECR repo with an AWS account:

aws ecr get-login-password --region us-east-1 | docker login --username AWS --password-stdin 021119463062.dkr.ecr.us-east-1.amazonaws.com

helm upgrade --install karpenter oci://021119463062.dkr.ecr.us-east-1.amazonaws.com/karpenter/snapshot/karpenter --version "0-6e28c43e6700612914332cfd103d14c972b556c4" --namespace "kube-system" --create-namespace \
  --set "settings.clusterName=${CLUSTER_NAME}" \
  --set "settings.interruptionQueue=${CLUSTER_NAME}" \
  --set controller.resources.requests.cpu=1 \
  --set controller.resources.requests.memory=1Gi \
  --set controller.resources.limits.cpu=1 \
  --set controller.resources.limits.memory=1Gi \
  --wait

[rschalo]

lgtm