Help with Grafana configuration

[PoweredByPeople]

Hey there,

I'm relatively new to this project and to jsonnet. I'm trying to deploy grafana ingress on a url subpath but am having trouble getting the syntax/hierarchy correct. There are several examples in both this project and also the https://github.com/brancz/kubernetes-grafana project, however I am struggling to put it all together into one working jsonnet file in order to generate the correct manifest files.

I'm using kube-prometheus v0.8.0 and running on k3s v1.20.6+k3s1

My questions:

1. When compiling, should all configuration/customizations be made in a single jsonnet file? I'm just asking since all of the examples are in separate files. (ex: https://github.com/prometheus-operator/kube-prometheus/blob/main/examples/all-namespaces.jsonnet, https://github.com/prometheus-operator/kube-prometheus/blob/main/examples/ingress.jsonnet, etc)
2. Does anyone in the community have an entire working jsonnet example that customizes this project with ingress controllers that exposes prometheus, grafana and alertmanager on subpaths such as https://<server_ip>/grafana ? I'm having trouble merging the existing snippets into a working example.

This is what I have so far: (I know it doesn't work, it's just a collection of things I've tried in order to convey what I'm trying to accomplish.)

  (import 'kube-prometheus/main.libsonnet') +
  // Uncomment the following imports to enable its patches
  // (import 'kube-prometheus/addons/anti-affinity.libsonnet') +
  // (import 'kube-prometheus/addons/managed-cluster.libsonnet') +
  //(import 'kube-prometheus/addons/node-ports.libsonnet') +
  // (import 'kube-prometheus/addons/static-etcd.libsonnet') +
  // (import 'kube-prometheus/addons/custom-metrics.libsonnet') +
  // (import 'kube-prometheus/addons/external-metrics.libsonnet') +
  {
    values+:: {
      common+: {
        namespace: 'monitoring',
      },
    },
      grafana+:: {
        config+: {
          sections+: {
            server+: {
              root_url: 'http://localhost:3000/grafana',
              serve_from_sub_path: {enabled: true},
            },
          },
        },
      },

local ingress(name, namespace, rules) = {
  apiVersion: 'networking.k8s.io/v1',
  kind: 'Ingress',
  metadata: {
    name: name,
    namespace: namespace,
    annotations: {
      'nginx.ingress.kubernetes.io/auth-type': 'basic',
      'nginx.ingress.kubernetes.io/auth-secret': 'basic-auth',
      'nginx.ingress.kubernetes.io/auth-realm': 'Authentication Required',
    },
  },
  spec: { rules: rules },
};

local kp =
  (import 'kube-prometheus/main.libsonnet') +
  {
    values+:: {
      common+: {
        namespace: 'monitoring',
      },
      grafana+:: {
        config+: {
          sections+: {
            server+: {
              root_url: 'http://grafana.example.com/',
            },
          },
        },
      },
    },
    // Configure External URL's per application
    alertmanager+:: {
      alertmanager+: {
        spec+: {
          externalUrl: 'http://alertmanager.example.com',
        },
      },
    },
    prometheus+:: {
      prometheus+: {
        spec+: {
          externalUrl: 'http://prometheus.example.com',
        },
      },
    },
    // Create ingress objects per application
    ingress+:: {
      'alertmanager-main': ingress(
        'alertmanager-main',
        $.values.common.namespace,
        [{
          host: 'alertmanager.example.com',
          http: {
            paths: [{
              backend: {
                service: {
                  name: 'alertmanager-main',
                  port: 'web',
                },
              },
            }],
          },
        }]
      ),
      grafana: ingress(
        'grafana',
        $.values.common.namespace,
        [{
          host: 'grafana.example.com',
          http: {
            paths: [{
              backend: {
                service: {
                  name: 'grafana',
                  port: 'http',
                },
              },
            }],
          },
        }],
      ),
      'prometheus-k8s': ingress(
        'prometheus-k8s',
        $.values.common.namespace,
        [{
          host: 'prometheus.example.com',
          http: {
            paths: [{
              backend: {
                service: {
                  name: 'prometheus-k8s',
                  port: 'web',
                },
              },
            }],
          },
        }],
      ),
    },
  } + {
    // Create basic auth secret - replace 'auth' file with your own
    ingress+:: {
      'basic-auth-secret': {
        apiVersion: 'v1',
        kind: 'Secret',
        metadata: {
          name: 'basic-auth',
          namespace: $.values.common.namespace,
        },
        data: { auth: std.base64(importstr 'auth') },
        type: 'Opaque',
      },
    },
  },

{ [name + '-ingress']: kp.ingress[name] for name in std.objectFields(kp.ingress) }

{ 'setup/0namespace-namespace': kp.kubePrometheus.namespace } +
{
  ['setup/prometheus-operator-' + name]: kp.prometheusOperator[name]
  for name in std.filter((function(name) name != 'serviceMonitor' && name != 'prometheusRule'), std.objectFields(kp.prometheusOperator))
} +
// serviceMonitor and prometheusRule are separated so that they can be created after the CRDs are ready
{ 'prometheus-operator-serviceMonitor': kp.prometheusOperator.serviceMonitor } +
{ 'prometheus-operator-prometheusRule': kp.prometheusOperator.prometheusRule } +
{ 'kube-prometheus-prometheusRule': kp.kubePrometheus.prometheusRule } +
{ ['alertmanager-' + name]: kp.alertmanager[name] for name in std.objectFields(kp.alertmanager) } +
{ ['blackbox-exporter-' + name]: kp.blackboxExporter[name] for name in std.objectFields(kp.blackboxExporter) } +
{ ['grafana-' + name]: kp.grafana[name] for name in std.objectFields(kp.grafana) } +
{ ['kube-state-metrics-' + name]: kp.kubeStateMetrics[name] for name in std.objectFields(kp.kubeStateMetrics) } +
{ ['kubernetes-' + name]: kp.kubernetesControlPlane[name] for name in std.objectFields(kp.kubernetesControlPlane) }
{ ['node-exporter-' + name]: kp.nodeExporter[name] for name in std.objectFields(kp.nodeExporter) } +
{ ['prometheus-' + name]: kp.prometheus[name] for name in std.objectFields(kp.prometheus) } +
{ ['prometheus-adapter-' + name]: kp.prometheusAdapter[name] for name in std.objectFields(kp.prometheusAdapter) }```

[zallesov]

Haha. having exact same issue. This jsonnet is so cryptic. I think I will end up generating yams and than just edit them.
I really can not wrap my head around how to add properties. for example I got to add annotation to grafana service.

How would I do it from here?

[kHRISl33t]

Tried to figure out the same thing, but I ended up patching the manifest:

    spec:
      containers:
        - env:
            - name: GF_SERVER_ROOT_URL
              value: <YOUR_URL_WITH_PATH>
            - name: GF_SERVER_SERVE_FROM_SUB_PATH
              value: "true"

and creating a custom ingress resource also.