feat(cockpit-k8s): review & test néda

Author: nerda-codes

observability/cockpit/how-to/send-log-from-k8s-to-cockpit.mdx

@@ -9,19 +9,19 @@ tags: kubernetes cockpit logs observability monitoring cluster
 categories:
   - observability
 dates:
-  validation: 2025/01/03
-  posted: 2025/01/03
+  validation: 2025/01/20
+  posted: 2025/01/20
 ---
 
-This page shows you how to send application logs created in a Kubernetes cluster to your Cockpit either by using a Helm chart or by deploying a Helm chart with [Terraform](https://www.terraform.io/).
+In this page we will show you how to send application logs from your Kubernetes cluster to your Cockpit using either a Helm chart or deploying a Helm chart with [Terraform](https://www.terraform.io/).
 
-In this example, we use [k8s-monitoring](https://artifacthub.io/packages/helm/grafana/k8s-monitoring/1.6.16) which installs an Alloy Daemon set to your Kubernetes cluster to export logs to your Cockpit.
+We will use the [k8s-monitoring](https://artifacthub.io/packages/helm/grafana/k8s-monitoring/1.6.16) Helm Chart, which installs an Alloy Daemon set to export your Kubernetes cluster's logs to your Cockpit.
 
 <Macro id="requirements" />
 
  - A Scaleway account logged into the [console](https://console.scaleway.com)
  - [Owner](/identity-and-access-management/iam/concepts/#owner) status or [IAM permissions](/identity-and-access-management/iam/concepts/#permission) allowing you to perform actions in the intended Organization
- - [Created](/observability/cockpit/how-to/create-external-data-sources/) a custom external data source
+ - [Created](/observability/cockpit/how-to/create-external-data-sources/) a custom external data source of the [logs type](/observability/cockpit/concepts/#data-types)
  - [Created](/observability/cockpit/how-to/create-token/) a Cockpit token for the same region as the data source
  - A running Kubernetes cluster containing your application deployed
  - [Created](/identity-and-access-management/iam/how-to/create-api-keys/) an API key and retrieved your API secret key
@@ -32,7 +32,7 @@ In this example, we use [k8s-monitoring](https://artifacthub.io/packages/helm/gr
 
 ## Configure the Helm chart
 
-Create a `values.yml` file to configure your Helm chart, using the example below. Make sure that you replace `$SCW_CLUSTER_NAME` with the name of your Scaleway Kubernetes cluster, `$COCKPIT_CUSTOM_DATASOURCE_HOST` with the hostname of your custom endpoint, and `$COCKPIT_TOKEN` with your Cockpit token.
+Create a `values.yml` file to configure your Helm chart, using the example below. Make sure that you replace `$SCW_CLUSTER_NAME` with the name of your Scaleway Kubernetes cluster, `$COCKPIT_CUSTOM_DATASOURCE_HOST` with the URL of your custom data source (you can find it under the "API URL" section in the [Data sources tab](https://console.scaleway.com/cockpit/dataSource) of the Scaleway console), and `$COCKPIT_TOKEN` with your Cockpit token.
 
 ```yaml
 cluster:
@@ -45,7 +45,7 @@ destinations:
     protocol: "http"
     logs: 
       enabled: true
-    url: "$COCKPIT_CUSTOM_DATASOURCE_HOST/loki/api/v1/push"
+    url: "$COCKPIT_CUSTOM_LOGS_DATASOURCE_URL/loki/api/v1/push" ##You can find your logs URL in the **Data sources** tab of the Scaleway conseole under the "API URL" section of the relevant data source
     tenantId: "$COCKPIT_TOKEN"
 
     metrics: 
@@ -77,37 +77,51 @@ alloy-singleton:
 ```
 
 <Message type="info">
-The template above is only an example to send logs to your Cockpit. You can also send metrics to Cockpit using this Helm chart.
-You can check our guide to [send metrics from your cluster to Cockpit](// ADD LINK TO METRICS TUTO)
+The template above is for sending logs to your Cockpit. You can also configure it to send metrics to Cockpit using this Helm chart.
+Refer to our dedicated doucumentation to [send metrics from your cluster to Cockpit](/observability/cockpit/how-to/send-metrics-froms-k8s-to-cockpit).
 </Message>
 
-## Send Kubernetes logs to your Cockpit using Helm chart
+## Send Kubernetes logs using Helm chart
 
-1. Connect your kubectl to your Kubernetes cluster
-2. Run the following command to apply your Helm chart with the `values.yml` file:
+Once you have configured your `values.yml` file, you can use Helm to deploy the log-forwarding configuration to your Kubernetes cluster. Before you can install the Helm chart, ensure that your `kubectl` tool is properly connected to your Kubernetes cluster. `kubectl` is the command-line tool for interacting with Kubernetes clusters.
+
+1. [Connect](/containers/kubernetes/how-to/connect-cluster-kubectl/) `kubectl` to your Kubernetes cluster
+2. Run the command below to install the `k8s-monitoring` Helm chart:
   ```
-  helm install -f /your-path/to/values.yml my-log-ingester k8s-monitoring --version 1.6.16
+  helm install -f /your-path/to/values.yml your-log-ingester k8s-monitoring --version 1.6.16
   ```
-  Make sure to replace `-f` flag with the correct path to your `values.yml` file.
+    The `-f` flag specifies the path to your `values.yml` file, which contains the configuration for the Helm chart. Make sure that you replace `/your-path/to/values.yml` with the correct path where your `values.yml` file is stored. Make sure that you also replace `your-log-ingester` with the log ingester of your choice. In our configuration we are using `alloy-lm-ingester`.
+    
+    Helm installs the `k8s-monitoring` chart, which includes the Alloy DaemonSet configured to collect logs from your Kubernetes cluster.
+    The DaemonSet ensures that a pod is running on each node in your cluster, which collects logs and forwards them to the specified Loki endpoint in your Cockpit.
+
+3. Optionally, check the status of the release to ensure it was installed:
 
-## Send Kubernetes logs to your Cockpit using Helm chart with Terraform
+    ```
+    helm list
+    ```
+    You should see a list of all the Helm releases in your cluster, including `my-log-ingester`.
 
-1. Set up the Helm Terraform provider:
+## Send Kubernetes logs using Helm chart with Terraform
+
+You can also use Terraform to manage and deploy Helm charts, providing you with more automation and consistency to manage your Kubernetes resources.
+
+1. Create a `provider.tf` file and paste the following template to set up the Helm Terraform provider:
   ```terraform
   provider "helm" {
     kubernetes {
-      host = your_k8s_cluster_host
-      token = your_k8s_cluster_token
+      host = your_k8s_cluster_host # The URL of your Kubernetes API server.
+      token = your_k8s_cluster_token # Authentication token to access the cluster.
       cluster_ca_certificate = base64decode(
-      your_k8s_cluster_ca_certificate
+      your_k8s_cluster_ca_certificate # The cluster's CA certificate, base64 encoded.
       )
     }
   }
   ```
-2. Create a Helm release resource with the path to your `values.yml`:
+2. Create a `maint.tf` file and paste the following template to create a Helm release resource. Make sure that you replace `/your-path/to/values.yml` with the actual path to your values file.
   ```
   resource "helm_release" "log-ingester" {
-    name = "my-log-ingester"
+    name = "your-log-ingester"
     repository = "https://grafana.github.io/helm-charts"
     chart = "k8s-monitoring"
     version = "2.0.2"
@@ -117,13 +131,20 @@ You can check our guide to [send metrics from your cluster to Cockpit](// ADD LI
     values = [file("/your-path/to/values.yml")]
   }
   ```
-3. Run `terraform apply` to apply the new Terraform configuration.
+3. Save your changes.
+4. Run `terraform init` to initialize your Terraform configuration and download any necessary providers.
+5. Run `terraform apply` to apply your configuration.
+5. Type `yes` when prompted to confirm the actions.
 
 ## Explore your logs in Cockpit
 
-Now that your logs are exported to your Cockpit, you can access and query them.
-
-1. Click **Cockpit** in the Observability section of the [console](https://console.scaleway.com/) side menu. The **Cockpit** overview page displays.
+1. Click **Cockpit** in the Observability section of the Scaleway [console](https://console.scaleway.com/) side menu. The **Cockpit** overview page displays.
 2. Click **Open dashboards** to open your managed dashboards in Grafana. You are redirected to the Grafana website.
-3. Click the **Home** icon > **Explore**. Select your custom data source in the upper left corner.
-4. Filter the query by only searching for the label `cluster` with the value corresponding to your cluster name and your logs should display.
+3. Log in to Grafana using your [Grafana credentials](/observability/cockpit/how-to/retrieve-grafana-credentials/).
+4. Click the **Home** icon, then click **Explore**.
+5. Select your custom data source in the search drop-down on the upper left corner of your screen.
+6. In the **Labels filter** drop-down, select the `cluster` label and in the **Value** drop-down, select your cluster. 
+7. Optionally, click the **Clock** icon on the top right corner of your screen and filter by time range.
+8. Click **Run query** to see your logs. An output similar to the following should display.
+
+<Lightbox src="scaleway-cpt-k8s-terraform-logs.webp" alt="" />