Is it Observable

Episode : Ecologits

This repository contains the files utilized during the tutorial presented in the dedicated IsItObservable episode related to reporting the energy usage of our LLM using Ecologits

this tutorial will also utilize the OpenTelemetry Operator with:

• the OpenTelemetry Demo

All the observability data generated by the environment would be sent to Dynatrace.

Prerequisite

The following tools need to be install on your machine :

• jq
• kubectl
• git
• gcloud ( if you are using GKE)
• Helm

1.Create a Google Cloud Platform Project

PROJECT_ID="<your-project-id>"
gcloud services enable container.googleapis.com --project ${PROJECT_ID}
gcloud services enable monitoring.googleapis.com \
cloudtrace.googleapis.com \
clouddebugger.googleapis.com \
cloudprofiler.googleapis.com \
--project ${PROJECT_ID}

2.Create a GKE cluster

ZONE=europe-west3-a
NAME=isitobservaboe-ecologits
gcloud container clusters create ${NAME} --zone=${ZONE} --machine-type=e2-standard-4 --num-nodes=2

3. Clone Github repo

git clone  https://github.com/isitobservable/ecologits
cd ecologits

Getting started

Dynatrace Tenant

1. Dynatrace Tenant - start a trial

If you don't have any Dynatrace tenant , then I suggest to create a trial using the following link : Dynatrace Trial Once you have your Tenant save the Dynatrace tenant url in the variable DT_TENANT_URL (for example : https://dedededfrf.live.dynatrace.com)

DT_TENANT_URL=<YOUR TENANT Host>

2. Create the Dynatrace API Tokens

The dynatrace operator will require to have several tokens:

• Token to deploy and configure the various components
• Token to ingest metrics and Traces

Operator Token

One for the operator having the following scope:

• Create ActiveGate tokens
• Read entities
• Read Settings
• Write Settings
• Access problem and event feed, metrics and topology
• Read configuration
• Write configuration
• Paas integration - installer downloader

Save the value of the token . We will use it later to store in a k8S secret

API_TOKEN=<YOUR TOKEN VALUE>

Ingest data token

Create a Dynatrace token with the following scope:

• Ingest metrics (metrics.ingest)
• Ingest logs (logs.ingest)
• Ingest events (events.ingest)
• Ingest OpenTelemetry
• Read metrics

Save the value of the token . We will use it later to store in a k8S secret

DATA_INGEST_TOKEN=<YOUR TOKEN VALUE>

AZURE OpenAI

You will have to provision a Azure AI OpenAI service

1. OpenAI Endpoint

AZURE_OPENAI_ENDPOINT="<YOUR OPENAI ENDPOINT>"

2. OpenAI Token

AZURE_OPENAI_KEY> --from-literal endpoint=<AZURE_OPENAI_ENDPOINT> -n travel-advisor-azure

AZURE_OPENAI_KEY="<YOUR OPENAI KEY>"

Deploying with solution emiting logs

Deploy most of the components

The application will deploy the entire environment:

chmod 777 deployment.sh
./deployment.sh  --clustername "${NAME}" --dturl "${DT_TENANT_URL}" --dtingesttoken "${DATA_INGEST_TOKEN}" --dtoperatortoken "${API_TOKEN}" --openAIendpoint "${AZURE_OPENAI_ENDPOINT}" --openAITOKEN "${AZURE_OPENAI_KEY}"

Update to emit metrics

kubectl apply -f k8s/deployment-openlit-metric.yaml -n travel-advisor-azure
kubectl apply -f k8s/deployment_metric.yaml -n travel-advisor-azure