OTEL-DEMO: Using port 80 instead of 8080

[obs-gh-frankmartens]

I am trying to get OTEL-DEMO working on my kubernetes environment. Using port 8080 works with a loadbalancer to expose to the external network.

But Ideally I'd like to use port 80 instead of 8080. When I try to make the port 80 in the values.yaml file at install, nothing works.

Command I execute to install:
helm install otel-demo open-telemetry/opentelemetry-demo --values values.yaml

Here's my values.yaml

# MORE INFO: https://github.com/open-telemetry/opentelemetry-helm-charts/blob/main/charts/opentelemetry-demo/README.md#chart-parameters
components:
  frontendProxy:
    service:
      type: LoadBalancer
      port: 80

Getting the list of services:

fmartens@k8snode1:~$ kubectl get svc
NAME                              TYPE           CLUSTER-IP       EXTERNAL-IP     PORT(S)                                                                     AGE
kubernetes                        ClusterIP      10.152.183.1     <none>          443/TCP                                                                     3d17h
otel-demo-adservice               ClusterIP      10.152.183.72    <none>          8080/TCP                                                                    15s
otel-demo-cartservice             ClusterIP      10.152.183.153   <none>          8080/TCP                                                                    15s
otel-demo-checkoutservice         ClusterIP      10.152.183.199   <none>          8080/TCP                                                                    15s
otel-demo-currencyservice         ClusterIP      10.152.183.204   <none>          8080/TCP                                                                    15s
otel-demo-emailservice            ClusterIP      10.152.183.206   <none>          8080/TCP                                                                    15s
otel-demo-flagd                   ClusterIP      10.152.183.45    <none>          8013/TCP,4000/TCP                                                           15s
otel-demo-frontend                ClusterIP      10.152.183.69    <none>          8080/TCP                                                                    15s
otel-demo-frontendproxy           LoadBalancer   10.152.183.122   192.168.1.102   80:32377/TCP                                                                15s
otel-demo-grafana                 ClusterIP      10.152.183.35    <none>          80/TCP                                                                      15s
otel-demo-imageprovider           ClusterIP      10.152.183.245   <none>          8081/TCP                                                                    15s
otel-demo-jaeger-agent            ClusterIP      None             <none>          5775/UDP,5778/TCP,6831/UDP,6832/UDP                                         15s
otel-demo-jaeger-collector        ClusterIP      None             <none>          9411/TCP,14250/TCP,14267/TCP,14268/TCP,4317/TCP,4318/TCP                    15s
otel-demo-jaeger-query            ClusterIP      None             <none>          16686/TCP,16685/TCP                                                         15s
otel-demo-kafka                   ClusterIP      10.152.183.219   <none>          9092/TCP,9093/TCP                                                           15s
otel-demo-loadgenerator           ClusterIP      10.152.183.115   <none>          8089/TCP                                                                    15s
otel-demo-opensearch              ClusterIP      10.152.183.233   <none>          9200/TCP,9300/TCP,9600/TCP                                                  15s
otel-demo-opensearch-headless     ClusterIP      None             <none>          9200/TCP,9300/TCP,9600/TCP                                                  15s
otel-demo-otelcol                 ClusterIP      10.152.183.202   <none>          6831/UDP,14250/TCP,14268/TCP,8888/TCP,4317/TCP,4318/TCP,9464/TCP,9411/TCP   15s
otel-demo-paymentservice          ClusterIP      10.152.183.164   <none>          8080/TCP                                                                    15s
otel-demo-productcatalogservice   ClusterIP      10.152.183.200   <none>          8080/TCP                                                                    15s
otel-demo-prometheus-server       ClusterIP      10.152.183.43    <none>          9090/TCP                                                                    15s
otel-demo-quoteservice            ClusterIP      10.152.183.28    <none>          8080/TCP                                                                    15s
otel-demo-recommendationservice   ClusterIP      10.152.183.117   <none>          8080/TCP                                                                    15s
otel-demo-shippingservice         ClusterIP      10.152.183.230   <none>          8080/TCP                                                                    15s
otel-demo-valkey                  ClusterIP      10.152.183.110   <none>          6379/TCP                                                                    15s

Note that otel-demo-frontendproxy is setup to use LoadBalancer with EXTERNAL-IP of 192.168.1.102 (this is all correct) -- my "external network" is really just the wider LAN. Note that port is "80" -- this does not work, but when port is "8080" it does work.

Describing the "otel-demo-frontendproxy" service...

fmartens@k8snode1:~$ kubectl describe svc otel-demo-frontendproxy
Name:                     otel-demo-frontendproxy
Namespace:                default
Labels:                   app.kubernetes.io/component=frontendproxy
                          app.kubernetes.io/instance=otel-demo
                          app.kubernetes.io/managed-by=Helm
                          app.kubernetes.io/name=otel-demo-frontendproxy
                          app.kubernetes.io/part-of=opentelemetry-demo
                          app.kubernetes.io/version=1.12.0
                          helm.sh/chart=opentelemetry-demo-0.33.8
                          opentelemetry.io/name=otel-demo-frontendproxy
Annotations:              meta.helm.sh/release-name: otel-demo
                          meta.helm.sh/release-namespace: default
Selector:                 opentelemetry.io/name=otel-demo-frontendproxy
Type:                     LoadBalancer
IP Family Policy:         SingleStack
IP Families:              IPv4
IP:                       10.152.183.122
IPs:                      10.152.183.122
LoadBalancer Ingress:     192.168.1.102 (VIP)
Port:                     tcp-service  80/TCP
TargetPort:               80/TCP
NodePort:                 tcp-service  32377/TCP
Endpoints:                10.1.249.31:80
Session Affinity:         None
External Traffic Policy:  Cluster
Internal Traffic Policy:  Cluster
Events:
  Type    Reason        Age    From                Message
  ----    ------        ----   ----                -------
  Normal  IPAllocated   2m17s  metallb-controller  Assigned IP ["192.168.1.102"]
  Normal  nodeAssigned  104s   metallb-speaker     announcing from node "k8snode1" with protocol "layer2"

otel-demo-frontendproxy POD description:

fmartens@k8snode1:~$ kubectl describe pod otel-demo-frontendproxy
Name:             otel-demo-frontendproxy-f9f766885-f2zkc
Namespace:        default
Priority:         0
Service Account:  otel-demo
Node:             k8snode1/192.168.1.101
Start Time:       Mon, 06 Jan 2025 18:09:15 +0000
Labels:           app.kubernetes.io/component=frontendproxy
                  app.kubernetes.io/instance=otel-demo
                  app.kubernetes.io/name=otel-demo-frontendproxy
                  opentelemetry.io/name=otel-demo-frontendproxy
                  pod-template-hash=f9f766885
Annotations:      cni.projectcalico.org/containerID: d77420c01209825710ee9919d6e1e7eeffe1652fd210c331ee0ef50a73320f41
                  cni.projectcalico.org/podIP: 10.1.249.31/32
                  cni.projectcalico.org/podIPs: 10.1.249.31/32
Status:           Running
IP:               10.1.249.31
IPs:
  IP:           10.1.249.31
Controlled By:  ReplicaSet/otel-demo-frontendproxy-f9f766885
Containers:
  frontendproxy:
    Container ID:   containerd://39ebff6bc07c9b600e60c8be2a304104efc166803a59ea9e20a14a4eb5442c41
    Image:          ghcr.io/open-telemetry/demo:1.12.0-frontendproxy
    Image ID:       ghcr.io/open-telemetry/demo@sha256:9fdec1be03e4695aec8c9eff3a2b3d6b854c1e25aa5677a373a63b17f42db743
    Port:           80/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 06 Jan 2025 18:09:25 +0000
    Ready:          True
    Restart Count:  0
    Limits:
      memory:  50Mi
    Requests:
      memory:  50Mi
    Environment:
      OTEL_SERVICE_NAME:                                   (v1:metadata.labels['app.kubernetes.io/component'])
      OTEL_COLLECTOR_NAME:                                otel-demo-otelcol
      OTEL_EXPORTER_OTLP_METRICS_TEMPORALITY_PREFERENCE:  cumulative
      ENVOY_PORT:                                         8080
      FLAGD_HOST:                                         otel-demo-flagd
      FLAGD_PORT:                                         8013
      FLAGD_UI_HOST:                                      otel-demo-flagd
      FLAGD_UI_PORT:                                      4000
      FRONTEND_HOST:                                      otel-demo-frontend
      FRONTEND_PORT:                                      8080
      GRAFANA_SERVICE_HOST:                               otel-demo-grafana
      GRAFANA_SERVICE_PORT:                               80
      IMAGE_PROVIDER_HOST:                                otel-demo-imageprovider
      IMAGE_PROVIDER_PORT:                                8081
      JAEGER_SERVICE_HOST:                                otel-demo-jaeger-query
      JAEGER_SERVICE_PORT:                                16686
      LOCUST_WEB_HOST:                                    otel-demo-loadgenerator
      LOCUST_WEB_PORT:                                    8089
      OTEL_COLLECTOR_HOST:                                $(OTEL_COLLECTOR_NAME)
      OTEL_COLLECTOR_PORT_GRPC:                           4317
      OTEL_COLLECTOR_PORT_HTTP:                           4318
      OTEL_RESOURCE_ATTRIBUTES:                           service.name=$(OTEL_SERVICE_NAME),service.namespace=opentelemetry-demo,service.version=1.12.0
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-cbs4j (ro)
Conditions:
  Type                        Status
  PodReadyToStartContainers   True 
  Initialized                 True 
  Ready                       True 
  ContainersReady             True 
  PodScheduled                True 
Volumes:
  kube-api-access-cbs4j:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   Burstable
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:                      <none>

What am I missing?

[puckpuck]

I suspect you will also need to update the ENVOY_PORT environment variable to use port 80 as well.

[obs-gh-frankmartens]

Thanks... buuuut... frontend-proxy containers fail saying that its expecting an "int" value instead of a string

The helm chart requires ENVOY_PORT to be a string... updated YAML:

default:
  image:
    repository: ghcr.io/open-telemetry/demo
    pullPolicy: Always
  schedulingRules:
    nodeSelector:
      workload: demo
components:
  frontend-proxy:
    env:
      - name: ENVOY_PORT
        value: "80"
    service:
      type: LoadBalancer
      port: 80
  flagd:
    sidecarContainers:
      - name: flagd-ui
        useDefault:
          env: true
        service:
          port: 4000
        env:
          - name: FLAGD_METRICS_EXPORTER
            value: otel
          - name: OTEL_EXPORTER_OTLP_ENDPOINT
            value: http://$(OTEL_COLLECTOR_NAME):4318
        resources:
          limits:
            memory: 100Mi
        volumeMounts:
          - name: config-rw
            mountPath: /app/data

Error in "frontend-proxy" logs:

Unable to parse JSON as proto (INVALID_ARGUMENT: invalid JSON in envoy.config.bootstrap.v3.Bootstrap   @ static_resources.clusters[2].load_assignment.endpoints[0].lb_endpoints[0].endpoint.address.socket_address.port_value: uint32,  near  │
│  1:4831 (offset 4830): non-number characters  in quoted  number): ....

If I try to change the "value" to a number:

components:
  frontend-proxy:
    env:
      - name: ENVOY_PORT
        value: 80

Then I get the following helm install error:

$ helm install --create-namespace -n otel-demo       otel-demo open-telemetry/opentelemetry-demo     --set opentelemetry-collector.enabled="false"     --values otel-demo-values.yaml
Error: INSTALLATION FAILED: values don't meet the specifications of the schema(s) in the following chart(s):
opentelemetry-demo:
- components.frontend-proxy.env.0.value: Invalid type. Expected: string, given: integer