ModuleNotFoundError: No module named 'opentelemetry'

[glupav]

Repo: https://github.com/glupav/aws-bootcamp-cruddur-2023

Week 2 — Distributed

1 Export some Environment Variables

export HONEYCOMB_API_KEY=""
export HONEYCOMB_SERVICE_NAME=""

gp env HONEYCOMB_API_KEY=""
gp env HONEYCOMB_SERVICE_NAME=""

2 Add Enviroment Variables

Into docker-compose.yml add following Enviroment Variables:

OTEL_SERVICE_NAME="${HONEYCOMB_SERVICE_NAME}"
OTEL_EXPORTER_OTLP_ENDPOINT: "https://api.honeycomb.io"
OTEL_EXPORTER_OTLP_HEADERS: "x-honeycomb-team=${HONEYCOMB_API_KEY}"

3 Install software

cd backend-flask

pip install opentelemetry-api \
    opentelemetry-sdk \
    opentelemetry-exporter-otlp-proto-http \
    opentelemetry-instrumentation-flask \
    opentelemetry-instrumentation-requests

4 Add some configuration

Change the content of requirements.txt add following, and execute install in backend-flask:

opentelemetry-api 
opentelemetry-sdk 
opentelemetry-exporter-otlp-proto-http 
opentelemetry-instrumentation-flask 
opentelemetry-instrumentation-requests

pip install -r requirements.txt

5 Import some libraries

Add following libraries into app.py file in backend-flask:

from opentelemetry import trace
from opentelemetry.instrumentation.flask import FlaskInstrumentor
from opentelemetry.instrumentation.requests import RequestsInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import BatchSpanProcessor

from opentelemetry.sdk.trace.export import ConsoleSpanProcessor
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

6 Initialize tracing and an exporter

Add following code into app.py file in backend-flask:

provider = TracerProvider()
processor = BatchSpanProcessor(OTLPSpanExporter())
provider.add_span_processor(processor)

simple_processor = SimpleSpanProcessor(ConsloleSpanExporter())
provider.add_span_processor(simple_processor)

trace.set_tracer_provider(provider)
tracer = trace.get_tracer(__name__)

7 Initialize automatic instrumentation with

Add following code into app.py file in backend-flask:

FlaskInstrumentor().instrument_app(app)
RequestsInstrumentor().instrument()

8 Change configuraiton file

Add to .gitpod.yml following configuration:

ports:
  - name: frontend
    port: 3000
    onOpen: open-browser
    visibility: public
  - name: backend
    port: 4567
    visibility: public
  - name: xray-daemon
    port: 2000
    visibility: public

@ Error-Debug:

Backend Logs Show in Terminal:

 *  Executing task: docker logs --tail 1000 -f 8e6bdeada6d9bb46deee7d77ee93dfa14af5b46400f0f7c2c5d65bf5753b37dd 

Usage: python -m flask run [OPTIONS]
Try 'python -m flask run --help' for help.

Error: While importing 'app', an ImportError was raised:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/flask/cli.py", line 218, in locate_app
    __import__(module_name)
  File "/backend-flask/app.py", line 18, in <module>
    from opentelemetry import trace
ModuleNotFoundError: No module named 'opentelemetry'

Usage: python -m flask run [OPTIONS]
Try 'python -m flask run --help' for help.

Error: While importing 'app', an ImportError was raised:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/flask/cli.py", line 218, in locate_app
    __import__(module_name)
  File "/backend-flask/app.py", line 18, in <module>
    from opentelemetry import trace
ModuleNotFoundError: No module named 'opentelemetry'

Usage: python -m flask run [OPTIONS]
Try 'python -m flask run --help' for help.

Error: While importing 'app', an ImportError was raised:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/flask/cli.py", line 218, in locate_app
    __import__(module_name)
  File "/backend-flask/app.py", line 18, in <module>
    from opentelemetry import trace
ModuleNotFoundError: No module named 'opentelemetry'

Usage: python -m flask run [OPTIONS]
Try 'python -m flask run --help' for help.

Error: While importing 'app', an ImportError was raised:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/flask/cli.py", line 218, in locate_app
    __import__(module_name)
  File "/backend-flask/app.py", line 18, in <module>
    from opentelemetry import trace
ModuleNotFoundError: No module named 'opentelemetry'

 *  Terminal will be reused by tasks, press any key to close it. 

Backend Docker Image Inspect shows:

{
    "Id": "sha256:704ebcd2e86fd7900366e5956440bf513f3eacde2c435d22ad89af30c6495965",
    "RepoTags": [
        "aws-bootcamp-cruddur-2023-backend-flask:latest"
    ],
    "RepoDigests": [],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2023-03-01T15:02:06.732171865Z",
    "Container": "",
    "ContainerConfig": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": null,
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": null
    },
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "LANG=C.UTF-8",
            "GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D",
            "PYTHON_VERSION=3.10.10",
            "PYTHON_PIP_VERSION=22.3.1",
            "PYTHON_SETUPTOOLS_VERSION=65.5.1",
            "PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/d5cb0afaf23b8520f1bbcfed521017b4a95f5c01/public/get-pip.py",
            "PYTHON_GET_PIP_SHA256=394be00f13fa1b9aaa47e911bdb59a09c3b2986472130f30aa0bfaf7f3980637",
            "FLASK_ENV=development"
        ],
        "Cmd": [
            "python3",
            "-m",
            "flask",
            "run",
            "--host=0.0.0.0",
            "--port=4567"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/backend-flask",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": {
            "com.docker.compose.project": "aws-bootcamp-cruddur-2023",
            "com.docker.compose.service": "backend-flask",
            "com.docker.compose.version": "2.16.0"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 129481460,
    "VirtualSize": 129481460,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/workspace/.docker-root/overlay2/30e9dzr6m92ntfx487d560nct/diff:/workspace/.docker-root/overlay2/sklr18xsnho5vhcgmy8pcf7z8/diff:/workspace/.docker-root/overlay2/rp2biu77lcyf5cimjtkr11ink/diff:/workspace/.docker-root/overlay2/b41009acd4eab8f9f6fd878449641801fba66b9890fb72d4977fe7f35b0e6951/diff:/workspace/.docker-root/overlay2/ae3cb5193546146c8fce6036fd68b469ddce30e207c93e9cbd99227a571fb245/diff:/workspace/.docker-root/overlay2/dc93b28d4fdff3862f412fde284ad505100b02d22373bbe69a72f3ba37c2ff0c/diff:/workspace/.docker-root/overlay2/1bbcb6941522f4d400d5d04f315afcc01ffa10c9d9b87a53c372837415c94bf0/diff:/workspace/.docker-root/overlay2/0d0f3ade0840ec48385b243dff9b9da3fcfad3af4ab39c56e43c3e4e5fead835/diff",
            "MergedDir": "/workspace/.docker-root/overlay2/s54i8v2ywqetdx0wgrh2y22rb/merged",
            "UpperDir": "/workspace/.docker-root/overlay2/s54i8v2ywqetdx0wgrh2y22rb/diff",
            "WorkDir": "/workspace/.docker-root/overlay2/s54i8v2ywqetdx0wgrh2y22rb/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:63b3cf45ece8eb76e566234ff33d702695c2e1336c291b8a7cd98ac51159c5b9",
            "sha256:8d60832b730a46632206fb390c7ec616a808a5833b7dfd47b487983d1f9cdec6",
            "sha256:5be8f6899d421c5a50a232bd993dd241614a2468cd3e1b78c5dcdba725087a09",
            "sha256:53b2529dfca969170569c8d4fd7b0efcd83ac6e463887fc8269a53f71ed04798",
            "sha256:4358fe544125b0ed0d02189ae0b1ff5a80df151a67756a7a607f618fc6ba7693",
            "sha256:32b37ebe5e4c2f601a0a174d4431a905b3a440f60fb948d4ff213d65d8d6afe3",
            "sha256:bfd55ade568b6a8a0bbc3ea915f1a1f90e0e9e91a8c14458588498d9f0735921",
            "sha256:fe5ae2ae897aa2241afd071f159657dfdfe191cb5b467a04aa9a34a0bfac0e22",
            "sha256:5392e5ffef4f864c61dee11994b6917854e81371372feb6bf17348c1db1522dc"
        ]
    },
    "Metadata": {
        "LastTagTime": "0001-01-01T00:00:00Z"
    }
}

Frontend Docker Image Inspect shows:

{
    "Id": "sha256:6810337e6ded684a15a7af6dd9ff52c36f494388dbaebbea7d0e41ce66930dfa",
    "RepoTags": [
        "aws-bootcamp-cruddur-2023-frontend-react-js:latest"
    ],
    "RepoDigests": [],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2023-03-01T15:02:09.556832639Z",
    "Container": "",
    "ContainerConfig": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": null,
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": null
    },
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "ExposedPorts": {
            "3000/tcp": {}
        },
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "NODE_VERSION=16.18.1",
            "YARN_VERSION=1.22.19",
            "PORT=3000"
        ],
        "Cmd": [
            "npm",
            "start"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/frontend-react-js",
        "Entrypoint": [
            "docker-entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "com.docker.compose.project": "aws-bootcamp-cruddur-2023",
            "com.docker.compose.service": "frontend-react-js",
            "com.docker.compose.version": "2.16.0"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 1151334802,
    "VirtualSize": 1151334802,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/workspace/.docker-root/overlay2/vht9vq1altit8qugns18yfy0e/diff:/workspace/.docker-root/overlay2/qctsh6ec66xd5c1n9w78cjmfa/diff:/workspace/.docker-root/overlay2/b1efa33f76107a82a43ffe7377db4b0e8f3b36ebe92dc01eaf7f107ec0090f29/diff:/workspace/.docker-root/overlay2/f90f737d16357dd05293706b1fb479343c4e3d106b852c3bf34d9550c5959fa0/diff:/workspace/.docker-root/overlay2/2e510294dce92e1b03673fa43f3bd2f337b9e56d82b54561903dda145e5d42cc/diff:/workspace/.docker-root/overlay2/58ad11ddb60f646438f81d33171f1392201eb8d28fb22dbdef6434fb7e1aa370/diff:/workspace/.docker-root/overlay2/f29dafd149922ead7d34cd78c2b2e729ded4d61fa212fa911319267cba8c3b37/diff:/workspace/.docker-root/overlay2/07e5b181740fbae989e138b5c9719a4362ea2073825e8e8f4c369807ce8c7e8e/diff:/workspace/.docker-root/overlay2/1d963c71417b8cae88185a93132ed14e0b1ac2e093098b041f8acdb35731fa11/diff:/workspace/.docker-root/overlay2/709de49fcc0d0d39d1de3ad7d1e13652a8efb126448c0b78928a0d0d42520355/diff:/workspace/.docker-root/overlay2/545fd7d29f1e1c715010fdf4f2bfaba89586eec9cab9366b509dce7f7d36fa92/diff",
            "MergedDir": "/workspace/.docker-root/overlay2/ur0ouvvmi9ecgg27epvqedmc2/merged",
            "UpperDir": "/workspace/.docker-root/overlay2/ur0ouvvmi9ecgg27epvqedmc2/diff",
            "WorkDir": "/workspace/.docker-root/overlay2/ur0ouvvmi9ecgg27epvqedmc2/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:3943af3b0cbde0bb8da4e4eb5e81efefe52669e9233eeff0ba820ac838121f65",
            "sha256:6a17543276127b69ca01d06023f3d06d9f20d001aae849593645227e04069248",
            "sha256:81fcd676802fa2ad407b8560d8fde1176c25e5b17b2e0804efb13347e8ae79b2",
            "sha256:753fac84fc56b761bf12bc3f0456e576eb13d000033e2097bf0a5ed95a42824f",
            "sha256:dec5d443c5c111e6375ac071471e0a309614d4c454603a08b6550c78cbced997",
            "sha256:86b22c61669bad45fefe7dfa32d9ab691c437f36de1c0e0d43f0277b63117084",
            "sha256:31880ac21a09a8d7e8c04b727db654ddc538a8865b3550193317ab5cf4cb6532",
            "sha256:60a3cb9a013a8517c45ffe60c15979e0c6bf9e5ae8cf001138b6eb9e25591ba0",
            "sha256:8dcc2270b2a43048ea06e417d3b1df63187b05515db34ce9928750b501028f44",
            "sha256:160af552bf68813f78023c42efa2e16f8799abc6d8a016900d511f9a0e73622e",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:8a1a6370a8f6ad88d288812c236c238a222cb2451ce03ef90df82cdde4456b55"
        ]
    },
    "Metadata": {
        "LastTagTime": "0001-01-01T00:00:00Z"
    }
}

[tim-finnigan]

Hi @glupav did you mean to create this discussion in the AWS CLI repository? I'm not sure I follow how this is related to the AWS CLI.

[glupav]

@tim-finnigan I didn't find GitHub a very intuitive place, until it started to change some of it UI/UX a little recently.

The Question is from the domain of integrating Open Telemetry to Python code.

Thank You for Your time.