Struggling with Docker based OpenMetaData 1.4.1 airflow pipeline for data quality checks fails #16896
Unanswered
malcolm-smith-mck
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I opened a ticket with all the details but maybe someone has seen this issue - my repro steps are:
Create a profiler job and execute it -
notice that it fails immediately,
when debug logging is enabled notice the following stacktrace that ends with "InvalidPrivateKeyException" when it tries to use openssl to validate a key value - the value it uses in the airflow job is the same as the IngestionBot JWT token value and that value is a valid JWT token based on a online JWT token parser I checked it with. The authProvider is OpenMetaData in the config json for the airflow job.
Isssue https://github.com/open-metadata/OpenMetadata/issues/16877
Mainly I just would like to know if others have gotten the docker version of openmetadata + airflow components to work - I installed this out of the box and loaded the sample data - that also run 99% correct but ended with an error even through I see a lot of sample data and the system seems to work well overall in the OpenMetaData UI and also in the Airflow UI.
BTW - I installed by just downloading the docker compose and building that
curl -sL -o docker-compose-postgres.yml https://github.com/open-metadata/OpenMetadata/releases/download/1.4.1-release/docker-compose-postgres.yml
Thanks in advance.
Beta Was this translation helpful? Give feedback.
All reactions