Skip to content

fix: Test Airflow 3.x / API Workers with new release of uvicorn #689

@adwk67

Description

@adwk67

The newest release includes this commit that allows the timeout to be configurable: https://www.github.com/Kludex/uvicorn/commit/4098bcac97aa0fbda2f4e73278fbbe3b128be940

The release: https://www.github.com/Kludex/uvicorn/releases/tag/0.37.0

This can be tested with our Airflow images by adjusting the uvicorn version in the relevant contraints file.
This issue is part of #640 (already closed)

PRs:

Tip

Testing

The product image has been built and has been pushed to: oci.stackable.tech/sandbox/andrew/airflow:3.0.1-stackable0.0.0-dev
The operator can be tested with this image by updating test-definition.yaml:

---
dimensions:
 - name: airflow
   values:
     - 3.0.1,oci.stackable.tech/sandbox/andrew/airflow:3.0.1-stackable0.0.0-dev
 - name: airflow-latest
   values:
     - 3.0.1,oci.stackable.tech/sandbox/andrew/airflow:3.0.1-stackable0.0.0-dev
 ...

(this change is only relevant for Airflow 3.x+)

Test results Re-run single failed test having bumped resources:
--- PASS: kuttl (155.49s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/overrides_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false (153.88s)
PASS

First run:

--- FAIL: kuttl (3046.26s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke_airflow-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-celery (289.73s)
        --- PASS: kuttl/harness/mount-dags-gitsync_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-celery (406.76s)
        --- PASS: kuttl/harness/ldap_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_ldap-authentication-insecure-tls_openshift-false_executor-kubernetes (171.35s)
        --- PASS: kuttl/harness/resources_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false (133.12s)
        --- PASS: kuttl/harness/ldap_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_ldap-authentication-server-verification-tls_openshift-false_executor-kubernetes (149.81s)
        --- PASS: kuttl/harness/ldap_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_ldap-authentication-server-verification-tls_openshift-false_executor-celery (174.99s)
        --- PASS: kuttl/harness/ldap_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_ldap-authentication-no-tls_openshift-false_executor-kubernetes (147.98s)
        --- PASS: kuttl/harness/ldap_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_ldap-authentication-no-tls_openshift-false_executor-celery (172.37s)
        --- PASS: kuttl/harness/external-access_airflow-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-kubernetes (197.51s)
        --- PASS: kuttl/harness/opa_airflow-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_opa-latest-1.4.2_openshift-false (158.06s)
        --- PASS: kuttl/harness/mount-dags-configmap_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-kubernetes (136.88s)
        --- PASS: kuttl/harness/mount-dags-configmap_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-celery (165.94s)
        --- PASS: kuttl/harness/orphaned-resources_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false (148.16s)
        --- PASS: kuttl/harness/oidc_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false (145.70s)
        --- PASS: kuttl/harness/ldap_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_ldap-authentication-insecure-tls_openshift-false_executor-celery (171.55s)
        --- PASS: kuttl/harness/logging_airflow-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-celery (297.74s)
        --- FAIL: kuttl/harness/overrides_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false (701.73s)
        --- PASS: kuttl/harness/external-access_airflow-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-celery (192.94s)
        --- PASS: kuttl/harness/cluster-operation_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false (257.36s)
        --- PASS: kuttl/harness/triggerer_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-celery (189.73s)
        --- PASS: kuttl/harness/smoke_airflow-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-kubernetes (189.06s)
        --- PASS: kuttl/harness/logging_airflow-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-kubernetes (476.01s)
        --- PASS: kuttl/harness/triggerer_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-kubernetes (177.84s)
        --- PASS: kuttl/harness/remote-logging_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-celery (260.03s)
        --- PASS: kuttl/harness/remote-logging_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-kubernetes (224.37s)
        --- PASS: kuttl/harness/mount-dags-gitsync_airflow-latest-3.0.1,oci.stackable.tech_sandbox_andrew_airflow_3.0.1-stackable0.0.0-dev_openshift-false_executor-kubernetes (202.57s)
FAIL

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions