SDP Release 24.7

[lfrancke]

Stackable Data Platform (SDP) Release 24.7 is now publicly available!

Highlights

This release continued the security theme from the last release but also includes some other goodies:

• Vulnerability management: We've significantly reduced vulnerabilities (by 75%) in product binaries by building all Java-based ones from source. This allows for better patching and flexibility.
• Build products from source: All Java-based binaries are now built from source. Python-based ones (Apache Airflow, Apache Superset) still use product binaries.
• Upgraded base images from UBI8 to UBI9
• Multi-platform images: The release supports AMD64 and ARM64 architectures. Status is currently experimental as we fine-tune the workflows.
• OIDC support added to Apache Druid.
  • SDP now provides OIDC-support for Druid, Superset, and Trino.
• Experimental HBase 2.6.0 support with a new policy-based authorizer (OPA).

Documentation updates:

• Hive and Trino operators: sample Rego rules provided together explanatory comments.
• Hive tutorial on loading external database drivers.
• Spark documentation shows how to provision Spark dependencies.

Other product features:

• Apache Airflow: modularized DAGs.
• Apache Druid: additional extensions support.
• HBase: exporting snapshots to S3.
• Listener operator: external traffic policy configuration.
• NiFi: TLS certificate SecretClass specification.
• Open Policy Agent: decision logs support.
• Trino: row filters and column masks in Rego rules.

Bugfixes:

• Druid, Hive, Kafka, and Spark fixes.
• Secret operator fix for OpenShift clusters.

Find more details in the release notes or our announcement blog post