Skip to content

Factor House Local v2.3

Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 05 Jan 23:29
· 3 commits to main since this release
v2.3
9ae3380
This commit was signed with the committer’s verified signature.
jaehyeon-kim Jaehyeon Kim
SSH Key Fingerprint: HRbDQaJZ825JFGLEjmmbQ5XFHFj9Jgk13dHdzh8D/lY
Verified
Learn about vigilant mode.

Factor House Local v2.3: Unlocking Data Governance and Next-Generation Analytics

We are thrilled to announce the release of Factor House Local v2.3, a major update that unlocks powerful new capabilities in data governance and real-time analytics. This release introduces a brand new Data Governance stack with OpenMetadata, massively expands our real-time analytical stores with ClickHouse and StarRocks, and modernizes the foundational Kafka stack to run in KRaft mode.

This version empowers you to build, manage, and govern your entire data ecosystem with an unprecedented level of modularity and power.

Factor House Local

Release Highlights

🧭 Introducing Data Discovery & Governance with OpenMetadata

A completely new stack featuring OpenMetadata is now available. Move beyond just processing data to truly understanding and managing it. This provides a single source of truth for all your data assets, enabling powerful data discovery, end-to-end lineage, data quality monitoring, and a collaborative business glossary.

✨ Expanded Real-Time Data Stores: Pinot, ClickHouse & StarRocks

The analytical store stack is no longer just for Pinot. It now offers a choice of three leading OLAP engines, launched via Docker profiles. You can now select the right high-performance database for your specific use case, whether it's user-facing analytics, interactive BI, or modern data warehousing.

⚡ Modernized Kafka Stack with KRaft Mode

The foundational Kafka & Kpow stack has been upgraded to use Confluent Platform 8.1.1 and now runs in KRaft mode. This removes the dependency on ZooKeeper, resulting in a simpler, more efficient, and easier-to-manage event streaming backbone for all your projects.

🔧 Enhanced Capabilities & Modularity

  • Real-Time Enrichment: The Flink & Flex stack now includes Redis, enabling new, high-performance use cases for stream enrichment and low-latency lookups.
  • Flexible Observability: The Observability stack is now split into lineage (Marquez) and telemetry (Prometheus) profiles, allowing you to launch only the components you need.

Core Environments

This release includes the following powerful, modular stacks:

  • Kafka Development & Monitoring with Kpow: A robust, 3-node Kafka environment in KRaft mode, and Kpow for enterprise-grade observability and management.
  • Unified Analytics Platform with Flex & Flink: A comprehensive data processing platform designed to handle both operational and analytical workloads, integrating Flink, Spark, an Iceberg lakehouse, PostgreSQL, and Redis, with enterprise-grade Flink management provided by Flex.
  • Real-time Data Stores: A choice of high-performance OLAP engines, including Pinot, ClickHouse, and StarRocks.
  • Observability & Data Lineage: A modular suite featuring OpenLineage via Marquez (lineage) and the Prometheus stack (telemetry).
  • NEW! Data Discovery & Governance: A complete data catalog and governance platform powered by OpenMetadata.
Assets 2
Loading