roadmap.md

Roadmap

The list below contains the functionality that contributors are planning to develop for Feast.

• We welcome contribution to all items in the roadmap!

• Data Sources

  • Snowflake source
  • Redshift source
  • BigQuery source
  • Parquet file source
  • Azure Synapse + Azure SQL source (contrib plugin)
  • Hive (community plugin)
  • Postgres (contrib plugin)
  • Spark (contrib plugin)
  • Kafka / Kinesis sources (via push support into the online store)

• Offline Stores

  • Snowflake
  • Redshift
  • BigQuery
  • Azure Synapse + Azure SQL (contrib plugin)
  • Hive (community plugin)
  • Postgres (contrib plugin)
  • Trino (contrib plugin)
  • Spark (contrib plugin)
  • In-memory / Pandas
  • Custom offline store support

• Online Stores

  • Snowflake
  • DynamoDB
  • Redis
  • Datastore
  • Bigtable
  • SQLite
  • Dragonfly
  • IKV - Inlined Key Value Store
  • Azure Cache for Redis (community plugin)
  • Postgres (contrib plugin)
  • Cassandra / AstraDB (contrib plugin)
  • ScyllaDB (contrib plugin)
  • Custom online store support

• Feature Engineering

  • On-demand Transformations (Beta release. See RFC)
  • Streaming Transformations (Alpha release. See RFC)
  • Batch transformation (In progress. See RFC)
  • Persistent On-demand Transformations (Beta release. See GitHub Issue)

• Streaming

  • Custom streaming ingestion job support
  • Push based streaming data ingestion to online store
  • Push based streaming data ingestion to offline store

• Deployments

  • AWS Lambda (Alpha release. See RFC)
  • Kubernetes (See guide)

• Feature Serving

  • Python Client
  • Python feature server
  • Java feature server (alpha)
  • Go feature server (alpha)

• Data Quality Management (See RFC)

  • Data profiling and validation (Great Expectations)

• Feature Discovery and Governance

  • Python SDK for browsing feature registry
  • CLI for browsing feature registry
  • Model-centric feature tracking (feature services)
  • Amundsen integration (see Feast extractor)
  • DataHub integration (see DataHub Feast docs)
  • Feast Web UI (Beta release. See docs)
  • Feast Lineage Explorer

• Natural Language Processing

  • Vector Search (Alpha release. See RFC)