awesome-list.md

title	description	permalink
Awesome Delta Lake & Apache Iceberg Resources	Curated list of high-quality learning materials and tools for Delta Lake and Apache Iceberg practitioners.	/docs/awesome-list/

Awesome Delta Lake & Apache Iceberg Resources

A curated list of articles, blog posts, videos, and resources about Delta Lake and Apache Iceberg, automatically maintained by our community and AI-powered aggregator.

🌟 Featured Resources

Official Documentation

• Delta Lake Official Docs - Comprehensive Delta Lake documentation
• Apache Iceberg Official Docs - Complete Iceberg documentation
• Delta Lake GitHub - Delta Lake source code
• Apache Iceberg GitHub - Iceberg source code

Specifications

• Delta Transaction Log Protocol - Delta's ACID transaction protocol
• Iceberg Table Spec - Apache Iceberg's table format specification

Recent Articles

This section is automatically updated by our resource aggregator bot. New articles are added weekly and reviewed by the community.

Introducing Delta Lake 3.0

Discovered: 2024-01-01

Delta Lake 3.0 brings significant improvements including better performance, enhanced schema evolution capabilities, and improved compatibility with Apache Spark 3.5.

---

Apache Iceberg: The Definitive Guide

Discovered: 2024-01-01

Comprehensive guide covering Iceberg architecture, design decisions, and best practices for production deployments.

---

📚 Learning Resources

Tutorials

• [Delta Lake Quickstart]({{ '/docs/tutorials/getting-started/' | relative_url }}) - Get started with Delta Lake
• [Iceberg Quickstart]({{ '/docs/tutorials/getting-started/' | relative_url }}) - Get started with Apache Iceberg
• [Migration Guide: Parquet to Delta/Iceberg]({{ '/docs/tutorials/migration-guide/' | relative_url }}) - Convert existing data lakes

Video Content

• Databricks YouTube Channel - Delta Lake videos and webinars
• Apache Iceberg Talks - Conference presentations

Books

• "Delta Lake: The Definitive Guide" by Denny Lee and Tristen Wentling
• "Building the Data Lakehouse" by Bill Inmon, et al.

🛠️ Tools and Libraries

Delta Lake Ecosystem

• delta-rs - Native Rust implementation
• kafka-delta-ingest - Stream from Kafka to Delta
• delta-sharing - Open protocol for data sharing

Iceberg Ecosystem

• PyIceberg - Python library for Iceberg
• Iceberg Go - Go implementation
• Nessie - Git-like version control for data lakes

Query Engines

• Apache Spark - Both Delta and Iceberg
• Trino - Both Delta and Iceberg
• Apache Flink - Excellent Iceberg support
• Dremio - Iceberg-native query engine
• Athena - AWS-managed, supports both

AI-Powered Research Tools

• Google NotebookLM - AI-powered research assistant for analyzing documents, PDFs, and notes
  • Community Notebook: Delta Lake & Iceberg Research Collection - A curated collection of research materials about Delta Lake and Apache Iceberg (Note: Access may require permission from the notebook owner)
  • Note: NotebookLM notebooks are private by default. To access shared content, the notebook owner must grant access or export summaries/insights
  • Access Methods:
    • Request access from the notebook owner
    • For enterprise users: NotebookLM Enterprise API provides programmatic access
    • Manual export: Notebook owners can share generated summaries, study guides, or audio overviews
  • Use Cases: Synthesizing research papers, creating study guides, generating insights from Delta Lake and Iceberg documentation

🏢 Case Studies

Delta Lake

• Netflix: Processing petabytes of data with Delta Lake
• Comcast: Real-time streaming analytics
• Adobe: Marketing analytics at scale
• Riot Games: Gaming analytics and ML pipelines

Apache Iceberg

• Netflix: Original creator, uses Iceberg for data warehousing
• Apple: Large-scale data processing
• LinkedIn: Data platform modernization
• Expedia: Travel data analytics

📊 Comparisons and Benchmarks

• Feature Comparison Matrix - Side-by-side comparison
• TPC-DS Benchmarks - Performance benchmarks
• Onehouse Benchmark - Multi-format comparison

🎓 Courses and Training

Free Courses

• Databricks Academy - Free Delta Lake courses
• Apache Iceberg Tutorials - Official tutorials

Paid Courses

• Udemy: Delta Lake Deep Dive
• Coursera: Data Engineering with Databricks

🔧 Integration Guides

Cloud Platforms

• Delta Lake on AWS
• Delta Lake on Azure
• Delta Lake on GCP
• Iceberg on AWS
• Iceberg on Azure
• Iceberg on GCP

BI Tools

• Tableau with Delta Lake
• Power BI with Delta Lake
• Looker with Iceberg

🎤 Community

Slack Channels

• Delta Lake Slack
• Apache Iceberg Slack

Mailing Lists

• Delta Lake Mailing List
• Iceberg Dev List

Meetups and Conferences

• Data + AI Summit - Annual Databricks conference
• ApacheCon - Apache Software Foundation conference
• Local Data Engineering Meetups

🔬 Research Papers

• Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores
• Apache Iceberg: Unlocking the Power of Open Standards

🤝 Contributing

This awesome list is community-maintained. To add a resource:

1. Check if it's already listed
2. Ensure it's relevant and high-quality
3. Submit a PR with your addition
4. Include a brief description

Our AI-powered aggregator also discovers new content weekly and creates PRs for review.

See our Contributing Guide for details.

📜 License

This awesome list is part of the Delta Lake & Apache Iceberg Knowledge Hub, licensed under Apache 2.0.

---

Last Updated: 2025-11-14
Maintained By: Community + AI Aggregator 🤖