You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
description: Overview of Delta Lakeand how it works as part of Azure Synapse Analytics
3
+
description: Overview of Delta Lake's key features and how it brings atomicity, consistency, isolation, and durability to Azure Synapse Analytics.
4
4
author: jovanpop-msft
5
5
ms.author: jovanpop
6
6
ms.service: azure-synapse-analytics
7
-
ms.topic: conceptual
7
+
ms.topic: concept-article
8
8
ms.subservice: spark
9
-
ms.date: 12/06/2022
9
+
ms.date: 11/15/2024
10
10
ms.reviewer: euang
11
11
---
12
12
@@ -16,15 +16,13 @@ Delta Lake is an open-source storage layer that brings ACID (atomicity, consiste
16
16
17
17
The current version of Delta Lake included with Azure Synapse has language support for Scala, PySpark, and .NET and is compatible with Linux Foundation Delta Lake. There are links at the bottom of the page to more detailed examples and documentation. You can learn more from the [Introduction to Delta Tables video](https://www.youtube.com/watch?v=B_wyRXlLKok).
18
18
19
-
## Key features
20
-
21
19
| Feature | Description |
22
20
| --- | --- |
23
21
|**ACID Transactions**| Data lakes are typically populated through multiple processes and pipelines, some of which are writing data concurrently with reads. Prior to Delta Lake and the addition of transactions, data engineers had to go through a manual error prone process to ensure data integrity. Delta Lake brings familiar ACID transactions to data lakes. It provides serializability, the strongest level of isolation level. Learn more at [Diving into Delta Lake: Unpacking the Transaction Log](https://databricks.com/blog/2019/08/21/diving-into-delta-lake-unpacking-the-transaction-log.html).|
24
22
|**Scalable Metadata Handling**| In big data, even the metadata itself can be "big data." Delta Lake treats metadata just like data, leveraging Spark's distributed processing power to handle all its metadata. As a result, Delta Lake can handle petabyte-scale tables with billions of partitions and files at ease. |
25
23
|**Time Travel (data versioning)**| The ability to "undo" a change or go back to a previous version is one of the key features of transactions. Delta Lake provides snapshots of data enabling you to revert to earlier versions of data for audits, rollbacks or to reproduce experiments. Learn more in [Introducing Delta Lake Time Travel for Large Scale Data Lakes](https://databricks.com/blog/2019/02/04/introducing-delta-time-travel-for-large-scale-data-lakes.html). |
26
24
|**Open Format**| Apache Parquet is the baseline format for Delta Lake, enabling you to leverage the efficient compression and encoding schemes that are native to the format. |
27
-
|**Unified Batch and Streaming Source and Sink**| A table in Delta Lake is both a batch table, as well as a streaming source and sink. Streaming data ingest, batch historic backfill, and interactive queries all just work out of the box. |
25
+
|**Unified Batch and Streaming Source and Sink**| A table in Delta Lake is both a batch table, and a streaming source and sink. Streaming data ingest, batch historic backfill, and interactive queries all just work out of the box. |
28
26
|**Schema Enforcement**| Schema enforcement helps ensure that the data types are correct and required columns are present, preventing bad data from causing data inconsistency. For more information, see [Diving Into Delta Lake: Schema Enforcement & Evolution](https://databricks.com/blog/2019/09/24/diving-into-delta-lake-schema-enforcement-evolution.html)|
29
27
|**Schema Evolution**| Delta Lake enables you to make changes to a table schema that can be applied automatically, without having to write migration DDL. For more information, see [Diving Into Delta Lake: Schema Enforcement & Evolution](https://databricks.com/blog/2019/09/24/diving-into-delta-lake-schema-enforcement-evolution.html)|
30
28
|**Audit History**| Delta Lake transaction log records details about every change made to data providing a full audit trail of the changes. |
@@ -35,7 +33,7 @@ For full documentation, see the [Delta Lake Documentation Page](https://docs.del
35
33
36
34
For more information, see [Delta Lake Project](https://github.com/delta-io/delta).
37
35
38
-
## Next steps
36
+
## Related content
39
37
40
38
-[.NET for Apache Spark documentation](/previous-versions/dotnet/spark/what-is-apache-spark-dotnet)
0 commit comments