|
2 | 2 | title: "DLT-META" |
3 | 3 | date: 2021-08-04T14:50:11-04:00 |
4 | 4 | draft: false |
| 5 | + |
5 | 6 | --- |
6 | 7 |
|
7 | 8 |
|
@@ -42,13 +43,14 @@ In practice, a single generic DLT pipeline reads the Dataflowspec and uses it to |
42 | 43 | ## DLT-META DLT Features support |
43 | 44 | | Features | DLT-META Support | |
44 | 45 | | ------------- | ------------- | |
45 | | -| Input data sources | Autoloader, Delta, Eventhub, Kafka | |
| 46 | +| Input data sources | Autoloader, Delta, Eventhub, Kafka, snapshot | |
46 | 47 | | Medallion architecture layers | Bronze, Silver | |
47 | 48 | | Custom transformations | Bronze, Silver layer accepts custom functions| |
48 | 49 | | Data Quality Expecations Support | Bronze, Silver layer | |
49 | 50 | | Quarantine table support | Bronze layer | |
50 | 51 | | [apply_changes](https://docs.databricks.com/en/delta-live-tables/python-ref.html#cdc) API support | Bronze, Silver layer | |
51 | 52 | | [apply_changes_from_snapshot](https://docs.databricks.com/en/delta-live-tables/python-ref.html#change-data-capture-from-database-snapshots-with-python-in-delta-live-tables) API support | Bronze layer| |
| 53 | +| [append_flow](https://docs.databricks.com/en/delta-live-tables/flows.html#use-append-flow-to-write-to-a-streaming-table-from-multiple-source-streams) API support | Bronze layer| |
52 | 54 | | Liquid cluster support | Bronze, Bronze Quarantine, Silver tables| |
53 | 55 | | [DLT-META CLI](https://databrickslabs.github.io/dlt-meta/getting_started/dltmeta_cli/) | ```databricks labs dlt-meta onboard```, ```databricks labs dlt-meta deploy``` | |
54 | 56 | | Bronze and Silver pipeline chaining | Deploy dlt-meta pipeline with ```layer=bronze_silver``` option using Direct publishing mode | |
|
0 commit comments