Skip to content

Commit 9ed4698

Browse files
authored
pull base content,head:MicrosoftDocs:main,into:wwlpublishsync
2 parents fdb7454 + 744cbe1 commit 9ed4698

File tree

50 files changed

+1223
-1120
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

50 files changed

+1223
-1120
lines changed
Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.introduction
3-
title: Introduction
4-
metadata:
5-
title: Introduction
6-
description: "Introduction"
7-
ms.date: 07/23/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
durationInMinutes: 1
12-
content: |
13-
[!include[](includes/1-introduction.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.introduction
3+
title: Introduction
4+
metadata:
5+
title: Introduction
6+
description: "Introduction"
7+
ms.date: 07/23/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
durationInMinutes: 1
12+
content: |
13+
[!include[](includes/1-introduction.md)]
Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.explore-delta-live-tables
3-
title: Explore Delta Live Tables
4-
metadata:
5-
title: Explore Delta Live Tables
6-
description: "Explore Delta Live Tables"
7-
ms.date: 07/23/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
durationInMinutes: 5
12-
content: |
13-
[!include[](includes/2-explore-delta-live-tables.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.explore-delta-live-tables
3+
title: Explore Delta Live Tables
4+
metadata:
5+
title: Explore Delta Live Tables
6+
description: "Explore Delta Live Tables"
7+
ms.date: 07/23/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
durationInMinutes: 5
12+
content: |
13+
[!include[](includes/2-explore-delta-live-tables.md)]
Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.data-ingestion-and-integration
3-
title: Data ingestion and integration
4-
metadata:
5-
title: Data ingestion and integration
6-
description: "Data ingestion and integration"
7-
ms.date: 07/23/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
durationInMinutes: 7
12-
content: |
13-
[!include[](includes/3-data-ingestion-and-integration.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.data-ingestion-and-integration
3+
title: Data ingestion and integration
4+
metadata:
5+
title: Data ingestion and integration
6+
description: "Data ingestion and integration"
7+
ms.date: 07/23/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
durationInMinutes: 7
12+
content: |
13+
[!include[](includes/3-data-ingestion-and-integration.md)]
Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.build-data-pipelines-with-delta-live-tables.real-time-processing
3-
title: Real-time processing
4-
metadata:
5-
title: Real-time processing
6-
description: "Real-time processing"
7-
ms.date: 07/23/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
durationInMinutes: 5
12-
content: |
13-
[!include[](includes/4-real-time-processing.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.build-data-pipelines-with-delta-live-tables.real-time-processing
3+
title: Real-time processing
4+
metadata:
5+
title: Real-time processing
6+
description: "Real-time processing"
7+
ms.date: 07/23/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
durationInMinutes: 5
12+
content: |
13+
[!include[](includes/4-real-time-processing.md)]
Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.exercise-data-pipeline
3-
title: Exercise - Create a data pipeline with Delta Live Tables
4-
metadata:
5-
title: Exercise - Create a data pipeline with Delta Live Tables
6-
description: "Exercise - Create a data pipeline with Delta Live Tables"
7-
ms.date: 07/23/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
durationInMinutes: 60
12-
content: |
13-
[!include[](includes/5-exercise-data-pipeline.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.exercise-data-pipeline
3+
title: Exercise - Create a data pipeline with Delta Live Tables
4+
metadata:
5+
title: Exercise - Create a data pipeline with Delta Live Tables
6+
description: "Exercise - Create a data pipeline with Delta Live Tables"
7+
ms.date: 07/23/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
durationInMinutes: 60
12+
content: |
13+
[!include[](includes/5-exercise-data-pipeline.md)]
Lines changed: 48 additions & 48 deletions
Original file line numberDiff line numberDiff line change
@@ -1,48 +1,48 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.knowledge-check
3-
title: Module assessment
4-
metadata:
5-
title: Module assessment
6-
description: "Knowledge check"
7-
ms.date: 07/23/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 3
14-
quiz:
15-
questions:
16-
- content: "What is the primary benefit of using Delta Live Tables (DLT) in Azure Databricks for real-time data processing?"
17-
choices:
18-
- content: "Reducing the cost of storage"
19-
isCorrect: false
20-
explanation: "Incorrect. Reducing the cost of storage isn't the primary benefit of using DLT in Azure Databricks for real-time processing."
21-
- content: "Automating data pipeline management"
22-
isCorrect: true
23-
explanation: "Correct. Delta Live Tables is a framework that simplifies the management of data pipelines by automating complex tasks such as error handling, monitoring, and data pipeline lineage. This automation is valuable in real-time data processing, where managing data flows efficiently and reliably is critical."
24-
- content: "Increasing the latency of data processing."
25-
isCorrect: false
26-
explanation: "Incorrect. Increasing the latency of data processing isn't the primary benefit of using DLT in Azure Databricks for real-time processing."
27-
- content: "Which feature of Delta Live Tables ensures data reliability and quality in real-time processing environments?"
28-
choices:
29-
- content: "Live data"
30-
isCorrect: false
31-
explanation: "Incorrect. You can receive live data with real-time data processing with Delta Live tables but this feature doesn't ensure data reliability and quality."
32-
- content: "ACID Transactions"
33-
isCorrect: true
34-
explanation: "Correct. Delta Live Tables support ACID transactions, which are crucial for ensuring data integrity by making all operations atomic, consistent, isolated, and durable. This is important in real-time processing environments where concurrent data modifications can lead to inconsistencies without proper transaction controls."
35-
- content: "Data Lake"
36-
isCorrect: false
37-
explanation: "Incorrect. A Data Lake is a centralized repository that houses vast volumes of structured and unstructured data from various sources but it doesn't ensure data reliability and quality."
38-
- content: "Which component of Azure Databricks enhances performance and scalability of data operations on Delta Lake?"
39-
choices:
40-
- content: "Azure Blob Storage"
41-
isCorrect: false
42-
explanation: "Incorrect. Azure Blob Storage is Microsoft's object storage solution for the cloud and isn't used to enhance performance and scalability of data operations on Delta Lake."
43-
- content: "Azure Synapse Analytics"
44-
isCorrect: false
45-
explanation: "Incorrect. Azure Synapse Analytics is an enterprise analytics service that accelerates time to insight across data warehouses and big data systems. It isn't used to enhance performance and scalability of data operations on Delta Lake."
46-
- content: "Delta Engine"
47-
isCorrect: true
48-
explanation: "Correct. Delta Engine significantly enhances the performance and scalability of operations on Delta Lake in Azure Databricks. It optimizes the execution of queries by utilizing a high-performance, in-memory execution environment, which is crucial for processing large datasets efficiently."
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.knowledge-check
3+
title: Module assessment
4+
metadata:
5+
title: Module assessment
6+
description: "Knowledge check"
7+
ms.date: 07/23/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 3
14+
quiz:
15+
questions:
16+
- content: "What is the primary benefit of using Delta Live Tables (DLT) in Azure Databricks for real-time data processing?"
17+
choices:
18+
- content: "Reducing the cost of storage"
19+
isCorrect: false
20+
explanation: "Incorrect. Reducing the cost of storage isn't the primary benefit of using DLT in Azure Databricks for real-time processing."
21+
- content: "Automating data pipeline management"
22+
isCorrect: true
23+
explanation: "Correct. Delta Live Tables is a framework that simplifies the management of data pipelines by automating complex tasks such as error handling, monitoring, and data pipeline lineage. This automation is valuable in real-time data processing, where managing data flows efficiently and reliably is critical."
24+
- content: "Increasing the latency of data processing."
25+
isCorrect: false
26+
explanation: "Incorrect. Increasing the latency of data processing isn't the primary benefit of using DLT in Azure Databricks for real-time processing."
27+
- content: "Which feature of Delta Live Tables ensures data reliability and quality in real-time processing environments?"
28+
choices:
29+
- content: "Live data"
30+
isCorrect: false
31+
explanation: "Incorrect. You can receive live data with real-time data processing with Delta Live tables but this feature doesn't ensure data reliability and quality."
32+
- content: "ACID Transactions"
33+
isCorrect: true
34+
explanation: "Correct. Delta Live Tables support ACID transactions, which are crucial for ensuring data integrity by making all operations atomic, consistent, isolated, and durable. This is important in real-time processing environments where concurrent data modifications can lead to inconsistencies without proper transaction controls."
35+
- content: "Data Lake"
36+
isCorrect: false
37+
explanation: "Incorrect. A Data Lake is a centralized repository that houses vast volumes of structured and unstructured data from various sources but it doesn't ensure data reliability and quality."
38+
- content: "Which component of Azure Databricks enhances performance and scalability of data operations on Delta Lake?"
39+
choices:
40+
- content: "Azure Blob Storage"
41+
isCorrect: false
42+
explanation: "Incorrect. Azure Blob Storage is Microsoft's object storage solution for the cloud and isn't used to enhance performance and scalability of data operations on Delta Lake."
43+
- content: "Azure Synapse Analytics"
44+
isCorrect: false
45+
explanation: "Incorrect. Azure Synapse Analytics is an enterprise analytics service that accelerates time to insight across data warehouses and big data systems. It isn't used to enhance performance and scalability of data operations on Delta Lake."
46+
- content: "Delta Engine"
47+
isCorrect: true
48+
explanation: "Correct. Delta Engine significantly enhances the performance and scalability of operations on Delta Lake in Azure Databricks. It optimizes the execution of queries by utilizing a high-performance, in-memory execution environment, which is crucial for processing large datasets efficiently."
Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.summary
3-
title: Summary
4-
metadata:
5-
title: Summary
6-
description: "Summary"
7-
ms.date: 07/23/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
durationInMinutes: 3
12-
content: |
13-
[!include[](includes/7-summary.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.summary
3+
title: Summary
4+
metadata:
5+
title: Summary
6+
description: "Summary"
7+
ms.date: 07/23/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
durationInMinutes: 3
12+
content: |
13+
[!include[](includes/7-summary.md)]
Lines changed: 38 additions & 38 deletions
Original file line numberDiff line numberDiff line change
@@ -1,38 +1,38 @@
1-
### YamlMime:Module
2-
uid: learn.wwl.build-data-pipeline-with-delta-live-tables
3-
metadata:
4-
title: "Build data pipelines with Delta Live Tables"
5-
description: "Learn how to build data pipelines with Delta Live Tables in Azure Databricks"
6-
ms.date: "07/23/2024"
7-
author: wwlpublish
8-
ms.author: theresai
9-
ms.topic: module-standard-task-based
10-
ms.service: azure-databricks
11-
title: Build data pipelines with Delta Live Tables
12-
summary: "Building data pipelines with Delta Live Tables enables real-time, scalable, and reliable data processing using Delta Lake's advanced features in Azure Databricks"
13-
abstract: |
14-
In this module, you'll learn how to:
15-
- Describe Delta Live Tables
16-
- Ingest data into Delta Live Tables
17-
- Use Data Pipelines for real time data processing
18-
prerequisites: |
19-
Before starting this module, you should be familiar the concept of a data pipeline.
20-
iconUrl: /training/achievements/generic-badge.svg
21-
levels:
22-
- intermediate
23-
roles:
24-
- data-analyst
25-
products:
26-
- azure-databricks
27-
subjects:
28-
- data-management
29-
units:
30-
- learn.wwl.build-data-pipeline-with-delta-live-tables.introduction
31-
- learn.wwl.build-data-pipeline-with-delta-live-tables.explore-delta-live-tables
32-
- learn.wwl.build-data-pipeline-with-delta-live-tables.data-ingestion-and-integration
33-
- learn.wwl.build-data-pipelines-with-delta-live-tables.real-time-processing
34-
- learn.wwl.build-data-pipeline-with-delta-live-tables.exercise-data-pipeline
35-
- learn.wwl.build-data-pipeline-with-delta-live-tables.knowledge-check
36-
- learn.wwl.build-data-pipeline-with-delta-live-tables.summary
37-
badge:
38-
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.badge
1+
### YamlMime:Module
2+
uid: learn.wwl.build-data-pipeline-with-delta-live-tables
3+
metadata:
4+
title: "Build data pipelines with Delta Live Tables"
5+
description: "Learn how to build data pipelines with Delta Live Tables in Azure Databricks"
6+
ms.date: "07/23/2024"
7+
author: wwlpublish
8+
ms.author: jamesh
9+
ms.topic: module-standard-task-based
10+
ms.service: azure-databricks
11+
title: Build data pipelines with Delta Live Tables
12+
summary: "Building data pipelines with Delta Live Tables enables real-time, scalable, and reliable data processing using Delta Lake's advanced features in Azure Databricks"
13+
abstract: |
14+
In this module, you'll learn how to:
15+
- Describe Delta Live Tables
16+
- Ingest data into Delta Live Tables
17+
- Use Data Pipelines for real time data processing
18+
prerequisites: |
19+
Before starting this module, you should be familiar the concept of a data pipeline.
20+
iconUrl: /training/achievements/generic-badge.svg
21+
levels:
22+
- intermediate
23+
roles:
24+
- data-analyst
25+
products:
26+
- azure-databricks
27+
subjects:
28+
- data-management
29+
units:
30+
- learn.wwl.build-data-pipeline-with-delta-live-tables.introduction
31+
- learn.wwl.build-data-pipeline-with-delta-live-tables.explore-delta-live-tables
32+
- learn.wwl.build-data-pipeline-with-delta-live-tables.data-ingestion-and-integration
33+
- learn.wwl.build-data-pipelines-with-delta-live-tables.real-time-processing
34+
- learn.wwl.build-data-pipeline-with-delta-live-tables.exercise-data-pipeline
35+
- learn.wwl.build-data-pipeline-with-delta-live-tables.knowledge-check
36+
- learn.wwl.build-data-pipeline-with-delta-live-tables.summary
37+
badge:
38+
uid: learn.wwl.build-data-pipeline-with-delta-live-tables.badge
Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.deploy-workloads-with-databricks-workflows.introduction
3-
title: Introduction
4-
metadata:
5-
title: Introduction
6-
description: "Introduction"
7-
ms.date: 07/29/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
durationInMinutes: 1
12-
content: |
13-
[!include[](includes/1-introduction.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.deploy-workloads-with-databricks-workflows.introduction
3+
title: Introduction
4+
metadata:
5+
title: Introduction
6+
description: "Introduction"
7+
ms.date: 07/29/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
durationInMinutes: 1
12+
content: |
13+
[!include[](includes/1-introduction.md)]
Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.deploy-workloads-with-databricks-workflows.what-are-azure-databricks-workflows
3-
title: What are Azure Databricks Workflows?
4-
metadata:
5-
title: What are Azure Databricks Workflows?
6-
description: "What are Azure Databricks Workflows?"
7-
ms.date: 07/29/2024
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
durationInMinutes: 5
12-
content: |
13-
[!include[](includes/2-what-are-azure-databricks-workflows.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.deploy-workloads-with-databricks-workflows.what-are-azure-databricks-workflows
3+
title: What are Azure Databricks Workflows?
4+
metadata:
5+
title: What are Azure Databricks Workflows?
6+
description: "What are Azure Databricks Workflows?"
7+
ms.date: 07/29/2024
8+
author: wwlpublish
9+
ms.author: jamesh
10+
ms.topic: unit
11+
durationInMinutes: 5
12+
content: |
13+
[!include[](includes/2-what-are-azure-databricks-workflows.md)]

0 commit comments

Comments
 (0)