Skip to content

Commit e0f9221

Browse files
committed
Updates to multi-stage-model
1 parent 9381f6f commit e0f9221

17 files changed

+297
-324
lines changed
Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.introduction
3-
title: Introduction
4-
metadata:
5-
title: Introduction
6-
description: "Introduction"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 2
14-
content: |
15-
[!include[](includes/01-introduction.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.introduction
3+
title: Introduction
4+
metadata:
5+
title: Introduction
6+
description: "Introduction"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 2
14+
content: |
15+
[!include[](includes/01-introduction.md)]
Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.multi-stage-reasoning-concepts
3-
title: What are multi-stage reasoning systems?
4-
metadata:
5-
title: What are multi-stage reasoning systems?
6-
description: "What are multi-stage reasoning systems?"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 5
14-
content: |
15-
[!include[](includes/02-multi-stage-reasoning-concepts.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.multi-stage-reasoning-concepts
3+
title: What are multi-stage reasoning systems?
4+
metadata:
5+
title: What are multi-stage reasoning systems?
6+
description: "What are multi-stage reasoning systems?"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 5
14+
content: |
15+
[!include[](includes/02-multi-stage-reasoning-concepts.md)]
Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.langchain
3-
title: Explore LangChain
4-
metadata:
5-
title: Explore LangChain
6-
description: "Explore LangChain"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 8
14-
content: |
15-
[!include[](includes/03-langchain.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.langchain
3+
title: Explore LangChain
4+
metadata:
5+
title: Explore LangChain
6+
description: "Explore LangChain"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 8
14+
content: |
15+
[!include[](includes/03-langchain.md)]
Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.llamaindex
3-
title: Explore LlamaIndex
4-
metadata:
5-
title: Explore LlamaIndex
6-
description: "Explore LlamaIndex"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 7
14-
content: |
15-
[!include[](includes/04-llamaindex.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.llamaindex
3+
title: Explore LlamaIndex
4+
metadata:
5+
title: Explore LlamaIndex
6+
description: "Explore LlamaIndex"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 7
14+
content: |
15+
[!include[](includes/04-llamaindex.md)]
Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.haystack
3-
title: Explore Haystack
4-
metadata:
5-
title: Explore Haystack
6-
description: "Explore Haystack"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 6
14-
content: |
15-
[!include[](includes/05-haystack.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.haystack
3+
title: Explore Haystack
4+
metadata:
5+
title: Explore Haystack
6+
description: "Explore Haystack"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 6
14+
content: |
15+
[!include[](includes/05-haystack.md)]
Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.dspy-framework
3-
title: Explore the DSPy framework
4-
metadata:
5-
title: Explore the DSPy framework
6-
description: "Explore the DSPy framework"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 6
14-
content: |
15-
[!include[](includes/06-dspy-framework.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.dspy-framework
3+
title: Explore the DSPy framework
4+
metadata:
5+
title: Explore the DSPy framework
6+
description: "Explore the DSPy framework"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 6
14+
content: |
15+
[!include[](includes/06-dspy-framework.md)]
Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.exercise
3-
title: Exercise - Implement multi-stage reasoning with LangChain
4-
metadata:
5-
title: Exercise - Implement multi-stage reasoning with LangChain
6-
description: "Exercise - Implement multi-stage reasoning with LangChain"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 30
14-
content: |
15-
[!include[](includes/07-exercise.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.exercise
3+
title: Exercise - Implement multi-stage reasoning with LangChain
4+
metadata:
5+
title: Exercise - Implement multi-stage reasoning with LangChain
6+
description: "Exercise - Implement multi-stage reasoning with LangChain"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 30
14+
content: |
15+
[!include[](includes/07-exercise.md)]
Lines changed: 50 additions & 50 deletions
Original file line numberDiff line numberDiff line change
@@ -1,50 +1,50 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.knowledge-check
3-
title: Module assessment
4-
metadata:
5-
title: Module assessment
6-
description: "Knowledge check"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
module_assessment: true
12-
azureSandbox: false
13-
labModal: false
14-
durationInMinutes: 3
15-
quiz:
16-
questions:
17-
- content: "What is a key advantage of using multi-stage reasoning in Large Language Models (LLMs)?"
18-
choices:
19-
- content: "It reduces the overall computational cost."
20-
isCorrect: false
21-
explanation: "Incorrect. Multi-stage reasoning doesn't reduce the overall computational cost."
22-
- content: "Dividing a complex problem into smaller and more manageable tasks."
23-
isCorrect: true
24-
explanation: "Correct. Multi-stage reasoning involves dividing a complex problem into smaller, more manageable tasks that the model can solve sequentially. This approach improves the model’s ability to handle intricate reasoning processes by addressing each subtask independently before combining the results to solve the overall problem."
25-
- content: "It eliminates the need for external data sources."
26-
isCorrect: false
27-
explanation: "Incorrect. Multi-stage reasoning doesn't eliminate the need for external data sources."
28-
- content: "Which framework is commonly used for managing multi-stage reasoning systems in LLMs?"
29-
choices:
30-
- content: "Tensorflow"
31-
isCorrect: false
32-
explanation: "Incorrect. TensorFlow is an open-source platform used for building and deploying deep learning models."
33-
- content: "PyTorch"
34-
isCorrect: false
35-
explanation: "Incorrect. PyTorch is an open-source deep learning framework used for developing and training machine learning models, with a focus on flexibility and dynamic computation graphs."
36-
- content: "LangChain"
37-
isCorrect: true
38-
explanation: "Correct. LangChain is a popular framework that helps build complex reasoning systems by linking different reasoning tasks together."
39-
- content: "In the context of multi-stage reasoning with LLMs, what is the primary role of a 'retriever' in a retriever-based chain?"
40-
choices:
41-
- content: "To generate new data based on the initial input."
42-
isCorrect: false
43-
explanation: "Incorrect. The 'retriever' isn't used to generate new data."
44-
- content: "To retrieve relevant information or documents that can be used in subsequent reasoning stages."
45-
isCorrect: true
46-
explanation: "Correct. In a retriever-based chain, the retriever is responsible for fetching relevant information or documents from a predefined dataset or knowledge base. This retrieved information is then passed on to subsequent stages in the reasoning process, where it can be used to generate a more informed and accurate response."
47-
- content: "To execute logical operations like AND, OR, and NOT."
48-
isCorrect: false
49-
explanation: "Incorrect. The 'retriever' isn't used to execute logical operations like AND, OR and NOT."
50-
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.knowledge-check
3+
title: Module assessment
4+
metadata:
5+
title: Module assessment
6+
description: "Knowledge check"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
module_assessment: true
12+
azureSandbox: false
13+
labModal: false
14+
durationInMinutes: 3
15+
quiz:
16+
questions:
17+
- content: "What is a key advantage of using multi-stage reasoning in Large Language Models (LLMs)?"
18+
choices:
19+
- content: "It reduces the overall computational cost."
20+
isCorrect: false
21+
explanation: "Incorrect. Multi-stage reasoning doesn't reduce the overall computational cost."
22+
- content: "Dividing a complex problem into smaller and more manageable tasks."
23+
isCorrect: true
24+
explanation: "Correct. Multi-stage reasoning involves dividing a complex problem into smaller, more manageable tasks that the model can solve sequentially. This approach improves the model’s ability to handle intricate reasoning processes by addressing each subtask independently before combining the results to solve the overall problem."
25+
- content: "It eliminates the need for external data sources."
26+
isCorrect: false
27+
explanation: "Incorrect. Multi-stage reasoning doesn't eliminate the need for external data sources."
28+
- content: "Which framework is commonly used for managing multi-stage reasoning systems in LLMs?"
29+
choices:
30+
- content: "Tensorflow"
31+
isCorrect: false
32+
explanation: "Incorrect. TensorFlow is an open-source platform used for building and deploying deep learning models."
33+
- content: "PyTorch"
34+
isCorrect: false
35+
explanation: "Incorrect. PyTorch is an open-source deep learning framework used for developing and training machine learning models, with a focus on flexibility and dynamic computation graphs."
36+
- content: "LangChain"
37+
isCorrect: true
38+
explanation: "Correct. LangChain is a popular framework that helps build complex reasoning systems by linking different reasoning tasks together."
39+
- content: "In the context of multi-stage reasoning with LLMs, what is the primary role of a 'retriever' in a retriever-based chain?"
40+
choices:
41+
- content: "To generate new data based on the initial input."
42+
isCorrect: false
43+
explanation: "Incorrect. The 'retriever' isn't used to generate new data."
44+
- content: "To retrieve relevant information or documents that can be used in subsequent reasoning stages."
45+
isCorrect: true
46+
explanation: "Correct. In a retriever-based chain, the retriever is responsible for fetching relevant information or documents from a predefined dataset or knowledge base. This retrieved information is then passed on to subsequent stages in the reasoning process, where it can be used to generate a more informed and accurate response."
47+
- content: "To execute logical operations like AND, OR, and NOT."
48+
isCorrect: false
49+
explanation: "Incorrect. The 'retriever' isn't used to execute logical operations like AND, OR and NOT."
50+
Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.multistage-reasoning-azure-databricks.summary
3-
title: Summary
4-
metadata:
5-
title: Summary
6-
description: "Summary"
7-
ms.date: 03/20/2025
8-
author: wwlpublish
9-
ms.author: theresai
10-
ms.topic: unit
11-
azureSandbox: false
12-
labModal: false
13-
durationInMinutes: 1
14-
content: |
15-
[!include[](includes/09-summary.md)]
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.multistage-reasoning-azure-databricks.summary
3+
title: Summary
4+
metadata:
5+
title: Summary
6+
description: "Summary"
7+
ms.date: 07/08/2025
8+
author: theresa-i
9+
ms.author: theresai
10+
ms.topic: unit
11+
azureSandbox: false
12+
labModal: false
13+
durationInMinutes: 1
14+
content: |
15+
[!include[](includes/09-summary.md)]

learn-pr/wwl-data-ai/multistage-reasoning-azure-databricks/includes/01-introduction.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,4 @@ To address these limitations, you can use **multi-stage reasoning systems**. The
66

77
:::image type="content" source="../media/model-system.png" alt-text="Diagram illustrating the difference between using one complex model or building a multi-stage reasoning system.":::
88

9-
In Azure Databricks, you can create multi-stage reasoning systems using popular libraries. When you combine the computing power of Apache Spark, the reliable data storage of Delta Lake, and advanced machine learning libraries, Databricks makes it easy to efficiently process complex tasks.
9+
In Azure Databricks, you can create multi-stage reasoning systems using popular libraries. When you combine the computing power of Apache Spark, the reliable data storage of Delta Lake, and advanced machine learning libraries, Databricks makes it easy to efficiently process complex tasks.

0 commit comments

Comments
 (0)