You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: Evaluate language models with Azure Databricks
5
-
description: Evaluate language models with Azure Databricks
6
-
ms.date: 03/20/2025
7
-
author: wwlpublish
8
-
ms.author: madiepev
9
-
ms.topic: module
10
-
ms.service: azure
11
-
ai-usage: ai-assisted
12
-
ms.collection: wwl-ai-copilot
13
-
title: Evaluate language models with Azure Databricks
14
-
summary: Learn to compare Large Language Model (LLM) and traditional Machine Learning (ML) evaluations, understand their relationship with AI system evaluation, and explore various LLM evaluation metrics and specific task-related evaluations.
15
-
abstract: |
16
-
In this module, you learn how to:
17
-
- Compare LLM and traditional ML evaluations.
18
-
- Describe the relationship between LLM evaluation and evaluation of entire AI systems.
19
-
- Describe generic LLM evaluation metrics like accuracy, perplexity, and toxicity.
20
-
- Describe LLM-as-a-judge for evaluation.
21
-
prerequisites: |
22
-
Before starting this module, you should be familiar with Azure Databricks. Consider completing [Explore Azure Databricks](/training/modules/explore-azure-databricks?azure-portal=true) before starting this module.
title: Evaluate language models with Azure Databricks
5
+
description: Evaluate language models with Azure Databricks
6
+
ms.date: 03/20/2025
7
+
author: wwlpublish
8
+
ms.author: theresai
9
+
ms.topic: module
10
+
ms.service: azure
11
+
ai-usage: ai-assisted
12
+
ms.collection: wwl-ai-copilot
13
+
title: Evaluate language models with Azure Databricks
14
+
summary: Learn to compare Large Language Model (LLM) and traditional Machine Learning (ML) evaluations, understand their relationship with AI system evaluation, and explore various LLM evaluation metrics and specific task-related evaluations.
15
+
abstract: |
16
+
In this module, you learn how to:
17
+
- Compare LLM and traditional ML evaluations.
18
+
- Describe the relationship between LLM evaluation and evaluation of entire AI systems.
19
+
- Describe generic LLM evaluation metrics like accuracy, perplexity, and toxicity.
20
+
- Describe LLM-as-a-judge for evaluation.
21
+
prerequisites: |
22
+
Before starting this module, you should be familiar with Azure Databricks. Consider completing [Explore Azure Databricks](/training/modules/explore-azure-databricks?azure-portal=true) before starting this module.
title: Fine-tune language models with Azure Databricks
5
-
description: Fine-tune language models with Azure Databricks
6
-
ms.date: 03/20/2025
7
-
author: wwlpublish
8
-
ms.author: madiepev
9
-
ms.topic: module
10
-
ms.service: azure
11
-
ai-usage: ai-assisted
12
-
ms.custom: ai-learning-hub
13
-
ms.collection: wwl-ai-copilot
14
-
title: Fine-tune language models with Azure Databricks
15
-
summary: Fine-tuning uses Large Language Models' (LLMs) general knowledge to improve performance on specific tasks, allowing organizations to create specialized models that are more accurate and relevant while saving resources and time compared to training from scratch.
16
-
abstract: |
17
-
In this module, you learn how to:
18
-
- Understand when to use fine-tuning.
19
-
- Prepare your data for fine-tuning.
20
-
- Fine-tune an Azure OpenAI model.
21
-
prerequisites: |
22
-
Before starting this module, you should be familiar with Azure Databricks. Consider completing [Explore Azure Databricks](/training/modules/explore-azure-databricks?azure-portal=true) before starting this module.
title: Fine-tune language models with Azure Databricks
5
+
description: Fine-tune language models with Azure Databricks
6
+
ms.date: 03/20/2025
7
+
author: wwlpublish
8
+
ms.author: theresai
9
+
ms.topic: module
10
+
ms.service: azure
11
+
ai-usage: ai-assisted
12
+
ms.custom: ai-learning-hub
13
+
ms.collection: wwl-ai-copilot
14
+
title: Fine-tune language models with Azure Databricks
15
+
summary: Fine-tuning uses Large Language Models' (LLMs) general knowledge to improve performance on specific tasks, allowing organizations to create specialized models that are more accurate and relevant while saving resources and time compared to training from scratch.
16
+
abstract: |
17
+
In this module, you learn how to:
18
+
- Understand when to use fine-tuning.
19
+
- Prepare your data for fine-tuning.
20
+
- Fine-tune an Azure OpenAI model.
21
+
prerequisites: |
22
+
Before starting this module, you should be familiar with Azure Databricks. Consider completing [Explore Azure Databricks](/training/modules/explore-azure-databricks?azure-portal=true) before starting this module.
summary: Streamline the implementation of Large Language Models (LLMs) with LLMOps (LLM Operations) in Azure Databricks. Learn how to deploy and manage LLMs throughout their lifecycle using Azure Databricks.
15
-
abstract: |
16
-
In this module, you learn how to:
17
-
- Describe the LLM lifecycle overview.
18
-
- Identify the model deployment option that best fits your needs.
19
-
- Use MLflow and Unity Catalog to implement LLMops.
20
-
prerequisites: |
21
-
Before starting this module, you should be familiar with Azure Databricks. Consider completing [Explore Azure Databricks](/training/modules/explore-azure-databricks?azure-portal=true) before starting this module.
summary: Streamline the implementation of Large Language Models (LLMs) with LLMOps (LLM Operations) in Azure Databricks. Learn how to deploy and manage LLMs throughout their lifecycle using Azure Databricks.
15
+
abstract: |
16
+
In this module, you learn how to:
17
+
- Describe the LLM lifecycle overview.
18
+
- Identify the model deployment option that best fits your needs.
19
+
- Use MLflow and Unity Catalog to implement LLMops.
20
+
prerequisites: |
21
+
Before starting this module, you should be familiar with Azure Databricks. Consider completing [Explore Azure Databricks](/training/modules/explore-azure-databricks?azure-portal=true) before starting this module.
title: Implement multi-stage reasoning in Azure Databricks
5
-
description: Implement multi-stage reasoning in Azure Databricks
6
-
ms.date: 03/20/2025
7
-
author: wwlpublish
8
-
ms.author: madiepev
9
-
ms.topic: module
10
-
ms.service: azure
11
-
ai-usage: ai-assisted
12
-
ms.custom: ai-learning-hub
13
-
ms.collection: wwl-ai-copilot
14
-
title: Implement multi-stage reasoning in Azure Databricks
15
-
summary: Multi-stage reasoning systems break down complex problems into multiple stages or steps, with each stage focusing on a specific reasoning task. The output of one stage serves as the input for the next, allowing for a more structured and systematic approach to problem-solving.
16
-
abstract: |
17
-
In this module, you learn how to:
18
-
- Identify the need for multi-stage reasoning systems.
19
-
- Describe a multi-stage reasoning workflow.
20
-
- Implement multi-stage reasoning with libraries like LangChain, LlamaIndex, Haystack, and the DSPy framework.
21
-
prerequisites: |
22
-
Before starting this module, you should be familiar with Azure Databricks. Consider completing [Explore Azure Databricks](/training/modules/explore-azure-databricks?azure-portal=true) before starting this module.
title: Implement multi-stage reasoning in Azure Databricks
5
+
description: Implement multi-stage reasoning in Azure Databricks
6
+
ms.date: 03/20/2025
7
+
author: wwlpublish
8
+
ms.author: theresai
9
+
ms.topic: module
10
+
ms.service: azure
11
+
ai-usage: ai-assisted
12
+
ms.custom: ai-learning-hub
13
+
ms.collection: wwl-ai-copilot
14
+
title: Implement multi-stage reasoning in Azure Databricks
15
+
summary: Multi-stage reasoning systems break down complex problems into multiple stages or steps, with each stage focusing on a specific reasoning task. The output of one stage serves as the input for the next, allowing for a more structured and systematic approach to problem-solving.
16
+
abstract: |
17
+
In this module, you learn how to:
18
+
- Identify the need for multi-stage reasoning systems.
19
+
- Describe a multi-stage reasoning workflow.
20
+
- Implement multi-stage reasoning with libraries like LangChain, LlamaIndex, Haystack, and the DSPy framework.
21
+
prerequisites: |
22
+
Before starting this module, you should be familiar with Azure Databricks. Consider completing [Explore Azure Databricks](/training/modules/explore-azure-databricks?azure-portal=true) before starting this module.
0 commit comments