You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/azure-functions/durable/durable-task-scheduler/choose-orchestration-framework.md
+28-13Lines changed: 28 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,36 +7,47 @@ ms.date: 04/28/2025
7
7
8
8
# Choosing an orchestration framework
9
9
10
-
The goal of this article is to provide information about two developer-oriented orchestration frameworks supported by Azure and considerations for when to choose which. The article will also provide some context around scenarios that warrant the use of an orchestration framework.
10
+
The goal of this article is to provide information about two developer-oriented orchestration frameworks supported by Azure and considerations for when to choose which. The article also provides some context around scenarios that warrant the use of an orchestration framework.
11
11
12
12
## Scenarios requiring orchestration
13
-
Developers often find themselves creating solutions that involve multi-step operations, some of which may be long-running. These multiple-step operations are referred to as *orchestrations* or *workflows*. For example, an e-commerce website would need an order processing workflow, which has steps (maybe implemented as microservices) that need to happen sequentially to check the inventory, send order confirmation, process payment, and generate invoice. Another example would be an intelligent trip planner. The planner might suggest ideas based on user requirements, get preference confirmation, and then make required bookings. You can implement an agent for each task and orchestrate the steps for invoking these agents as a workflow.
13
+
Developers often find themselves creating solutions that involve multi-step operations, some of which may be long-running. These multiple-step operations are referred to as *orchestrations* or *workflows*. For example, an e-commerce website would need an order processing workflow, which has steps (implemented as microservices) that need to happen sequentially to:
14
+
- Check the inventory
15
+
- Send order confirmation
16
+
- Process payment
17
+
- Generate invoice
14
18
15
-
Since orchestrations involve multiple steps or a step might be long-running, it's important that the framework you use keeps track of the application state so that execution can continue from the point of failure rather than the beginning. One way to ensure this statefulness is to continuouly checkpoint orchestration states to a persistance layer while it runs. The orchestration frameworks discussed in the next section does exactly this, while also taking care automatic retries so that you can orchestrate your workflows without the burden of architecting for fault tolerance.
19
+
Another example would be an intelligent trip planner. The planner might suggest ideas based on user requirements, get preference confirmation, and then make required bookings. You can implement an agent for each task and orchestrate the steps for invoking these agents as a workflow.
16
20
17
-
The two scenarios above share a commonly used orchestration pattern, which is *sequential chaining* of operations. There are other patterns that benefit from the statefulness of an orchestration framework:
21
+
Since orchestrations involve multiple or long-running steps, it's important that the framework you tracks the application state so that execution can continue from the point of failure rather than the beginning. One way to ensure this statefulness is to continuously checkpoint orchestration states to a persistence layer while it runs. The next section demonstrates how orchestration frameworks maintain statefulness while also taking care automatic retries while you orchestrate your workflows without the burden of architecting for fault tolerance.
22
+
23
+
The two previous scenarios share a commonly used orchestration pattern, which is *sequential chaining* of operations. There are other patterns that benefit from the statefulness of an orchestration framework:
18
24
-*Fan-out/fan-in*: For batch jobs, ETL (extract, transfer, and load), and any scenario that requires parallel processing
19
25
-*Human interactions*: For two-factor authentication, workflows that require human approval
20
26
-*Asynchronous HTTP APIs*: For any scenario where a client doesn't want to wait for long-running tasks to complete
21
27
22
-
The next section will cover the two orchestration frameworks supported by Azure: **Durable Functions** and **Durable Task SDKs (currently in public preview)**.
28
+
The next section covers the two orchestration frameworks supported by Azure: **Durable Functions** and **Durable Task SDKs (currently in public preview)**.
23
29
24
30
## Orchestration framework options
25
31
Both orchestrations frameworks described in this section are designed for developers, so they're code-centric and are available in various popular programming languages.
26
32
27
33
### Durable Functions
28
-
[Durable Functions](../durable-functions-overview.md) is a feature of Azure Functions, so it inherits a lot of the assets from the latter such as integrations with other Azure services through the Functions extensions, local development experience, serverless pricing model, etc. Other than running on the Functions platform, Durable Functions apps can also be run on Azure App Service and Azure Container App just like a regular Function app.
34
+
As a feature of Azure Functions, [Durable Functions](../durable-functions-overview.md) inherits numerous assets, such as:
35
+
- Integrations with other Azure services through the Functions extensions
36
+
- Local development experience
37
+
- Serverless pricing model, and more.
38
+
39
+
Other than running on the Functions platform, Durable Functions apps can also be run on Azure App Service and Azure Container App just like a regular Function app.
29
40
30
41
Durable Functions has a special feature called [Durable Entities](../durable-functions-entities.md), which are similar in concept to virtual actors or grains in the Orleans framework. Entities allow you to keep small pieces of states for objects in a distributed system. For example, you could use entities to model users of a microblogging app or the counter of an exercise app. Learn more about Durable Entities.
31
42
32
-
As mentioned earlier, orchestration frameworks need to persist state information. In the context of Durable Functions, states are persisted in something called a [storage backend](../durable-functions-storage-providers.md). Durable Functions supports two BYO or "bring-your-own" backends - Azure Storage and Microsoft SQL - and an Azure managed backend called Durable Task Scheduler (more information about the scheduler in the next section).
43
+
As mentioned earlier, orchestration frameworks need to persist state information. In the context of Durable Functions, states are persisted in something called a [storage backend](../durable-functions-storage-providers.md). Durable Functions supports two "bring-your-own" (BYO) backends - Azure Storage and Microsoft SQL - and an Azure managed backend called Durable Task Scheduler (more information about the scheduler in the next section).
33
44
34
45
#### When to use Durable Functions
35
-
If you need to build event-driven apps with workflows, the recommendation would be to consider Durable Functions. The Azure Functions extensions that provide integrations with other Azure services makes building event-driven scenarios easy. For example, if you need to start a Durable Functions orchestration when a message comes into your Azure Service Bus or when a file is uploaded to Azure Blob Storage, then you can easily implement that with Durable Functions. Or if you need an orchestration to start periodically or in reaction to an HTTP request, then you can build that with the Azure Functions timer and HTTP trigger, respectively.
46
+
If you need to build event-driven apps with workflows, the recommendation would be to consider Durable Functions. The Azure Functions extensions that provide integrations with other Azure services makes building event-driven scenarios easy. For example, if you need to start a Durable Functions orchestration when a message comes into your Azure Service Bus or a file uploads to Azure Blob Storage, you can easily implement that with Durable Functions. Or if you need an orchestration to start periodically or in reaction to an HTTP request, then you can build that with the Azure Functions timer and HTTP trigger, respectively.
36
47
37
48
Another scenario for choosing Durable Functions would be when your solution benefits from using Durable Entities, since the Durable Task SDKs don't provide this feature.
38
49
39
-
Lastly, if you're already writing Azure Function apps and realized that you need workflow, then you probably would want to use Durable Functions because you'll find its programming model to be very similar to Functions. You can accelerate your develope in this case.
50
+
Lastly, if you're already writing Azure Function apps and realized that you need workflow, you probably want to use Durable Functions. Its programming model is very similar to Functions. You can accelerate your developer in this case.
40
51
41
52
**Quickstarts**
42
53
- Create a durable functions app with Azure Storage backend
@@ -53,22 +64,26 @@ Lastly, if you're already writing Azure Function apps and realized that you need
53
64
- Intelligent PDF summarizer - [.NET](/samples/azure-samples/intelligent-pdf-summarizer-dotnet/durable-func-pdf-summarizer-csharp/), [Python](/samples/azure-samples/intelligent-pdf-summarizer/durable-func-pdf-summarizer/)
54
65
55
66
### Durable Task SDKs with Durable Task Scheduler (public preview)
56
-
The Durable Task SDKs are client SDKs that allows the orchestrations you write to connect to the orchestration engine in Azure. As such, apps that leverage the Durable Task SDKs can be run on virtually any compute platforms, including Azure Kubernetes Service, Azure Container Apps, Azure App Service, or just VMs on-prem.
67
+
The Durable Task SDKs are client SDKs that allows the orchestrations you write to connect to the orchestration engine in Azure. Apps that use the Durable Task SDKs can be run on any compute platforms, including:
68
+
- Azure Kubernetes Service
69
+
- Azure Container Apps
70
+
- Azure App Service
71
+
- VMs on-premises
57
72
58
-
The Durable Task SDKs must be used with the Durable Task Scheduler (currently in public preview), where the latter plays both the role of the orchestration engine and the storage backend for orchestration state persistence. As mentioned previously, the Durable Task Scheduler is fully managed by Azure, which eliminates management overhead. The scheduler is also optimized to provide high orchestration throughput, offers an out-of-the-box dashboard for orchestrations monitoring and debugging, as well as a local emulator and more. Learn more about the [Durable Task Scheduler](./durable-task-scheduler.md).
73
+
The Durable Task SDKs must be used with the Durable Task Scheduler (currently in public preview), where the latter plays both the role of the orchestration engine and the storage backend for orchestration state persistence. As mentioned previously, the Azure-managed Durable Task Scheduler eliminates management overhead. The scheduler is also optimized to provide high orchestration throughput, offers an out-of-the-box dashboard for orchestrations monitoring and debugging, as well as a local emulator and more. Learn more about the [Durable Task Scheduler](./durable-task-scheduler.md).
59
74
60
75
#### When to use Durable Task SDKs
61
76
Use the Durable Task SDKs when your app needs only workflows. The Durable Task SDKs provide a lightweight and relatively un-opinionated programming model for authoring workflows.
62
77
63
-
The other reason for using the Durable Task SDKs is when you need to run apps on Azure Kubernetes Services or VMs on-prem with official Microsoft support. While Durable Functions can be run on these platforms as well, there is no official support.
78
+
The other reason for using the Durable Task SDKs is when you need to run apps on Azure Kubernetes Services or VMs on-premises with official Microsoft support. While Durable Functions can be run on these platforms as well, there's no official support.
64
79
65
80
**Quickstarts**
66
81
-[.NET][TODO]
67
82
-[Python][TODO]
68
83
-[Java][TODO]
69
84
70
85
> [!NOTE]
71
-
> The Durable Task Framework is an open-source .NET orchestration framework. Like the Durable Task SDKs, it can be used to build apps that run on platforms like the Azure Kubernetes Services. However, we don't recommend new customers to use Durable Task Framework because it is not officially supported by Microsoft.
86
+
> The Durable Task Framework is an open-source .NET orchestration framework. Like the Durable Task SDKs, it can be used to build apps that run on platforms like the Azure Kubernetes Services. However, we don't recommend new customers to use Durable Task Framework because Microsoft doesn't officially support it.
0 commit comments