You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/reliability/reliability-data-factory.md
+10-10Lines changed: 10 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
---
2
2
title: Reliability in Azure Data Factory
3
-
description: Learn about reliability in Azure Data Factory, including availability zones, multiple-region deployments, and resilient pipeline practices.
3
+
description: Learn about reliability in Azure Data Factory, including availability zones, multi-region deployments, and resilient pipeline practices.
4
4
author: jonburchel
5
5
ms.author: jburchel
6
6
ms.topic: reliability-article
@@ -12,7 +12,7 @@ ms.date: 03/19/2025
12
12
13
13
# Reliability in Azure Data Factory
14
14
15
-
This article describes reliability support in [Azure Data Factory](../data-factory/introduction.md). It covers intra-regional resiliency via [availability zones](#availability-zone-support) and [multiple-region deployments](#multiple-region-support).
15
+
This article describes reliability support in [Azure Data Factory](../data-factory/introduction.md). It covers intra-regional resiliency via [availability zones](#availability-zone-support) and [multi-region deployments](#multi-region-support).
16
16
17
17
Reliability is a shared responsibility between you and Microsoft. This article describes ways for you to create a reliable solution that meets your needs.
18
18
@@ -32,7 +32,7 @@ The components of Data Factory include:
32
32
33
33
-**The core Data Factory service**, which manages pipeline triggers and oversees the coordination of pipeline activities. The core service also manages metadata for each component in the data factory. Microsoft manages the core service.
34
34
35
-
-**[IRs](../data-factory/concepts-integration-runtime.md#integration-runtime-types)**, which perform specific activities within a pipeline. There are different types of IRs.
35
+
-**[Integration runtimes (IRs)](../data-factory/concepts-integration-runtime.md#integration-runtime-types)**, which perform specific activities within a pipeline. There are different types of IRs.
36
36
37
37
-*Microsoft-managed IRs*, which include the Azure IR and the Azure-SQL Server Integration Services (Azure-SSIS) IR. Microsoft manages the components that make up these runtimes. In some scenarios, you configure settings that affect the resiliency of your IRs.
38
38
@@ -123,9 +123,9 @@ Zone-redundant Data Factory resources can be deployed in [any region that suppor
123
123
124
124
-*A SHIR* requires you to configure your own capacity and scaling. Consider over-provisioning when you deploy a SHIR.
125
125
126
-
### Traffic routing between zones
126
+
### Normal operations
127
127
128
-
During normal operations, Data Factory automatically distributes pipeline activities, triggers, and other work among healthy instances in each availability zone.
128
+
**Traffic routing between zones:**During normal operations, Data Factory automatically distributes pipeline activities, triggers, and other work among healthy instances in each availability zone.
129
129
130
130
### Zone-down experience
131
131
@@ -139,13 +139,13 @@ When the availability zone recovers, Data Factory automatically fails back to th
139
139
140
140
However, if you use a SHIR, you might need to restart your compute resources if they've been stopped.
141
141
142
-
### Test for zone failures
142
+
### Testing for zone failures
143
143
144
144
For the core service, and for Azure and Azure-SSIS IRs, Data Factory manages traffic routing, failover, and failback for zone-redundant resources. Because this feature is fully managed, you don't need to initiate or validate availability zone failure processes.
145
145
146
146
For SHIRs, you can use [Azure Chaos Studio](/azure/chaos-studio/chaos-studio-overview) to simulate an availability zone failure on an Azure VM.
147
147
148
-
## Multiple-region support
148
+
## Multi-region support
149
149
150
150
Data Factory resources are deployed into a single Azure region. If the region becomes unavailable, your data factory is also unavailable. However, there are approaches that you can use to help ensure resilience to region outages. These approaches depend on whether the data factory is in a paired or nonpaired region and on your specific requirements and configuration.
151
151
@@ -158,9 +158,9 @@ Because of data residency requirements in Brazil South and Southeast Asia, Data
158
158
For data factories in nonpaired regions, or in Brazil South or Southeast Asia, Microsoft doesn't perform regional failover on your behalf.
159
159
160
160
> [!IMPORTANT]
161
-
> Microsoft triggers Microsoft-managed failover. It's likely to occur after a significant delay and is done on a best-effort basis. There are also some exceptions to this process. You might experience some loss of your data factory metadata. The failover of Data Factory resources might occur at a different time than the failover of other Azure services.
161
+
> Microsoft triggers Microsoft-managed failover. It's likely to occur after a significant delay and is done on a best-effort basis. There are also some exceptions to this process. You might experience some loss of your data factory metadata. The failover of Data Factory resources might occur at a time that's different from the failover time of other Azure services.
162
162
>
163
-
> If you need to be resilient to region outages, consider using one of the [alternative multiple-region approaches](#alternative-multiple-region-approaches).
163
+
> If you need to be resilient to region outages, consider using one of the [alternative multi-region approaches](#alternative-multi-region-approaches).
164
164
165
165
#### Failover of IRs
166
166
@@ -176,7 +176,7 @@ To prepare for a failover, there might be some extra considerations, depending o
176
176
177
177
After a Microsoft-managed failover is complete, you can access your Data Factory pipeline in the paired region. However, after the failover completes, you might need to perform some reconfiguration for IRs or other components. This process includes re-establishing the networking configuration.
178
178
179
-
### Alternative multiple-region approaches
179
+
### Alternative multi-region approaches
180
180
181
181
If you need your pipelines to be resilient to regional outages and you need control over the failover process, consider using a metadata-driven pipeline.
0 commit comments