You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/airflow-sync-github-repository.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,7 @@ author: nabhishek
5
5
ms.author: abnarain
6
6
ms.reviewer: jburchel
7
7
ms.topic: how-to
8
-
ms.date: 09/19/2023
8
+
ms.date: 02/13/2025
9
9
---
10
10
11
11
# Sync a GitHub repository in Workflow Orchestration Manager
@@ -45,7 +45,7 @@ To sync your GitHub repository by using the Workflow Orchestration Manager UI:
45
45
-**GitLab**
46
46
-**Bitbucket**
47
47
48
-
:::image type="content" source="media/airflow-git-sync-repository/git-service-type.png" alt-text="Screenshot that shows the Git service type selection dropdown in the environment setup dialog that appears during creation of an Workflow Orchestration Manager integration runtime.":::
48
+
:::image type="content" source="media/airflow-git-sync-repository/git-service-type.png" alt-text="Screenshot that shows the Git service type selection dropdown in the environment setup dialog that appears during creation of a Workflow Orchestration Manager integration runtime.":::
49
49
50
50
1. Select a credential type:
51
51
@@ -59,7 +59,7 @@ To sync your GitHub repository by using the Workflow Orchestration Manager UI:
59
59
- GitLab personal access token
60
60
- Bitbucket personal access token
61
61
62
-
:::image type="content" source="media/airflow-git-sync-repository/git-pat-credentials.png" alt-text="Screenshot that shows the Git PAT credential options in the Airflow environment setup dialog that appears during creation of an AWorkflow Orchestration Manager integration runtime.":::
62
+
:::image type="content" source="media/airflow-git-sync-repository/git-pat-credentials.png" alt-text="Screenshot that shows the Git PAT credential options in the Airflow environment setup dialog that appears during creation of a Workflow Orchestration Manager integration runtime.":::
63
63
-**SPN** ([service principal name](https://devblogs.microsoft.com/devops/introducing-service-principal-and-managed-identity-support-on-azure-devops/)): Only ADO supports this credential type.
64
64
After you select this option, fill out the remaining fields based on the selected **Git service type**:
65
65
-**Git repo url** (required): The clone URL to the Git repository to sync.
@@ -68,7 +68,7 @@ To sync your GitHub repository by using the Workflow Orchestration Manager UI:
68
68
-**Service principal secret** (required): A manually generated secret in the service principal whose value is used to authenticate and access the ADO repo.
69
69
-**Service principal tenant id** (required): The service principal tenant ID.
70
70
71
-
:::image type="content" source="media/airflow-git-sync-repository/git-spn-credentials.png" alt-text="Screenshot that shows the Git SPN credential options in the Airflow environment setup dialog that appears during creation of an Workflow Orchestration Manager integration runtime.":::
71
+
:::image type="content" source="media/airflow-git-sync-repository/git-spn-credentials.png" alt-text="Screenshot that shows the Git SPN credential options in the Airflow environment setup dialog that appears during creation of a Workflow Orchestration Manager integration runtime.":::
72
72
73
73
1. Fill in the rest of the fields with the required information.
74
74
1. Select **Create**.
@@ -295,7 +295,7 @@ This process assumes that your private package was autosynced via Git sync. You
295
295
296
296
For example, if your private package is in `/dags/test/private.whl` in a GitHub repo, you should add the requirement `/opt/airflow/git/\<repoName\>.git/dags/test/private.whl` in the Workflow Orchestration Manager environment.
297
297
298
-
:::image type="content" source="media/airflow-git-sync-repository/airflow-private-package.png" alt-text="Screenshot that shows the Airflow requirements section in the Airflow environment setup dialog that appears during creation of an Workflow Orchestration Manager integration runtime.":::
298
+
:::image type="content" source="media/airflow-git-sync-repository/airflow-private-package.png" alt-text="Screenshot that shows the Airflow requirements section in the Airflow environment setup dialog that appears during creation of a Workflow Orchestration Manager integration runtime.":::
Global parameters are constants across a data factory that can be consumed by a pipeline in any expression. They're useful when you have multiple pipelines with identical parameter names and values. When promoting a data factory using the continuous integration and deployment process (CI/CD), you can override these parameters in each environment.
16
+
Global parameters are constants across a data factory that pipelines can consume in any expression. They're useful when you have multiple pipelines with identical parameter names and values. When promoting a data factory using the continuous integration and deployment process (CI/CD), you can override these parameters in each environment.
17
17
18
18
## Creating global parameters
19
19
@@ -38,17 +38,18 @@ Global parameters can be used in any [pipeline expression](control-flow-expressi
38
38
39
39
## <aname="cicd"></a> Global parameters in CI/CD
40
40
41
-
We recommend including global parameters in the ARM template during the CI/CD. The new mechanism of including global parameters in the ARM template (from 'Manage hub' -> 'ARM template' -> ‘Include global parameters in ARM template') as illustrated below, will not conflict/ override the factory-level settings as it used to do earlier, hence not requiring additional PowerShell for global parameters deployment during CI/CD.
41
+
We recommend including global parameters in the ARM template during the CI/CD. The new mechanism of including global parameters in the ARM template (from 'Manage hub' -> 'ARM template' -> ‘Include global parameters in ARM template') as illustrated in the following image, won't conflict/ override the factory-level settings as it used to do earlier, hence not requiring extra PowerShell for global parameters deployment during CI/CD.
42
42
43
43
:::image type="content" source="media/author-global-parameters/include-arm-template.png" alt-text="Screenshot of 'Include in ARM template'.":::
44
44
45
45
> [!NOTE]
46
-
> We have moved the UI experience for including global parameters from the 'Global parameters' section to the 'ARM template' section in the manage hub.
47
-
If you are already using the older mechanism (from 'Manage hub' -> 'Global parameters' -> 'Include in ARM template'), you can continue. We will continue to support it.
46
+
> We moved the UI experience for including global parameters from the 'Global parameters' section to the 'ARM template' section in the Manage hub.
47
+
48
+
If you're already using the older mechanism (from 'Manage hub' -> 'Global parameters' -> 'Include in ARM template'), you can continue. We'll continue to support it.
48
49
49
50
The **Parameters** folder in the downloaded ARM template contains JSON files that define the parameters used in the ARM template. Each file corresponds to a specific global parameter.
50
51
51
-
If you are using the older flow of integrating global parameters in your continuous integration and deployment solution, it will continue to work:
52
+
If you're using the older flow of integrating global parameters in your continuous integration and deployment solution, it continues to work:
52
53
53
54
* Include global parameters in the ARM template (from 'Manage hub' -> 'Global parameters' -> 'Include in ARM template')
54
55
:::image type="content" source="media/author-global-parameters/include-arm-template-deprecated.png" alt-text="Screenshot of deprecated 'Include in ARM template'.":::
@@ -58,10 +59,10 @@ If you are using the older flow of integrating global parameters in your continu
58
59
We strongly recommend using the new mechanism of including global parameters in the ARM template (from 'Manage hub' -> 'ARM template' -> 'Include global parameters in an ARM template') since it makes the CICD with global parameters much more straightforward and easier to manage.
59
60
60
61
> [!NOTE]
61
-
> The **Include global parameters in an ARM template** configuration is only available in "Git mode". Currently it is disabled in "live mode" or "Data Factory" mode.
62
+
> The **Include global parameters in an ARM template** configuration is only available in "Git mode". Currently it's disabled in "live mode" or "Data Factory" mode.
62
63
63
64
> [!WARNING]
64
-
>You cannot use ‘-‘ in the parameter name. You will receive an errorcode "{"code":"BadRequest","message":"ErrorCode=InvalidTemplate,ErrorMessage=The expression >'pipeline().globalParameters.myparam-dbtest-url' is not valid: .....}". But, you can use the ‘_’ in the parameter name.
65
+
>You can't use ‘-‘ in the parameter name. You receive an errorcode "{"code":"BadRequest","message":"ErrorCode=InvalidTemplate,ErrorMessage=The expression >'pipeline().globalParameters.myparam-dbtest-url' isn't valid: .....}". But, you can use the ‘_’ in the parameter name.
Copy file name to clipboardExpand all lines: articles/data-factory/azure-integration-runtime-ip-addresses.md
+2-4Lines changed: 2 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,7 @@ ms.author: lle
5
5
author: lrtoyou1223
6
6
ms.subservice: integration-runtime
7
7
ms.topic: conceptual
8
-
ms.date: 01/05/2024
8
+
ms.date: 02/13/2025
9
9
---
10
10
11
11
# Azure Integration Runtime IP addresses
@@ -15,9 +15,7 @@ ms.date: 01/05/2024
15
15
The IP addresses that Azure Integration Runtime uses depends on the region where your Azure integration runtime is located. *All* Azure integration runtimes that are in the same region use the same IP address ranges.
16
16
17
17
> [!IMPORTANT]
18
-
> Azure Integration Runtime which enable Managed Virtual Network and all data flows don't support the use of fixed IP ranges.
19
-
>
20
-
> You can use these IP ranges for Data Movement, Pipeline and External activities executions. These IP ranges can be used for filtering in data stores/ Network Security Group (NSG)/ Firewalls for inbound access from Azure Integration runtime.
18
+
> The Azure integration runtime lets you used a managed virtual network. Some data flows require the use of fixed IP ranges. You can use these IP ranges for data movement, pipeline and external activity executions, as well as for filtering in data stores, network security groups (NSGs), and firewalls for inbound access from the Azure integration runtime.
21
19
22
20
## Azure Integration Runtime IP addresses: Specific regions
0 commit comments