Skip to content

Commit a5d089f

Browse files
committed
Rename Managed Airflow to Workflow orchestration manager in data factory
1 parent 8a79e88 commit a5d089f

File tree

59 files changed

+505
-517
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

59 files changed

+505
-517
lines changed

articles/confidential-computing/.openpublishing.redirection.json

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,38 @@
3838
{
3939
"source_path_from_root": "/articles/confidential-computing/how-to-fortanix-enclave-manager.md",
4040
"redirect_url": "/azure/confidential-computing/how-to-fortanix-confidential-computing-manager-node-agent"
41+
},
42+
{
43+
"source_path_from_root": "/articles/data-factory/create-managed-airflow-environment.md",
44+
"redirect_url": "/azure/data-factory/create-airflow-environment"
45+
},
46+
{
47+
"source_path_from_root": "/articles/data-factory/airflow-create-private-requirement-package.md",
48+
"redirect_url": "/articles/data-factory/airflow-install-private-package"
49+
},
50+
{
51+
"source_path_from_root": "/articles/data-factory/concept-managed-airflow.md",
52+
"redirect_url": "/articles/data-factory/concepts-workflow-orchestration-manager"
53+
},
54+
{
55+
"source_path_from_root": "/articles/data-factory/delete-dags-in-managed-airflow.md",
56+
"redirect_url": "/articles/data-factory/delete-dags-in-workflow-orchestration-manager"
57+
},
58+
{
59+
"source_path_from_root": "/articles/data-factory/enable-azure-key-vault-for-managed-airflow.md",
60+
"redirect_url": "/articles/data-factory/enable-azure-key-vault"
61+
},
62+
{
63+
"source_path_from_root": "/articles/data-factory/get-started-with-managed-airflow.md",
64+
"redirect_url": "/articles/data-factory/get-started-with-workflow-orchestration-manager"
65+
},
66+
{
67+
"source_path_from_root": "/articles/data-factory/how-does-managed-airflow-work.md",
68+
"redirect_url": "/articles/data-factory/how-does-workflow-orchestration-manager-work.md"
69+
},
70+
{
71+
"source_path_from_root": "/articles/data-factory/how-to-diagnostic-logs-and-metrics-for-managed-airflow.md",
72+
"redirect_url": "/articles/data-factory/diagnostic-logs-and-metrics-for-workflow-orchestration-manager.md"
4173
}
4274
]
4375
}

articles/data-factory/TOC.yml

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1239,7 +1239,7 @@ items:
12391239
displayName: troubleshooting
12401240
- name: Google Ads
12411241
href: connector-troubleshoot-google-ads.md
1242-
displayName: troubleshooting
1242+
displayName: troubleshooting
12431243
- name: Hive
12441244
href: connector-troubleshoot-hive.md
12451245
displayName: troubleshooting
@@ -1325,30 +1325,30 @@ items:
13251325
- name: Advanced topics
13261326
href: sap-change-data-capture-advanced-topics.md
13271327
displayName: SAP, change data capture, CDC
1328-
- name: Managed Airflow
1328+
- name: Workflow Orchestration Manager
13291329
items:
13301330
- name: Tutorials
13311331
items:
13321332
- name: Run an existing pipeline with Airflow
13331333
href: tutorial-run-existing-pipeline-with-airflow.md
13341334
- name: Concepts
1335-
href: concept-managed-airflow.md
1336-
- name: Get Started with Managed Airflow
1337-
href: get-started-with-managed-airflow.md
1335+
href: concepts-workflow-orchestration-manager.md
1336+
- name: Get Started
1337+
href: get-started-with-workflow-orchestration-manager.md
13381338
- name: How-to
13391339
items:
1340-
- name: Create Managed Airflow Environment
1341-
href: create-managed-airflow-environment.md
1340+
- name: Create Airflow Environment
1341+
href: create-airflow-environment.md
13421342
- name: Import Dags using Azure Blob Storage
13431343
href: airflow-import-dags-blob-storage.md
13441344
- name: Delete Dags
1345-
href: delete-dags-in-managed-airflow.md
1345+
href: delete-dags-in-workflow-orchestration-manager.md
13461346
- name: How to change the Airflow password
13471347
href: password-change-airflow.md
13481348
- name: Install a Private Package
13491349
href: airflow-install-private-package.md
13501350
- name: Enable Azure Key Vault for Airflow
1351-
href: enable-azure-key-vault-for-managed-airflow.md
1351+
href: enable-azure-key-vault.md
13521352
- name: Kubernetes secret to access private container registry
13531353
href: kubernetes-secret-pull-image-from-private-container-registry.md
13541354
- name: Rest APIs for the Airflow integrated runtime
@@ -1358,8 +1358,8 @@ items:
13581358
- name: Sync a GitHub repository
13591359
href: airflow-sync-github-repository.md
13601360
- name: Diagnostic logs and metrics
1361-
href: how-to-diagnostic-logs-and-metrics-for-managed-airflow.md
1362-
- name: CI/CD Patterns with Managed Airflow
1361+
href: diagnostic-logs-and-metrics-for-workflow-orchestration-manager.md
1362+
- name: CI/CD Patterns
13631363
href: ci-cd-pattern-with-airflow.md
13641364
- name: Airflow Configurations
13651365
href: airflow-configurations.md

articles/data-factory/airflow-configurations.md

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
2-
title: Apache Airflow configuration options on Managed Airflow
3-
description: This article explains how Apache Airflow configuration options can be attached to your Managed Airflow integration runtimes for an Apache Airflow environment as key-value pairs.
2+
title: Supported Apache Airflow Configurations
3+
description: This article enumerates the Apache Airflow configurations supported by the Workflow Orchestration Manager.
44
author: nabhishek
55
ms.author: abnarain
66
ms.reviewer: jburchel
@@ -9,9 +9,12 @@ ms.topic: how-to
99
ms.date: 12/11/2023
1010
---
1111

12-
# Apache Airflow configuration options on Managed Airflow
12+
# Supported Apache Airflow Configurations
1313

14-
Apache Airflow configuration options can be attached to your Azure Data Factory Managed Airflow integration runtime as key-value pairs. We don't expose the `airflow.cfg` in the Managed Airflow UI. However, users can override the Apache Airflow configurations directly on the UI as key-value pairs under the `Airflow Configuration overrides` section. They can continue using all other settings in `airflow.cfg`. In Managed Airflow, developers can override any of the Airflow configurations provided by Apache Airflow except the configurations shown in the table.
14+
> [!NOTE]
15+
> This feature is in public preview. Workflow Orchestration Manager is powered by Apache Airflow.
16+
17+
In Workflow Orchestration Manager, Apache Airflow configurations can be integrated with the platform's runtime as key-value pairs. While the `airflow.cfg` isn't directly accessible in the UI, users can override these configurations via the UI's "Airflow Configuration overrides" section, retaining access to other `airflow.cfg` settings. Developers have the flexibility to override most Apache Airflow configurations within Workflow Orchestration Manager, `except for those explicitly outlined in a provided table`.
1518

1619
[!INCLUDE[appliesto-adf-xxx-md](includes/appliesto-adf-xxx-md.md)]
1720

articles/data-factory/airflow-create-private-requirement-package.md

Lines changed: 0 additions & 93 deletions
This file was deleted.

articles/data-factory/airflow-get-ip-airflow-cluster.md

Lines changed: 19 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
2-
title: Retrieve the IP address of a Managed Airflow cluster
3-
description: This article provides step-by-step instructions for how to retrieve the IP address of a Managed Airflow cluster in Azure Data Factory.
2+
title: Retrieve the IP address of a Workflow Orchestration Manager cluster
3+
description: This article provides step-by-step instructions to retrieve the IP address of a Workflow Orchestration Manager's cluster.
44
author: nabhishek
55
ms.author: abnarain
66
ms.reviewer: jburchel
@@ -9,11 +9,14 @@ ms.topic: how-to
99
ms.date: 09/19/2023
1010
---
1111

12-
# Retrieve the IP address of a Managed Airflow cluster
12+
# Retrieve the IP address of a Workflow Orchestration Manager cluster
1313

1414
[!INCLUDE[appliesto-adf-xxx-md](includes/appliesto-adf-xxx-md.md)]
1515

16-
This article explains how to enhance security of your data stores and resources by restricting access solely to your Azure Data Factory Managed Airflow cluster. In this article, you walk through the process of retrieving and adding the unique IP address associated with your Managed Airflow cluster to your storage firewall's allowlist. This process enables you to access data stores or resources through the list of permitted IP addresses on the firewall's allowlist. Access from all other IP addresses via the public endpoint is prevented.
16+
> [!NOTE]
17+
> This feature is in public preview. Workflow Orchestration Manager is powered by Apache Airflow.
18+
19+
This article demonstrates how to retrieve and add the IP address associated with your Workflow Orchestration Manager cluster to your storage firewall's allowlist. This enhances the security of data stores and resources by restricting access solely to the Workflow Orchestration Manager cluster within Azure Data Factory, preventing access from all other IP addresses via the public endpoint.
1720

1821
> [!NOTE]
1922
> Importing DAGs is currently not supported by using blob storage with IP allow listing or by using private endpoints. We suggest using Git sync instead.
@@ -37,33 +40,33 @@ For more information, see the following screenshots.
3740

3841
:::image type="content" source="media/airflow-get-ip-airflow-cluster/get-dags.png" alt-text="Screenshot that shows a sample Airflow API request using a bearer token fetched in the initial step." lightbox="media/airflow-get-ip-airflow-cluster/get-dags.png":::
3942

40-
### Retrieve the Managed Airflow cluster's IP address
43+
### Retrieve the Workflow Orchestration Manager cluster's IP address
4144

42-
1. Use the Managed Airflow UI.
45+
1. Use the Workflow Orchestration Manager UI.
4346

4447
:::image type="content" source="media/airflow-get-ip-airflow-cluster/get-cluster-ip-from-ui.png" alt-text="Screenshot that shows how to retrieve a cluster's IP by using the UI." lightbox="media/airflow-get-ip-airflow-cluster/get-cluster-ip-from-ui.png":::
4548

4649
1. Use the Rest API.
47-
For more information, see [Managed Airflow IP address - Get](/rest/api/datafactory/integration-runtimes/get?tabs=HTTP#code-try-0).
50+
For more information, see [Workflow Orchestration Manager IP address - Get](/rest/api/datafactory/integration-runtimes/get?tabs=HTTP#code-try-0).
4851

4952
You should retrieve the Airflow cluster's IP address from the response, as shown in the screenshot.
5053

5154
#### Sample response
5255

5356
:::image type="content" source="media/airflow-get-ip-airflow-cluster/get-cluster-ip-from-api.png" alt-text="Screenshot that shows how to retrieve a cluster's IP by using an API." lightbox="media/airflow-get-ip-airflow-cluster/get-cluster-ip-from-api.png":::
5457

55-
### Add the Managed Airflow cluster IP address to the storage account you want to secure
58+
### Add the Workflow Orchestration Manager cluster IP address to the storage account you want to secure
5659

5760
> [!NOTE]
58-
> You can add the Managed Airflow IP address to other storage services too, like Azure SQL Database and Azure Key Vault.
61+
> You can add the Workflow Orchestration Manager IP address to other storage services too, like Azure SQL Database and Azure Key Vault.
5962
60-
- To add a Managed Airflow cluster IP address in Azure Key Vault, see [Azure SQL Database and Azure Synapse IP firewall rules](/azure/key-vault/general/network-security).
61-
- To add a Managed Airflow cluster IP address in Azure Blob Storage, see [Configure Azure Storage firewalls and virtual networks](/azure/storage/common/storage-network-security?tabs=azure-portal#grant-access-from-an-internet-ip-range).
62-
- To add a Managed Airflow cluster IP address in Azure SQL Database, see [Configure Azure Key Vault firewalls and virtual networks](/azure/azure-sql/database/firewall-configure).
63-
- To add a Managed Airflow cluster IP address in Azure PostgreSQL Database, see [Create and manage firewall rules for Azure Database for PostgreSQL - Single server using the Azure portal](/azure/postgresql/single-server/how-to-manage-firewall-using-portal).
63+
- To add a Workflow Orchestration Manager cluster IP address in Azure Key Vault, see [Azure SQL Database and Azure Synapse IP firewall rules](/azure/key-vault/general/network-security).
64+
- To add a Workflow Orchestration Manager cluster IP address in Azure Blob Storage, see [Configure Azure Storage firewalls and virtual networks](/azure/storage/common/storage-network-security?tabs=azure-portal#grant-access-from-an-internet-ip-range).
65+
- To add a Workflow Orchestration Manager cluster IP address in Azure SQL Database, see [Configure Azure Key Vault firewalls and virtual networks](/azure/azure-sql/database/firewall-configure).
66+
- To add a Workflow Orchestration Manager cluster IP address in Azure PostgreSQL Database, see [Create and manage firewall rules for Azure Database for PostgreSQL - Single server using the Azure portal](/azure/postgresql/single-server/how-to-manage-firewall-using-portal).
6467

6568
## Related content
6669

67-
- [Run an existing pipeline with Managed Airflow](tutorial-run-existing-pipeline-with-airflow.md)
68-
- [Managed Airflow pricing](airflow-pricing.md)
69-
- [Change the password for Managed Airflow environments](password-change-airflow.md)
70+
- [Run an existing pipeline with Workflow Orchestration Manager](tutorial-run-existing-pipeline-with-airflow.md)
71+
- [Workflow Orchestration Manager pricing](airflow-pricing.md)
72+
- [Change the password for Workflow Orchestration Manager environment](password-change-airflow.md)

0 commit comments

Comments
 (0)