Skip to content

Commit f488619

Browse files
Merge pull request #226008 from jonburchel/2023-02-01-fixes-for-PR-224903
Fixes from PR review in https://github.com/MicrosoftDocs/azure-docs-p…
2 parents 008d43a + c9e1d6a commit f488619

File tree

4 files changed

+19
-17
lines changed

4 files changed

+19
-17
lines changed

articles/data-factory/how-does-managed-airflow-work.md

Lines changed: 19 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -19,57 +19,59 @@ ms.date: 01/20/2023
1919
Azure Data Factory Managed Airflow orchestrates your workflows using Directed Acyclic Graphs (DAGs) written in Python. You must provide your DAGs and plugins in Azure Blob Storage. Airflow requirements or library dependencies can be installed during the creation of the new Managed Airflow environment or by editing an existing Managed Airflow environment. Then run and monitor your DAGs by launching the Airflow UI from ADF using a command line interface (CLI) or a software development kit (SDK).
2020

2121
## Create a Managed Airflow environment
22-
The following steps setup and configure your Managed Airflow environment.
22+
The following steps set up and configure your Managed Airflow environment.
2323

2424
### Prerequisites
2525
**Azure subscription**: If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/) before you begin.
2626
Create or select an existing Data Factory in the region where the managed airflow preview is supported.
2727

2828
### Steps to create the environment
29-
1. Create new Managed Airflow environment.
30-
Go to **Manage** hub -> **Airflow (Preview)** -> **+New** to create a new Airflow environment
29+
1. Create new Managed Airflow environment.
30+
Go to **Manage** hub -> **Airflow (Preview)** -> **+New** to create a new Airflow environment
3131

3232
:::image type="content" source="media/how-does-managed-airflow-work/create-new-airflow.png" alt-text="Screenshot that shows how to create a new Managed Apache Airflow environment.":::
3333

34-
1. Provide the details (Airflow config)
34+
1. Provide the details (Airflow config)
3535

3636
:::image type="content" source="media/how-does-managed-airflow-work/airflow-environment-details.png" alt-text="Screenshot that shows some Managed Airflow environment details.":::
3737

3838
> [!IMPORTANT]
39-
> When using **Basic** authentication, remember the username and password specified in this screen. It will be needed to login later in the Managed Airflow UI. The default option is **AAD** and it does not require creating username/ password for your Airflow environment, but instead uses the logged in user**s credential to Azure Data Factory to login/ monitor DAGs.
39+
> When using **Basic** authentication, remember the username and password specified in this screen. It will be needed to login later in the Managed Airflow UI. The default option is **Azure AD** and it does not require creating username/ password for your Airflow environment, but instead uses the logged in user's credential to Azure Data Factory to login/ monitor DAGs.
4040
1. **Environment variables** a simple key value store within Airflow to store and retrieve arbitrary content or settings.
4141
1. **Requirements** can be used to pre-install python libraries. You can update these later as well.
4242

4343
## Import DAGs
4444

4545
The following steps describe how to import DAGs into Managed Airflow.
4646

47-
### Prerequisite
47+
### Prerequisites
4848

49-
You will need to upload a sample DAG onto an accessible Storage account.
49+
You'll need to upload a sample DAG onto an accessible Storage account.
5050

5151
> [!NOTE]
52-
> Blob Storage behind VNet are not supported during the preview. We will be adding the support shortly.
52+
> Blob Storage behind VNet are not supported during the preview.
5353
5454
[Sample Apache Airflow v2.x DAG](https://airflow.apache.org/docs/apache-airflow/stable/tutorial/fundamentals.html).
5555
[Sample Apache Airflow v1.10 DAG](https://airflow.apache.org/docs/apache-airflow/1.10.11/_modules/airflow/example_dags/tutorial.html).
5656

57+
58+
### Steps to import
5759
1. Copy-paste the content (either v2.x or v1.10 based on the Airflow environment that you have setup) into a new file called as **tutorial.py**.
5860

5961
Upload the **tutorial.py** to a blob storage. ([How to upload a file into blob](/storage/blobs/storage-quickstart-blobs-portal.md))
6062

6163
> [!NOTE]
6264
> You will need to select a directory path from a blob storage account that contains folders named **dags** and **plugins** to import those into the Airflow environment. **Plugins** are not mandatory. You can also have a container named **dags** and upload all Airflow files within it.
6365
64-
1. Click on **Airflow (Preview)** under **Manage** hub. Then hover over the earlier created **Airflow** environment and click on **Import files** to Import all DAGs and dependencies into the Airflow Environment.
66+
1. Select on **Airflow (Preview)** under **Manage** hub. Then hover over the earlier created **Airflow** environment and select on **Import files** to Import all DAGs and dependencies into the Airflow Environment.
6567

6668
:::image type="content" source="media/how-does-managed-airflow-work/import-files.png" alt-text="Screenshot shows import files in manage hub.":::
6769

6870
1. Create a new Linked Service to the accessible storage account mentioned in the prerequisite (or use an existing one if you already have your own DAGs).
6971

7072
:::image type="content" source="media/how-does-managed-airflow-work/create-new-linked-service.png" alt-text="Screenshot that shows how to create a new linked service.":::
7173

72-
1. Use the storage account where you uploaded the DAG (check prerequisite). Test connection, then click **Create**.
74+
1. Use the storage account where you uploaded the DAG (check prerequisite). Test connection, then select **Create**.
7375

7476
:::image type="content" source="media/how-does-managed-airflow-work/linked-service-details.png" alt-text="Screenshot shows some linked service details.":::
7577

@@ -94,27 +96,27 @@ You will need to upload a sample DAG onto an accessible Storage account.
9496
* Problem: DAG import is taking over 5 minutes
9597
Mitigation: Reduce the size of the imported DAGs with a single import. One way to achieve this is by creating multiple DAG folders with lesser DAGs across multiple containers.
9698

97-
* Problem: Imported DAGs do not show up when you login into the Airflow UI.
98-
Mitigation: Login into the Airflow UI and see if there are any DAG parsing errors. This could happen if the DAG files contains any incompatible code. You will find the exact line numbers and the files which have the issue through the Airflow UI.
99+
* Problem: Imported DAGs don't show up when you sign in into the Airflow UI.
100+
Mitigation: Sign in into the Airflow UI and see if there are any DAG parsing errors. This could happen if the DAG files contain any incompatible code. You'll find the exact line numbers and the files, which have the issue through the Airflow UI.
99101

100102
:::image type="content" source="media/how-does-managed-airflow-work/import-dag-issues.png" alt-text="Screenshot shows import dag issues.":::
101103

102104

103105
## Monitor DAG runs
104106

105-
To monitor the Airflow DAGs, login into Airflow UI with the earlier created username and password.
107+
To monitor the Airflow DAGs, sign in into Airflow UI with the earlier created username and password.
106108

107-
1. Click on the Airflow environment created.
109+
1. Select on the Airflow environment created.
108110

109111
:::image type="content" source="media/how-does-managed-airflow-work/airflow-environment-monitor-dag.png" alt-text="Screenshot that shows the Airflow environment created.":::
110112

111-
1. Login using the username-password provided during the Airflow Integration Runtime creation. ([You can reset the username or password by editing the Airflow Integration runtime]() if needed)
113+
1. Sign in using the username-password provided during the Airflow Integration Runtime creation. ([You can reset the username or password by editing the Airflow Integration runtime]() if needed)
112114

113-
:::image type="content" source="media/how-does-managed-airflow-work/login-in-dags.png" alt-text="Screenshot that shows login using the username-password provided during the Airflow Integration Runtime creation.":::
115+
:::image type="content" source="media/how-does-managed-airflow-work/login-in-dags.png" alt-text="Screenshot that shows sign in using the username-password provided during the Airflow Integration Runtime creation.":::
114116

115117
## Remove DAGs from the Airflow environment
116118

117-
If you are using Airflow version 1.x, delete DAGs that are deployed on any Airflow environment (IR), you need to delete the DAGs in two different places.
119+
If you're using Airflow version 1.x, delete DAGs that are deployed on any Airflow environment (IR), you need to delete the DAGs in two different places.
118120

119121
1. Delete the DAG from Airflow UI
120122
1. Delete the DAG in ADF UI
3.39 KB
Loading
26.1 KB
Loading
13.7 KB
Loading

0 commit comments

Comments
 (0)