Skip to content

Commit e7dbba8

Browse files
committed
address feedbacks
1 parent ce7df16 commit e7dbba8

10 files changed

+19
-9
lines changed

articles/data-factory/TOC.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -646,7 +646,7 @@
646646
- name: Understanding pricing
647647
items:
648648
- name: Plan and manage costs
649-
href: billing-acom.md
649+
href: plan-and-manage-costs.md
650650
- name: Pricing examples
651651
href: pricing-concepts.md
652652
- name: Troubleshooting guides

articles/data-factory/billing-acom.md renamed to articles/data-factory/plan-and-manage-costs.md

Lines changed: 18 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,8 @@ ms.date: 05/14/2020
1212

1313
# Plan and manage costs for Azure Data Factory
1414

15+
[!INCLUDE[appliesto-adf-xxx-md](includes/appliesto-adf-xxx-md.md)]
16+
1517
Azure Data Factory is a serverless and elastic data integration service built for cloud scale. This means there is not a fixed-size compute that you need to plan for peak load; rather you specify how much resource to allocate on demand per operation, which allows you to design the ETL processes in a much more scalable manner. In addition, ADF is billed on a consumption-based plan, which means you only pay for what you use.
1618

1719
This article describes how you can plan and manage costs for Azure Data Factory.
@@ -32,17 +34,20 @@ One of the commonly asked questions for the pricing calculator is what values sh
3234
For example, let’s say you need to move 1 TB of data daily from AWS S3 to Azure Data Lake Gen2. You can perform POC of moving 100 GB of data to measure the data ingestion throughput and understand the corresponding billing consumption.
3335

3436
Here is a sample copy activity run detail (your actual mileage will vary based on the shape of your specific dataset, network speeds, egress limits on S3 account, ingress limits on ADLS Gen2, and other factors).
35-
![S3 copy run](media/billing-acom/s3-copy-run-details.png)
37+
38+
![S3 copy run](media/plan-and-manage-costs/s3-copy-run-details.png)
3639

3740
By leveraging the [consumption monitoring at pipeline-run level](#monitor-consumption-at-pipeline-run-level), you can see the corresponding data movement meter consumption quantities:
38-
![S3 copy pipeline consumption](media/billing-acom/s3-copy-pipeline-consumption.png)
41+
42+
![S3 copy pipeline consumption](media/plan-and-manage-costs/s3-copy-pipeline-consumption.png)
3943

4044
Therefore, the total number of DIU-hours it takes to move 1 TB per day for the entire month is:
4145

4246
1.2667 (DIU-hours) * (1 TB / 100 GB) * 30 (days in a month) = 380 DIU-hours
4347

4448
Now you can plug 30 activity runs and 380 DIU-hours into ADF pricing calculator to get an estimate of your monthly bill:
45-
![S3 copy pricing calculator](media/billing-acom/s3-copy-pricing-calculator.png)
49+
50+
![S3 copy pricing calculator](media/plan-and-manage-costs/s3-copy-pricing-calculator.png)
4651

4752
## Use budgets and cost alerts
4853

@@ -56,7 +61,8 @@ As you start using Azure Data Factory, you can see the costs incurred in the [co
5661
2. The default view shows accumulated costs for the current month. You can switch to a different time range and a different granularity such as daily or monthly.
5762
3. To narrow costs for a single service such as Azure Data Factory, select **Add filter** and then select **Service name**. Then choose **Azure data factory v2** from the list.
5863
4. You can add additional filters to analyze cost for specific factory instance and specific ADF meter granularity.
59-
![Cost analysis](media/billing-acom/cost-analysis.png)
64+
65+
![Cost analysis](media/plan-and-manage-costs/cost-analysis.png)
6066

6167
## Monitor consumption at pipeline-run level
6268

@@ -65,8 +71,10 @@ Depending on the types of activities you have in your pipeline, how much data yo
6571
You can view the amount of consumption for different meters for individual pipeline runs in the Azure Data Factory user experience. To open the monitoring experience, select the **Monitor & Manage** tile in the data factory blade of the [Azure portal](https://portal.azure.com/). If you're already in the ADF UX, click on the **Monitor** icon on the left sidebar. The default monitoring view is list of pipeline runs.
6672

6773
Clicking the **Consumption** button next to the pipeline name will display a pop-up window showing you the consumption for your pipeline run aggregated across all of the activities within the pipeline.
68-
![Pipeline run consumption](media/billing-acom/pipeline-run-consumption.png)
69-
![Pipeline consumption details](media/billing-acom/pipeline-consumption-details.png)
74+
75+
![Pipeline run consumption](media/plan-and-manage-costs/pipeline-run-consumption.png)
76+
77+
![Pipeline consumption details](media/plan-and-manage-costs/pipeline-consumption-details.png)
7078

7179
The pipeline run consumption view shows you the amount consumed for each ADF meter for the specific pipeline run, but it does not show the actual price charged, because the amount billed to you is dependent on the type of Azure account you have and the type of currency used. To view the full list of supported account types, see [Understand Cost Management data](https://docs.microsoft.com/azure/cost-management-billing/costs/understand-cost-mgt-data).
7280

@@ -76,10 +84,12 @@ Once you understand the aggregated consumption at pipeline-run level, there are
7684
To see the consumption at activity-run level, go to your data factory **Author & Monitor** UI. From the **Monitor** tab where you see a list of pipeline runs, click the **pipeline name** link to access the list of activity runs in the pipeline run. Click on the **Output** button next to the activity name and look for **billableDuration** property in the JSON output:
7785

7886
Here is a sample out from a copy activity run:
79-
![Copy output](media/billing-acom/copy-output.png)
87+
88+
![Copy output](media/plan-and-manage-costs/copy-output.png)
8089

8190
And here is a sample out from a Mapping Data Flow activity run:
82-
![Dataflow output](media/billing-acom/dataflow-output.png)
91+
92+
![Dataflow output](media/plan-and-manage-costs/dataflow-output.png)
8393

8494
## Next steps
8595

0 commit comments

Comments
 (0)