Skip to content

Commit ab2078e

Browse files
authored
Merge pull request #107192 from djpmsft/docUpdates
adding transformation overview
2 parents 4e5f845 + c4e6831 commit ab2078e

File tree

3 files changed

+39
-1
lines changed

3 files changed

+39
-1
lines changed

articles/data-factory/TOC.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -479,6 +479,8 @@
479479
href: control-flow-webhook-activity.md
480480
- name: Data flow transformations
481481
items:
482+
- name: Transformation overview
483+
href: data-flow-transformation-overview.md
482484
- name: Aggregate
483485
href: data-flow-aggregate.md
484486
- name: Alter row
Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
---
2+
title: Mapping data flow transformation overview
3+
description: An overview of the different transformations available in mapping data flow
4+
author: djpmsft
5+
ms.author: daperlov
6+
manager: anandsub
7+
ms.service: data-factory
8+
ms.topic: conceptual
9+
ms.date: 03/10/2020
10+
---
11+
12+
# Mapping data flow transformation overview
13+
14+
Below is a list of the transformations currently supported in mapping data flow. Click on each transformations to learn its configuration details.
15+
16+
| Name | Category | Description |
17+
| ---- | -------- | ----------- |
18+
| [Aggregate](data-flow-aggregate.md) | Schema modifier | Define different types of aggregations such as SUM, MIN, MAX, and COUNT grouped by existing or computed columns. |
19+
| [Alter row](data-flow-alter-row.md) | Row modifier | Set insert, delete, update, and upsert policies on rows. |
20+
| [Conditional split](data-flow-conditional-split.md) | Multiple inputs/outputs | Route rows of data to different streams based on matching conditions. |
21+
| [Derived column](data-flow-derived-column.md) | Schema modifier | generate new columns or modify existing fields using the data flow expression language. |
22+
| [Exists](data-flow-exists.md) | Multiple inputs/outputs | Check whether your data exists in another source or stream. |
23+
| [Filter](data-flow-filter.md) | Row modifier | Filter a row based upon a condition. |
24+
| [Flatten](data-flow-flatten.md) | Schema modifier | Take array values inside hierarchical structures such as JSON and unroll them into individual rows. |
25+
| [Join](data-flow-join.md) | Multiple inputs/outputs | Combine data from two sources or streams. |
26+
| [Lookup](data-flow-lookup.md) | Multiple inputs/outputs | Reference data from another source. |
27+
| [New branch](data-flow-new-branch.md) | Multiple inputs/outputs | Apply multiple sets of operations and transformations against the same data stream. |
28+
| [Pivot](data-flow-pivot.md) | Schema modifier | An aggregation where one or more grouping columns has its distinct row values transformed into individual columns. |
29+
| [Select](data-flow-select.md) | Schema modifier | Alias columns and stream names, and drop or reorder columns |
30+
| [Sink](data-flow-sink.md) | - | A final destination for your data |
31+
| [Sort](data-flow-sort.md) | Row modifier | Sort incoming rows on the current data stream |
32+
| [Source](data-flow-source.md) | - | A data source for the data flow |
33+
| [Surrogate key](data-flow-surrogate-key.md) | Schema modifier | Add an incrementing non-business arbitrary key value |
34+
| [Union](data-flow-union.md) | Multiple inputs/outputs | Combine multiple data streams vertically |
35+
| [Unpivot](data-flow-unpivot.md) | Schema modifier | Pivot columns into row values |
36+
| [Window](data-flow-window.md) | Schema modifier | Define window-based aggregations of columns in your data streams. |

includes/azure-data-factory-limits.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ Azure Data Factory is a multitenant service that has the following default limit
1616

1717
| Resource | Default limit | Maximum limit |
1818
| -------- | ------------- | ------------- |
19-
| Data factories in an Azure subscription | 50 | [Contact support](https://azure.microsoft.com/blog/2014/06/04/azure-limits-quotas-increase-requests/). |
19+
| Data factories in an Azure subscription | 800 | [Contact support](https://azure.microsoft.com/blog/2014/06/04/azure-limits-quotas-increase-requests/). |
2020
| Total number of entities, such as pipelines, data sets, triggers, linked services, and integration runtimes, within a data factory | 5,000 | [Contact support](https://azure.microsoft.com/blog/2014/06/04/azure-limits-quotas-increase-requests/). |
2121
| Total CPU cores for Azure-SSIS Integration Runtimes under one subscription | 256 | [Contact support](https://azure.microsoft.com/blog/2014/06/04/azure-limits-quotas-increase-requests/). |
2222
| Concurrent pipeline runs per data factory that's shared among all pipelines in the factory | 10,000 | [Contact support](https://azure.microsoft.com/blog/2014/06/04/azure-limits-quotas-increase-requests/). |

0 commit comments

Comments
 (0)