You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/wrangling-data-flow-functions.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
---
2
2
title: Wrangling data flow transformation functions in Azure Data Factory | Microsoft Docs
3
-
description: An overview of available wrangling data flow fucntions in Azure Data Factory
3
+
description: An overview of available wrangling data flow functions in Azure Data Factory
4
4
author: djpmsft
5
5
ms.author: daperlov
6
6
ms.reviewer: gamal
@@ -13,9 +13,9 @@ ms.date: 11/01/2019
13
13
14
14
Wrangling data flow in Azure Data Factory allows you to do code-free agile data preparation and wrangling at cloud scale. Wrangling data flow integrates with [Power Query Online](https://docs.microsoft.com/powerquery-m/power-query-m-reference) and makes Power Query M functions available for data wrangling via spark execution.
15
15
16
-
Currently not all Power Query M functions are supported for data wrangling despite being available during authoring. While building your wrangling data flows, you will be prompted with the following error message if a function is not supported:
16
+
Currently not all Power Query M functions are supported for data wrangling despite being available during authoring. While building your wrangling data flows, you'll be prompted with the following error message if a function isn't supported:
17
17
18
-
`The wrangling data flow is invalid. Expression.Error: The transformation logic is not supported. Please try a simpler expression`
18
+
`The wrangling data flow is invalid. Expression.Error: The transformation logic isn't supported. Please try a simpler expression`
19
19
20
20
Below is a list of supported Power Query M functions.
21
21
@@ -44,7 +44,7 @@ The following M functions add or transform columns: [Table.AddColumn](https://do
* Durations can be used for date and time arithmetic, but must be transformed into some other type before being written to a sink (Arithmetic operators, [#duration](https://docs.microsoft.com/powerquery-m/sharpduration), [Duration.Days](https://docs.microsoft.com/powerquery-m/duration-days), [Duration.Hours](https://docs.microsoft.com/powerquery-m/duration-hours), [Duration.Minutes](https://docs.microsoft.com/powerquery-m/duration-minutes), [Duration.Seconds](https://docs.microsoft.com/powerquery-m/duration-seconds), [Duration.TotalDays](https://docs.microsoft.com/powerquery-m/duration-totaldays), [Duration.TotalHours](https://docs.microsoft.com/powerquery-m/duration-totalhours), [Duration.TotalMinutes](https://docs.microsoft.com/powerquery-m/duration-totalminutes), [Duration.TotalSeconds](https://docs.microsoft.com/powerquery-m/duration-totalseconds))
47
+
* Durations can be used for date and time arithmetic, but must be transformed into another type before written to a sink (Arithmetic operators, [#duration](https://docs.microsoft.com/powerquery-m/sharpduration), [Duration.Days](https://docs.microsoft.com/powerquery-m/duration-days), [Duration.Hours](https://docs.microsoft.com/powerquery-m/duration-hours), [Duration.Minutes](https://docs.microsoft.com/powerquery-m/duration-minutes), [Duration.Seconds](https://docs.microsoft.com/powerquery-m/duration-seconds), [Duration.TotalDays](https://docs.microsoft.com/powerquery-m/duration-totaldays), [Duration.TotalHours](https://docs.microsoft.com/powerquery-m/duration-totalhours), [Duration.TotalMinutes](https://docs.microsoft.com/powerquery-m/duration-totalminutes), [Duration.TotalSeconds](https://docs.microsoft.com/powerquery-m/duration-totalseconds))
48
48
* Most standard, scientific, and trigonometric numeric functions (All functions under [Operations](https://docs.microsoft.com/powerquery-m/number-functions#operations), [Rounding](https://docs.microsoft.com/powerquery-m/number-functions#rounding), and [Trigonometry](https://docs.microsoft.com/powerquery-m/number-functions#trigonometry)*except* Number.Factorial, Number.Permutations, and Number.Combinations)
Copy file name to clipboardExpand all lines: articles/data-factory/wrangling-data-flow-overview.md
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,27 +11,27 @@ ms.date: 11/01/2019
11
11
12
12
# What are wrangling data flows?
13
13
14
-
Organizations need to do data preparation and wrangling for accurate analysis of complex data that continues to grow every day. Data preparation is also required so that organizations can use the data effectively in various business processes and reduce the time to value.
14
+
Organizations need to do data preparation and wrangling for accurate analysis of complex data that continues to grow every day. Data preparation is required so that organizations can use the data in various business processes and reduce the time to value.
15
15
16
-
Wrangling data flows in Azure Data Factory allow you to do code-free data preparation at cloud scale iteratively. Wrangling data flows integrate with [Power Query Online](https://docs.microsoft.com/power-query/) and makes Power Query M functions available for data wrangling at cloud scale via spark execution.
16
+
Wrangling data flows in Azure Data Factory allow you to do code-free data preparation at cloud scale iteratively. Wrangling data flows integrate with [Power Query Online](https://docs.microsoft.com/power-query/) and makes Power Query M functions available for data factory users.
17
17
18
-
Wrangling data flow translates M generated by the Power Query Online Mashup Editor into spark code for cloud scale execution and provides best in class monitoring experience.
18
+
Wrangling data flow translates M generated by the Power Query Online Mashup Editor into spark code for cloud scale execution.
19
19
20
20
Wrangling data flows are especially useful for data engineers or 'citizen data integrators'.
21
21
22
22
## Use cases
23
23
24
24
### Fast interactive data exploration and preparation
25
25
26
-
Multiple data engineers and citizen data integrators can interactively explore and prepare datasets at cloud scale. With the rise of volume, variety and velocity of data in data lakes, sometimes you need to explore and prepare a data set or are asked to create a new dataset. For example, you may need to create a dataset that 'has all customer demographic info for new customers since 2017'. You aren't mapping to a known target. You're exploring, wrangling, and prepping datasets to meet a requirement before publishing it in the lake. These are often used for less formal analytics scenarios. The prepped datasets can be used for doing transformations and machine learning operations downstream.
26
+
Multiple data engineers and citizen data integrators can interactively explore and prepare datasets at cloud scale. With the rise of volume, variety and velocity of data in data lakes, users need an effective way to explore and prepare data sets. For example, you may need to create a dataset that 'has all customer demographic info for new customers since 2017'. You aren't mapping to a known target. You're exploring, wrangling, and prepping datasets to meet a requirement before publishing it in the lake. Wrangling data flows are often used for less formal analytics scenarios. The prepped datasets can be used for doing transformations and machine learning operations downstream.
27
27
28
28
### Code-free agile data preparation
29
29
30
-
Citizen data integrators spend more than 60% of their time looking for and preparing data. They're looking to do it in a code free manner to improve operational productivity. Allowing citizen data integrators to enrich, shape, and publish data using known tools like Power Query Online in a scalable manner drastically improves their productivity. Wrangling data flow in Azure Data Factory enables the familiar Power Query Online mashup editor to allow citizen data integrators to fix errors quickly, standardize data, and produce highquality data to support business decision makers.
30
+
Citizen data integrators spend more than 60% of their time looking for and preparing data. They're looking to do it in a code free manner to improve operational productivity. Allowing citizen data integrators to enrich, shape, and publish data using known tools like Power Query Online in a scalable manner drastically improves their productivity. Wrangling data flow in Azure Data Factory enables the familiar Power Query Online mashup editor to allow citizen data integrators to fix errors quickly, standardize data, and produce high-quality data to support business decisions.
31
31
32
32
### Data Validation
33
33
34
-
Visually scan your data in a code-free manner to remove any outliers, anomalies
34
+
Visually scan your data in a code-free manner to remove any outliers, anomalies,
0 commit comments