Skip to content

Commit 78fa205

Browse files
authored
Merge pull request #96722 from djpmsft/docUpdates
updating wrangling docs
2 parents 329d612 + 7b996e7 commit 78fa205

File tree

3 files changed

+40
-7
lines changed

3 files changed

+40
-7
lines changed
86.1 KB
Loading

articles/data-factory/wrangling-data-flow-functions.md

Lines changed: 16 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -108,12 +108,21 @@ Keep and Remove Top, Keep Range (corresponding M functions,
108108
[Table.MinN](https://docs.microsoft.com/powerquery-m/table-minn),
109109
[Table.MaxN](https://docs.microsoft.com/powerquery-m/table-maxn))
110110

111-
## Known unsupported functionality
112-
113-
Below are functions that aren't supported. This list isn't exhaustive and is subject to change.
114-
* Merge columns (can be achieved with AddColumn)
115-
* Split column
116-
* Append queries
117-
* 'Use first row as headers' and 'Use headers as first row'
111+
## Known unsupported functions
112+
113+
| Function | Status |
114+
| -- | -- |
115+
| Table.PromoteHeaders | Not supported. The same result can be achieved by setting “First row as header” in the dataset. |
116+
| Table.CombineColumns | This is a common scenario that isn't directly supported but can be achieved by adding a new column that concatenates two given columns. For example, Table.AddColumn(RemoveEmailColumn, “Name”, each [FirstName] & ” ” & [LastName]) |
117+
| Table.TransformColumnTypes | This is supported in most cases. The following scenarios are unsupported: transforming string to currency type, transforming string to time type, transforming string to Percentage type. |
118+
| Table.NestedJoin | Just doing a join will result in a validation error. The columns must be expanded for it to work. |
119+
| Table.Distinct | Remove duplicate rows isn't supported. |
120+
| Table.RemoveLastN | Remove bottom rows isn't supported. |
121+
| Table.RowCount | Not supported, but can be achieved with an add column with all cells empty (condition column can be used) and then using group by on that column. Table.Group is supported. |
122+
| Row level error handling | Row level error handling is currently not supported. For example, to filter out non-numeric values from a column, one approach would be to transform the text column to a number. Every cell which fails to transform will be in an error state and need to be filtered. This scenario isn't possible in wrangling data flow. |
123+
| Table.Transpose | Not supported |
124+
| Table.Pivot | Not supported |
118125

119126
## Next steps
127+
128+
Learn how to [create a wrangling data flow](wrangling-data-flow-tutorial.md).

articles/data-factory/wrangling-data-flow-overview.md

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,30 @@ Citizen data integrators spend more than 60% of their time looking for and prepa
3434
Visually scan your data in a code-free manner to remove any outliers, anomalies,
3535
and conform it to a shape for fast analytics.
3636

37+
## Supported Sources
38+
39+
| Connector | Data format | Authentication type |
40+
| -- | -- | --|
41+
| [Azure Blob Storage](connector-azure-blob-storage.md) | CSV | Account Key |
42+
| [Azure Data Lake Storage Gen1](connector-azure-data-lake-store.md) | CSV | Service Principal |
43+
| [Azure Data Lake Storage Gen2](connector-azure-data-lake-storage.md) | CSV | Account Key, Service Principal |
44+
| [Azure SQL Database](connector-azure-sql-database.md) | - | SQL authentication |
45+
| [Azure Synapse Analytics](connector-azure-sql-data-warehouse.md) | - | SQL authentication |
46+
47+
## The mashup editor
48+
49+
When you create a wrangling data flow, all source datasets become dataset queries and are placed in the **ADFResource** folder. By default, the UserQuery will point to the first dataset query. All transformations should be done on the UserQuery as changes to dataset queries are not supported nor will they be persisted. Renaming, adding and deleting queries is currently not supported.
50+
51+
![Wrangling](media/wrangling-data-flow/editor.png)
52+
53+
Currently not all Power Query M functions are supported for data wrangling despite being available during authoring. While building your wrangling data flows, you'll be prompted with the following error message if a function isn't supported:
54+
55+
`The wrangling data flow is invalid. Expression.Error: The transformation logic isn't supported. Please try a simpler expression`
56+
57+
For more information on supported transformations, see [wrangling data flow functions](wrangling-data-flow-functions.md).
58+
59+
Currently wrangling data flow only supports writing to one sink.
60+
3761
## Next steps
3862

3963
Learn how to [create a wrangling data flow](wrangling-data-flow-tutorial.md).

0 commit comments

Comments
 (0)