Skip to content

Commit ce7d05f

Browse files
authored
Merge pull request #179598 from joshuha-msft/master
Added Map Data overview to Azure Synapse Analytics
2 parents f5b38dc + 6b5a537 commit ce7d05f

File tree

7 files changed

+87
-1
lines changed

7 files changed

+87
-1
lines changed
76 KB
Loading
32.8 KB
Loading
131 KB
Loading
246 KB
Loading
61.1 KB
Loading
Lines changed: 83 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,83 @@
1+
---
2+
title: Map Data in Azure Synapse Analytics | Microsoft Docs
3+
description: Learn how to use the Map Data tool in Azure Synapse Analytics
4+
author: joshuha-msft
5+
ms.author: joowen
6+
ms.service: synapse-analytics
7+
ms.subservice: database-editor
8+
ms.topic: overview
9+
ms.date: 11/11/2021
10+
---
11+
12+
# Map Data in Azure Synapse Analytics
13+
14+
## What is the Map Data tool?
15+
16+
The Map Data tool is a guided process to help users create ETL mappings and mapping data flows from their source data to Synapse lake database tables without writing code. This process starts with the user choosing the destination tables in Synapse lake databases and then mapping their source data into these tables.
17+
18+
For more information on Synapse lake databases see [Overview of Azure Synapse database templates - Azure Synapse Analytics | Microsoft Docs](overview-database-templates.md)
19+
20+
Map Data provides for a guided experience where the user can generate a mapping data flow without having to start with a blank canvas and quickly generate a scalable mapping data flow runnable in Synapse pipelines.
21+
22+
[!NOTE] The Map Data feature in Synapse Analytics pipelines is currently in public preview
23+
24+
## Getting Started
25+
The Map Data tool is started from within the Synapse lake database experience. From here, you can select the Map Data tool to begin the process.
26+
27+
![Screenshot showing how to open an Map data](./media/overview-map-data/open-map-data.png)
28+
29+
30+
Map Data needs compute available to assist users with previewing data and reading schema of their source files. Upon using Map Data for the first time in a session you will need to warm up a cluster.
31+
![Screenshot showing debug clusters](./media/overview-map-data/debug-map-data.png)
32+
33+
To begin, choose your data source that you want to map to your lake database tables. Currently supported data sources are Azure Data Lake Storage Gen 2 and Synapse lake databases.
34+
![Screenshot showing sources](./media/overview-map-data/sources-map-data.png)
35+
36+
### File type options
37+
When choosing a file store such as Azure Data Lake Storage Gen 2 the following file types are supported:
38+
39+
* Common Data Model
40+
* Delimited Text
41+
* Parquet
42+
43+
## Create Data Mapping
44+
Name your data mapping and select the Synapse lake database destination.
45+
![Screenshot showing naming and destination](./media/overview-map-data/destination-map-data.png)
46+
47+
## Source to Target Mapping
48+
Choose a Primary source table to map to the Synapse lake database destination table.
49+
![Screenshot showing Map data rules](./media/overview-map-data/rules-map-data.png)
50+
51+
### New Mapping
52+
Use the New Mapping button to add a mapping method to create a mapping or transformation.
53+
54+
### Additional Source
55+
Use the Additional source button to join to and add another source to your mapping.
56+
57+
### Preview Data
58+
The **Data Preview** tab gives you an interactive snapshot of the data of each transform. For more information, see [Data preview in debug mode](../../data-factory/concepts-data-flow-debug-mode.md#data-preview).
59+
60+
### Mapping Methods
61+
The following mapping methods are supported:
62+
63+
* [Direct](../../data-factory/data-flow-select.md)
64+
* [Surrogate Key](../../data-factory/data-flow-surrogate-key.md)
65+
* [Lookup](../../data-factory/data-flow-lookup.md)
66+
* [Unpivot](../../data-factory/data-flow-unpivot.md)
67+
* [Aggregate](../../data-factory/data-flow-aggregate.md)
68+
* Sum
69+
* Minimum
70+
* Maximum
71+
* First
72+
* Last
73+
* Standard Deviation
74+
* Average
75+
* Mean
76+
* [Derived Column](../../data-factory/data-flow-derived-column.md)
77+
* Trim
78+
* Upper
79+
* Lower
80+
* Advanced
81+
82+
## Create Pipeline
83+
Once you are done with your Map Data transformations select the Create pipeline button to generate a mapping data flow and pipeline to debug and run your transformation.

articles/synapse-analytics/toc.yml

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -217,6 +217,9 @@ items:
217217
- name: Database templates overview
218218
href: database-designer/overview-database-templates.md
219219
displayName: overview
220+
- name: Map data overview
221+
href: database-designer/overview-map-data.md
222+
displayName: map data
220223
- name: Quickstarts
221224
items:
222225
- name: Create a lake database
@@ -226,7 +229,7 @@ items:
226229
- name: Database templates
227230
href: database-designer/concepts-database-templates.md
228231
- name: Lake database
229-
href: database-designer/concepts-lake-database.md
232+
href: database-designer/concepts-lake-database.md
230233
- name: How-to guides
231234
items:
232235
- name: Create an empty lake database

0 commit comments

Comments
 (0)