Skip to content

Commit d17f0a0

Browse files
authored
Create tutorial-data-flow-sql-server.md
1 parent a32c61b commit d17f0a0

File tree

1 file changed

+63
-0
lines changed

1 file changed

+63
-0
lines changed
Lines changed: 63 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,63 @@
1+
---
2+
title: Ingest and transform data from SQL Server to Azure SQL Database | Microsoft Docs
3+
description: This tutorial provides step-by-step instructions for transforming data coming from on-prem SQL Server using ADF with Mapping Data Flows.
4+
services: data-factory
5+
author: kromerm
6+
ms.service: data-factory
7+
ms.workload: data-services
8+
ms.date: 05/23/2019
9+
ms.author: makromer
10+
---
11+
12+
# Copy data from Azure Blob to Azure SQL Database using Azure Data Factory
13+
14+
Azure Data Factory is a cloud-based data integration service that allows you to create data-driven workflows in the cloud for orchestrating and automating data movement and data transformation. Using Azure Data Factory, you can create and schedule data-driven workflows (called pipelines) that can ingest data from disparate data stores, process/transform the data by using compute services such as Azure HDInsight Hadoop, Spark, Azure Data Lake Analytics, and Azure Machine Learning, and publish output data to data stores such as Azure SQL Data Warehouse for business intelligence (BI) applications to consume.
15+
16+
In this tutorial, you create a Data Factory pipeline that copies data from Azure Blob Storage to Azure SQL Database. The configuration pattern in this tutorial applies to copying from a file-based data store to a relational data store. For a list of data stores supported as sources and sinks, see [supported data stores](copy-activity-overview.md#supported-data-stores-and-formats) table.
17+
18+
You perform the following steps in this tutorial:
19+
20+
> [!div class="checklist"]
21+
> * Create a data factory.
22+
> * Create Azure Storage and Azure SQL Database linked services.
23+
> * Create Azure BLob and Azure SQL Database datasets.
24+
> * Create a pipeline contains a Copy activity.
25+
> * Start a pipeline run.
26+
> * Monitor the pipeline and activity runs.
27+
28+
This tutorial uses .NET SDK. You can use other mechanisms to interact with Azure Data Factory, refer to samples under "Quickstarts".
29+
30+
If you don't have an Azure subscription, create a [free](https://azure.microsoft.com/free/) account before you begin.
31+
32+
## Prerequisites
33+
34+
* **Azure Storage account**. You use the blob storage as **source** data store. If you don't have an Azure storage account, see the [Create a storage account](../storage/common/storage-create-storage-account.md#create-a-storage-account) article for steps to create one.
35+
* **Azure SQL Database**. You use the database as **sink** data store. If you don't have an Azure SQL Database, see the [Create an Azure SQL database](../sql-database/sql-database-get-started-portal.md) article for steps to create one.
36+
* **Visual Studio** 2015, or 2017. The walkthrough in this article uses Visual Studio 2017.
37+
* **Download and install [Azure .NET SDK](http://azure.microsoft.com/downloads/)**.
38+
* **Create an application in Azure Active Directory** following [this instruction](../azure-resource-manager/resource-group-create-service-principal-portal.md#create-an-azure-active-directory-application). Make note of the following values that you use in later steps: **application ID**, **authentication key**, and **tenant ID**. Assign application to "**Contributor**" role by following instructions in the same article.
39+
40+
### Create a blob and a SQL table
41+
42+
Now, prepare your Azure Blob and Azure SQL Database for the tutorial by performing the following steps:
43+
44+
#### Create a source blob
45+
46+
47+
48+
## Next steps
49+
The pipeline in this sample copies data from one location to another location in an Azure blob storage. You learned how to:
50+
51+
> [!div class="checklist"]
52+
> * Create a data factory.
53+
> * Create Azure Storage and Azure SQL Database linked services.
54+
> * Create Azure Blob and Azure SQL Database datasets.
55+
> * Create a pipeline contains a Copy activity.
56+
> * Start a pipeline run.
57+
> * Monitor the pipeline and activity runs.
58+
59+
60+
Advance to the following tutorial to learn about copying data from on-premises to cloud:
61+
62+
> [!div class="nextstepaction"]
63+
>[Copy data from on-premises to cloud](tutorial-hybrid-copy-powershell.md)

0 commit comments

Comments
 (0)