Skip to content

Commit 29ec13c

Browse files
authored
Merge pull request #100560 from chugugrace/vnet
vnet tutial
2 parents 1b1c8ff + f37ac84 commit 29ec13c

File tree

3 files changed

+159
-1
lines changed

3 files changed

+159
-1
lines changed

articles/data-factory/TOC.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -132,6 +132,8 @@
132132
href: tutorial-deploy-ssis-packages-azure.md
133133
- name: Azure PowerShell
134134
href: tutorial-deploy-ssis-packages-azure-powershell.md
135+
- name: Join virtual network
136+
href: tutorial-deploy-ssis-virtual-network.md
135137
- name: End-to-end labs
136138
items:
137139
- name: Data integration using data factory and data share

articles/data-factory/join-azure-ssis-integration-runtime-virtual-network.md

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,11 +25,21 @@ When using SQL Server Integration Services (SSIS) in Azure Data Factory, you sho
2525

2626
- You want to connect to data stores/resources configured with IP firewall rules from SSIS packages that run on your Azure-SSIS IR.
2727

28-
Data Factory lets you join your Azure-SSIS IR to a virtual network created through the classic deployment model or the Azure Resource Manager deployment model.
28+
Data Factory lets you join your Azure-SSIS IR to a virtual network created through the classic deployment model or the Azure Resource Manager deployment model.
2929

3030
> [!IMPORTANT]
3131
> The classic virtual network is being deprecated, so use the Azure Resource Manager virtual network instead. If you already use the classic virtual network, switch to the Azure Resource Manager virtual network as soon as possible.
3232
33+
The [configuring an Azure-SQL Server Integration Services (SSIS) integration runtime (IR) to join a virtual network](tutorial-deploy-ssis-virtual-network.md) tutorial shows the minimum steps via Azure portal. This article expands on the tutorial and describes all the optional tasks:
34+
35+
- If you are using virtual network (classic).
36+
- If you bring your own public IP addresses for the Azure-SSIS IR.
37+
- If you use your own Domain Name System (DNS) server.
38+
- If you use a network security group (NSG) on the subnet.
39+
- If you use Azure ExpressRoute or a user-defined route (UDR).
40+
- If you use customized Azure-SSIS IR.
41+
- If you use Azure Powershell provisioning.
42+
3343
## Access to on-premises data stores
3444

3545
If your SSIS packages access on-premises data stores, you can join your Azure-SSIS IR to a virtual network that is connected to the on-premises network. Or you can configure and manage a self-hosted IR as proxy for your Azure-SSIS IR. For more information, see [Configure a self-hosted IR as a proxy for an Azure-SSIS IR](https://docs.microsoft.com/azure/data-factory/self-hosted-integration-runtime-proxy-ssis).
Lines changed: 146 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,146 @@
1+
---
2+
title: Tutorial to configure an Azure-SSIS integration runtime to join a virtual network
3+
description: Learn how to join an Azure-SSIS integration runtime to an Azure virtual network.
4+
services: data-factory
5+
documentationcenter: ''
6+
author: chugugrace
7+
ms.author: chugu
8+
ms.reviewer:
9+
manager:
10+
ms.service: data-factory
11+
ms.workload: data-services
12+
13+
ms.topic: conceptual
14+
ms.date: 1/10/2020
15+
---
16+
# Configure an Azure-SQL Server Integration Services (SSIS) integration runtime (IR) to join a virtual network
17+
18+
This tutorial provides basic steps for using the Azure portal to configure an Azure-SQL Server Integration Services (SSIS) integration runtime (IR) to join a virtual network.
19+
20+
The steps include:
21+
22+
- Configure a virtual network.
23+
- Join the Azure-SSIS IR to a virtual network from Azure Data Factory portal.
24+
25+
## Prerequisites
26+
27+
- **Azure-SSIS integration runtime**. If you do not have an Azure-SSIS integration runtime, [provision an Azure-SSIS integration runtime in Azure Data Factory](tutorial-deploy-ssis-packages-azure.md) before begin.
28+
29+
- **User permission**. The user who creates the Azure-SSIS IR must have the following [role assignment](https://docs.microsoft.com/azure/role-based-access-control/role-assignments-list-portal#list-role-assignments-for-a-user-at-a-scope) at least on Azure Data Factory resource:
30+
31+
- Use the built-in Network Contributor role. This role comes with the _Microsoft.Network/\*_ permission, which has a much larger scope than necessary.
32+
- Create a custom role that includes only the necessary _Microsoft.Network/virtualNetworks/\*/join/action_ permission. If you also want to bring your own public IP addresses for Azure-SSIS IR while joining it to an Azure Resource Manager virtual network, please also include _Microsoft.Network/publicIPAddresses/*/join/action_ permission in the role.
33+
34+
- **Virtual network**.
35+
36+
- If you do not have a virtual network, [create a virtual network using the Azure portal](https://docs.microsoft.com/azure/virtual-network/quick-create-portal).
37+
38+
- Make sure that the virtual network's resource group can create and delete certain Azure network resources.
39+
40+
The Azure-SSIS IR needs to create certain network resources under the same resource group as the virtual network. These resources include:
41+
- An Azure load balancer, with the name *\<Guid>-azurebatch-cloudserviceloadbalancer*
42+
- A network work security group, with the name *\<Guid>-azurebatch-cloudservicenetworksecuritygroup
43+
44+
Those resources will be created when your Azure-SSIS IR starts. They'll be deleted when your Azure-SSIS IR stops. To avoid blocking your Azure-SSIS IR from stopping, don't reuse these network resources in your other resources.
45+
46+
- Make sure that you have no [resource lock](https://docs.microsoft.com/azure/azure-resource-manager/management/lock-resources) on the resource group/subscription to which the virtual network belongs. If you configure a read-only/delete lock, starting and stopping your Azure-SSIS IR will fail, or it will stop responding.
47+
48+
- Make sure that you don't have an Azure policy that prevents the following resources from being created under the resource group/subscription to which the virtual network belongs:
49+
- Microsoft.Network/LoadBalancers
50+
- Microsoft.Network/NetworkSecurityGroups
51+
52+
- Below **network configuration** scenarios are not covered in this tutorial:
53+
- If you bring your own public IP addresses for the Azure-SSIS IR.
54+
- If you use your own Domain Name System (DNS) server.
55+
- If you use a network security group (NSG) on the subnet.
56+
- If you use Azure ExpressRoute or a user-defined route (UDR).
57+
- If you use customized Azure-SSIS IR.
58+
59+
For more info, check [virtual network configuration](join-azure-ssis-integration-runtime-virtual-network.md#virtual-network-configuration).
60+
61+
## Configure a virtual network
62+
63+
Use the Azure portal to a virtual network before you try to join an Azure-SSIS IR to it.
64+
65+
1. Start Microsoft Edge or Google Chrome. Currently, only these web browsers support the Data Factory UI.
66+
67+
1. Sign in to the [Azure portal](https://portal.azure.com).
68+
69+
1. Select **More services**. Filter for and select **Virtual networks**.
70+
71+
1. Filter for and select your virtual network in the list.
72+
73+
1. On the **Virtual network** page, select **Properties**.
74+
75+
1. Select the copy button for **RESOURCE ID** to copy the resource ID for the virtual network to the clipboard. Save the ID from the clipboard in OneNote or a file.
76+
77+
1. On the left menu, select **Subnets**.
78+
79+
- Ensure that the subnet you select has enough available address space for the Azure-SSIS IR to use. Leave available IP addresses for at least two times the IR node number. Azure reserves some IP addresses within each subnet. These addresses can't be used. The first and last IP addresses of the subnets are reserved for protocol conformance, and three more addresses are used for Azure services. For more information, see [Are there any restrictions on using IP addresses within these subnets?](../virtual-network/virtual-networks-faq.md#are-there-any-restrictions-on-using-ip-addresses-within-these-subnets)
80+
- Don't select the GatewaySubnet to deploy an Azure-SSIS IR. It's dedicated for virtual network gateways.
81+
- Don’t use a subnet that is exclusively occupied by other Azure services (for example, SQL Database managed instance, App Service, and so on).
82+
83+
1. Verify that the Azure Batch provider is registered in the Azure subscription that has the virtual network. Or register the Azure Batch provider. If you already have an Azure Batch account in your subscription, your subscription is registered for Azure Batch. (If you create the Azure-SSIS IR in the Data Factory portal, the Azure Batch provider is automatically registered for you.)
84+
85+
1. In the Azure portal, on the left menu, select **Subscriptions**.
86+
87+
1. Select your subscription.
88+
89+
1. On the left, select **Resource providers**, and confirm that **Microsoft.Batch** is a registered provider.
90+
91+
![Confirmation of "Registered" status](media/join-azure-ssis-integration-runtime-virtual-network/batch-registered-confirmation.png)
92+
93+
If you don't see **Microsoft.Batch** in the list, to register it, [create an empty Azure Batch account](../batch/batch-account-create-portal.md) in your subscription. You can delete it later.
94+
95+
## Join the Azure-SSIS IR to a virtual network
96+
97+
After you've configured your Azure Resource Manager virtual network or classic virtual network, you can join the Azure-SSIS IR to the virtual network:
98+
99+
1. Start Microsoft Edge or Google Chrome. Currently, only these web browsers support the Data Factory UI.
100+
101+
1. In the [Azure portal](https://portal.azure.com), on the left menu, select **Data factories**. If you don't see **Data factories** on the menu, select **More services**, and then in the **INTELLIGENCE + ANALYTICS** section, select **Data factories**.
102+
103+
![List of data factories](media/join-azure-ssis-integration-runtime-virtual-network/data-factories-list.png)
104+
105+
1. Select your data factory with the Azure-SSIS IR in the list. You see the home page for your data factory. Select the **Author & Deploy** tile. You see the Data Factory UI on a separate tab.
106+
107+
![Data factory home page](media/join-azure-ssis-integration-runtime-virtual-network/data-factory-home-page.png)
108+
109+
1. In the Data Factory UI, switch to the **Edit** tab, select **Connections**, and switch to the **Integration Runtimes** tab.
110+
111+
!["Integration runtimes" tab](media/join-azure-ssis-integration-runtime-virtual-network/integration-runtimes-tab.png)
112+
113+
1. If your Azure-SSIS IR is running, in the **Integration Runtimes** list, in the **Actions** column, select the **Stop** button for your Azure-SSIS IR. You can't edit your Azure-SSIS IR until you stop it.
114+
115+
![Stop the IR](media/join-azure-ssis-integration-runtime-virtual-network/stop-ir-button.png)
116+
117+
1. In the **Integration Runtimes** list, in the **Actions** column, select the **Edit** button for your Azure-SSIS IR.
118+
119+
![Edit the integration runtime](media/join-azure-ssis-integration-runtime-virtual-network/integration-runtime-edit.png)
120+
121+
1. On the integration runtime setup panel, advance through the **General Settings** and **SQL Settings** sections by selecting the **Next** button.
122+
123+
1. On the **Advanced Settings** section:
124+
1. Select the **Select a VNet for your Azure-SSIS Integration Runtime to join, allow ADF to create certain network resources, and optionally bring your own static public IP addresses** check box.
125+
126+
1. For **Subscription**, select the Azure subscription that has your virtual network.
127+
128+
1. For **Location**, the same location of your integration runtime is selected.
129+
130+
1. For **Type**, select the type of your virtual network: classic or Azure Resource Manager. We recommend that you select an Azure Resource Manager virtual network, because classic virtual networks will be deprecated soon.
131+
132+
1. For **VNet Name**, select the name of your virtual network. It should be the same one used for your Azure SQL Database server with virtual network service endpoints or managed instance with private endpoint to host SSISDB. Or it should be the same one connected to your on-premises network. Otherwise, it can be any virtual network to bring your own static public IP addresses for Azure-SSIS IR.
133+
134+
1. For **Subnet Name**, select the name of subnet for your virtual network. It should be the same one used for your Azure SQL Database server with virtual network service endpoints to host SSISDB. Or it should be a different subnet from the one used for your managed instance with private endpoint to host SSISDB. Otherwise, it can be any subnet to bring your own static public IP addresses for Azure-SSIS IR.
135+
136+
1. Select **VNet Validation**. If the validation is successful, select **Continue**.
137+
138+
![Advanced settings with a virtual network](./media/tutorial-create-azure-ssis-runtime-portal/advanced-settings-vnet.png)
139+
140+
1. On the **Summary** section, review all settings for your Azure-SSIS IR. Then select **Update**.
141+
142+
1. Start your Azure-SSIS IR by selecting the **Start** button in the **Actions** column for your Azure-SSIS IR. It takes about 20 to 30 minutes to start the Azure-SSIS IR that joins a virtual network.
143+
144+
## Next Steps
145+
146+
Learn more about [joining Azure-SSIS IR to a virtual network](join-azure-ssis-integration-runtime-virtual-network.md).

0 commit comments

Comments
 (0)