Skip to content

Commit e844b93

Browse files
authored
Merge pull request #163846 from chugugrace/purview-ssis
add separate section for SSIS lineage
2 parents 810e03e + 99a7bfe commit e844b93

File tree

10 files changed

+79
-12
lines changed

10 files changed

+79
-12
lines changed
Lines changed: 76 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,76 @@
1+
---
2+
title: Lineage from SQL Server Integration Services
3+
description: This article describes the data lineage extraction from SQL Server Integration Services.
4+
author: chugugrace
5+
ms.author: chugu
6+
ms.service: purview
7+
ms.subservice: purview-data-catalog
8+
ms.topic: how-to
9+
ms.date: 06/30/2021
10+
---
11+
# How to get lineage from SQL Server Integration Services (SSIS) into Azure Purview
12+
13+
This article elaborates on the data lineage aspects of SQL Server Integration Services (SSIS) in Azure Purview.
14+
15+
## Prerequisites
16+
17+
- [Lift and shift SQL Server Integration Services workloads to the cloud](https://docs.microsoft.com/sql/integration-services/lift-shift/ssis-azure-lift-shift-ssis-packages-overview)
18+
19+
## Supported scenarios
20+
21+
The current scope of support includes the lineage extraction from SSIS packages executed by Azure Data Factory SSIS integration runtime.
22+
23+
On premises SSIS lineage extraction is not supported yet.
24+
25+
### Supported data stores
26+
27+
| Data store | Supported |
28+
| ------------------- | ------------------- |
29+
| Azure Blob Storage | Yes |
30+
| Azure Data Lake Storage Gen1 | Yes |
31+
| Azure Data Lake Storage Gen2 | Yes |
32+
| Azure File Storage | Yes |
33+
| Azure SQL Database \* | Yes |
34+
| Azure SQL Managed Instance \*| Yes |
35+
| Azure Synapse Analytics \* | Yes |
36+
| SQL Server \* | Yes |
37+
38+
*\* Azure Purview currently doesn't support query or stored procedure for lineage or scanning. Lineage is limited to table and view sources only.*
39+
40+
41+
## How to bring SSIS lineage into Purview
42+
43+
### Step 1. [Connect a Data Factory to Azure Purview](how-to-link-azure-data-factory.md)
44+
45+
### Step 2. Trigger SSIS activity execution in Azure Data Factory
46+
47+
You can [run SSIS package with Execute SSIS Package activity](../data-factory/how-to-invoke-ssis-package-ssis-activity.md) or [run SSIS package with Transact-SQL in ADF SSIS Integration Runtime](../data-factory/how-to-invoke-ssis-package-stored-procedure-activity.md).
48+
49+
Once Execute SSIS Package activity finishes the execution, you can check lineage report status from the activity output in [Data Factory activity monitor](../data-factory/monitor-visually.md#monitor-activity-runs).
50+
:::image type="content" source="media/how-to-lineage-sql-server-integration-services/activity-report-lineage-status.png" alt-text="ssis-status":::
51+
52+
### Step 3. Browse lineage Information in your Azure Purview account
53+
54+
- You can browse the Data Catalog by choosing asset type “SQL Server Integration Services”.
55+
56+
:::image type="content" source="media/how-to-lineage-sql-server-integration-services/browse-assets-1.png" alt-text="Browser assets" lightbox="media/how-to-lineage-sql-server-integration-services/browse-assets-1.png":::
57+
:::image type="content" source="media/how-to-lineage-sql-server-integration-services/browse-assets-2.png" alt-text="browser-assets-ssis":::
58+
:::image type="content" source="media/how-to-lineage-sql-server-integration-services/browse-assets-3.png" alt-text="browse-assets-ssis-package":::
59+
60+
- You can also search the Data Catalog using keywords.
61+
62+
:::image type="content" source="media/how-to-lineage-sql-server-integration-services/search-assets.png" alt-text="search-ssis" lightbox="media/how-to-lineage-sql-server-integration-services/search-assets.png":::
63+
64+
- You can view lineage information for an SSIS Execute Package activity and open in Data Factory to view/edit the activity settings.
65+
66+
:::image type="content" source="media/how-to-lineage-sql-server-integration-services/lineage.png" alt-text="show-ssis-lineage" lightbox="media/how-to-lineage-sql-server-integration-services/lineage.png":::
67+
68+
- You can choose one data source to drill into how the columns in the source are mapped to the columns in the destination.
69+
70+
:::image type="content" source="media/how-to-lineage-sql-server-integration-services/lineage-drill-in.png" alt-text="show-ssis-lineage-drill-in" lightbox="media/how-to-lineage-sql-server-integration-services/lineage-drill-in.png":::
71+
72+
## Next steps
73+
74+
- [Lift and shift SQL Server Integration Services workloads to the cloud](https://docs.microsoft.com/sql/integration-services/lift-shift/ssis-azure-lift-shift-ssis-packages-overview)
75+
- [Learn about Data lineage in Azure Purview](catalog-lineage-user-guide.md)
76+
- [Link Azure Data Factory to push automated lineage](how-to-link-azure-data-factory.md)

articles/purview/how-to-link-azure-data-factory.md

Lines changed: 1 addition & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -165,18 +165,7 @@ In additional to lineage, the data asset schema (shown in Asset -> Schema tab) i
165165

166166
### Data Factory Execute SSIS Package support
167167

168-
| Data store | Supported |
169-
| ------------------- | ------------------- |
170-
| Azure Blob Storage | Yes |
171-
| Azure Data Lake Storage Gen1 | Yes |
172-
| Azure Data Lake Storage Gen2 | Yes |
173-
| Azure File Storage | Yes |
174-
| Azure SQL Database \* | Yes |
175-
| Azure SQL Managed Instance \*| Yes |
176-
| Azure Synapse Analytics \* | Yes |
177-
| SQL Server \* | Yes |
178-
179-
*\* Azure Purview currently doesn't support query or stored procedure for lineage or scanning. Lineage is limited to table and view sources only.*
168+
Refer to [supported data stores](how-to-lineage-sql-server-integration-services.md#supported-data-stores).
180169

181170
> [!Note]
182171
> Azure Data Lake Storage Gen2 is now generally available. We recommend that you start using it today. For more information, see the [product page](https://azure.microsoft.com/en-us/services/storage/data-lake-storage/).
48.4 KB
Loading
78.8 KB
Loading
29.7 KB
Loading
16 KB
Loading
91.4 KB
Loading
100 KB
Loading
109 KB
Loading

articles/purview/toc.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -175,6 +175,8 @@ items:
175175
href: how-to-lineage-powerbi.md
176176
- name: Spark lineage
177177
href: how-to-lineage-spark-atlas-connector.md
178+
- name: SQL Server Integration Services lineage
179+
href: how-to-lineage-sql-server-integration-services.md
178180
- name: Monitor
179181
items:
180182
- name: Monitor with Azure Monitor

0 commit comments

Comments
 (0)