You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|[Run pipeline and report lineage to Microsoft Purview](tutorial-push-lineage-to-purview.md)| For Data Factory pipeline to push lineage to Microsoft Purview, Microsoft Purview ***account*** and ***ingestion*** private endpoints are required. <br>- When using **Azure Integration Runtime**, follow the steps in [Managed private endpoints for Microsoft Purview](#managed-private-endpoints-for-microsoft-purview) section to create managed private endpoints in the Data Factory managed virtual network.<br>- When using **Self-hosted Integration Runtime**, follow the steps in [this section](../purview/catalog-private-link-end-to-end.md#option-2---enable-account-portal-and-ingestion-private-endpoint-on-existing-azure-purview-accounts) to create the *account* and *ingestion* private endpoints in your integration runtime's virtual network. |
25
-
|[Discover and explore data using Microsoft Purview on ADF UI](how-to-discover-explore-purview-data.md)| To use the search bar at the top center of Data Factory authoring UI to search for Microsoft Purview data and perform actions, you need to create Microsoft Purview ***account*** and ***portal*** private endpoints in the virtual network that you launch the Data Factory Studio. Follow the steps in [Enable *account* and *portal* private endpoint](../purview/catalog-private-link-account-portal.md#option-2---enable-account-and-portal-private-endpoint-on-existing-azure-purview-accounts). |
24
+
|[Run pipeline and report lineage to Microsoft](tutorial-push-lineage-to-purview.md)| For Data Factory pipeline to push lineage to Microsoft, Microsoft Purview ***account*** and ***ingestion*** private endpoints are required. <br>- When using **Azure Integration Runtime**, follow the steps in [Managed private endpoints for Microsoft Purview](#managed-private-endpoints-for-microsoft-purview) section to create managed private endpoints in the Data Factory managed virtual network.<br>- When using **Self-hosted Integration Runtime**, follow the steps in [this section](../purview/catalog-private-link-end-to-end.md#option-2---enable-account-portal-and-ingestion-private-endpoint-on-existing-microsoft-purview-accounts) to create the *account* and *ingestion* private endpoints in your integration runtime's virtual network. |
25
+
|[Discover and explore data using Microsoft on ADF UI](how-to-discover-explore-purview-data.md)| To use the search bar at the top center of Data Factory authoring UI to search for Microsoft Purview data and perform actions, you need to create Microsoft Purview ***account*** and ***portal*** private endpoints in the virtual network that you launch the Data Factory Studio. Follow the steps in [Enable *account* and *portal* private endpoint](../purview/catalog-private-link-account-portal.md#option-2---enable-account-and-portal-private-endpoint-on-existing-microsoft-purview-accounts). |
26
26
27
27
## Managed private endpoints for Microsoft Purview
# View, edit and delete assets in Azure Purview catalog
11
+
# View, edit and delete assets in Microsoft Purview catalog
12
12
13
13
This article discusses how you can view your assets and their relevant details. It also describes how you can edit and delete assets from your catalog.
14
14
15
15
## Prerequisites
16
16
17
17
- Set up your data sources and scan the assets into your catalog.
18
-
-*Or* Use the Azure Purview Atlas APIs to ingest assets into the catalog.
18
+
-*Or* Use the Microsoft Purview Atlas APIs to ingest assets into the catalog.
19
19
20
20
## Viewing asset details
21
21
22
-
You can discover your assets in the Azure Purview data catalog by either:
22
+
You can discover your assets in the Microsoft Purview data catalog by either:
23
23
-[Browsing the data catalog](how-to-browse-catalog.md)
24
24
-[Searching the data catalog](how-to-search-catalog.md)
25
25
@@ -81,25 +81,25 @@ If you edit an asset by adding a description, asset level classification, glossa
81
81
82
82
If you make some column level updates, like adding a description, column level classification, or glossary term, then subsequent scans will also update the asset schema (new columns and classifications will be detected by the scanner in subsequent scan runs).
83
83
84
-
Even on edited assets, after a scan Azure Purview will reflect the truth of the source system. For example: if you edit a column and it's deleted from the source, it will be deleted from your asset in Azure Purview.
84
+
Even on edited assets, after a scan Microsoft Purview will reflect the truth of the source system. For example: if you edit a column and it's deleted from the source, it will be deleted from your asset in Microsoft Purview.
85
85
86
86
>[!NOTE]
87
-
> If you update the **name or data type of a column** in an Azure Purview asset, later scans **will not** update the asset schema. New columns and classifications **will not** be detected.
87
+
> If you update the **name or data type of a column** in a Microsoft Purview asset, later scans **will not** update the asset schema. New columns and classifications **will not** be detected.
88
88
89
89
## Deleting assets
90
90
91
91
You can delete an asset by selecting the delete icon under the name of the asset.
92
92
93
93
### Delete behavior explained
94
94
95
-
Any asset you delete using the delete button is permanently deleted in Azure Purview. However, if you run a **full scan** on the source from which the asset was ingested into the catalog, then the asset is reingested and you can discover it using the Azure Purview catalog.
95
+
Any asset you delete using the delete button is permanently deleted in Microsoft Purview. However, if you run a **full scan** on the source from which the asset was ingested into the catalog, then the asset is reingested and you can discover it using the Microsoft Purview catalog.
96
96
97
-
If you have a scheduled scan (weekly or monthly) on the source, the **deleted asset will not get re-ingested** into the catalog unless the asset is modified by an end user since the previous run of the scan. For example, if a SQL table was deleted from Azure Purview, but after the table was deleted a user added a new column to the table in SQL, at the next scan the asset will be rescanned and ingested into the catalog.
97
+
If you have a scheduled scan (weekly or monthly) on the source, the **deleted asset will not get re-ingested** into the catalog unless the asset is modified by an end user since the previous run of the scan. For example, if a SQL table was deleted from Microsoft Purview, but after the table was deleted a user added a new column to the table in SQL, at the next scan the asset will be rescanned and ingested into the catalog.
98
98
99
-
If you delete an asset, only that asset is deleted. Azure Purview does not currently support cascaded deletes. For example, if you delete a storage account asset in your catalog - the containers, folders and files within them are not deleted.
99
+
If you delete an asset, only that asset is deleted. Microsoft Purview does not currently support cascaded deletes. For example, if you delete a storage account asset in your catalog - the containers, folders and files within them are not deleted.
100
100
101
101
102
102
## Next steps
103
103
104
-
-[Browse the Azure Purview Data catalog](how-to-browse-catalog.md)
105
-
-[Search the Azure Purview Data Catalog](how-to-search-catalog.md)
104
+
-[Browse the Microsoft Purview Data catalog](how-to-browse-catalog.md)
105
+
-[Search the Microsoft Purview Data Catalog](how-to-search-catalog.md)
title: Configure Azure AD Conditional Access for Azure Purview
3
-
description: This article describes steps how to configure Azure AD Conditional Access for Azure Purview
2
+
title: Configure Azure AD Conditional Access for Microsoft Purview
3
+
description: This article describes steps how to configure Azure AD Conditional Access for Microsoft Purview
4
4
author: zeinam
5
5
ms.author: zeinam
6
6
ms.service: purview
7
7
ms.subservice: purview-data-catalog
8
8
ms.topic: how-to
9
9
ms.date: 01/14/2022
10
-
# Customer intent: As an identity and security admin, I want to set up Azure Active Directory Conditional Access for Azure Purview, for secure access.
10
+
# Customer intent: As an identity and security admin, I want to set up Azure Active Directory Conditional Access for Microsoft Purview, for secure access.
11
11
---
12
12
13
-
# Conditional Access with Azure Purview
13
+
# Conditional Access with Microsoft Purview
14
14
15
-
[Azure Purview](./overview.md) supports Microsoft Conditional Access.
15
+
[Microsoft Purview](./overview.md) supports Microsoft Conditional Access.
16
16
17
-
The following steps show how to configure Azure Purview to enforce a Conditional Access policy.
17
+
The following steps show how to configure Microsoft Purview to enforce a Conditional Access policy.
18
18
19
19
## Prerequisites
20
20
21
-
- When multi-factor authentication is enabled, to sign in to Azure Purview Studio, you must perform multi-factor authentication.
21
+
- When multi-factor authentication is enabled, to sign in to Microsoft Purview Studio, you must perform multi-factor authentication.
22
22
23
23
## Configure conditional access
24
24
@@ -31,7 +31,7 @@ The following steps show how to configure Azure Purview to enforce a Conditional
31
31
32
32
:::image type="content" source="media/catalog-conditional-access/select-users-and-groups.png" alt-text="Screenshot that shows User and Group selection"lightbox="media/catalog-conditional-access/select-users-and-groups.png":::
33
33
34
-
1. Select **Cloud apps**, select **Select apps**. You see all apps available for Conditional Access. Select **Azure Purview**, at the bottom select **Select**, and then select **Done**.
34
+
1. Select **Cloud apps**, select **Select apps**. You see all apps available for Conditional Access. Select **Microsoft Purview**, at the bottom select **Select**, and then select **Done**.
35
35
36
36
:::image type="content" source="media/catalog-conditional-access/select-azure-purview.png" alt-text="Screenshot that shows Applications selection"lightbox="media/catalog-conditional-access/select-azure-purview.png":::
37
37
@@ -43,4 +43,4 @@ The following steps show how to configure Azure Purview to enforce a Conditional
Copy file name to clipboardExpand all lines: articles/purview/catalog-lineage-user-guide.md
+17-17Lines changed: 17 additions & 17 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,22 +1,22 @@
1
1
---
2
2
title: Data Catalog lineage user guide
3
-
description: This article provides an overview of the catalog lineage feature of Azure Purview.
3
+
description: This article provides an overview of the catalog lineage feature of Microsoft Purview.
4
4
author: chanuengg
5
5
ms.author: csugunan
6
6
ms.service: purview
7
7
ms.topic: conceptual
8
8
ms.date: 01/20/2022
9
9
---
10
-
# Azure Purview Data Catalog lineage user guide
10
+
# Microsoft Purview Data Catalog lineage user guide
11
11
12
-
This article provides an overview of the data lineage features in Azure Purview Data Catalog.
12
+
This article provides an overview of the data lineage features in Microsoft Purview Data Catalog.
13
13
14
14
## Background
15
15
16
-
One of the platform features of Azure Purview is the ability to show the lineage between datasets created by data processes. Systems like Data Factory, Data Share, and Power BI capture the lineage of data as it moves. Custom lineage reporting is also supported via Atlas hooks and REST API.
16
+
One of the platform features of Microsoft Purview is the ability to show the lineage between datasets created by data processes. Systems like Data Factory, Data Share, and Power BI capture the lineage of data as it moves. Custom lineage reporting is also supported via Atlas hooks and REST API.
17
17
18
18
## Lineage collection
19
-
Metadata collected in Azure Purview from enterprise data systems are stitched across to show an end to end data lineage. Data systems that collect lineage into Azure Purview are broadly categorized into following three types:
19
+
Metadata collected in Microsoft Purview from enterprise data systems are stitched across to show an end to end data lineage. Data systems that collect lineage into Microsoft Purview are broadly categorized into following three types:
@@ -25,7 +25,7 @@ One of the platform features of Azure Purview is the ability to show the lineage
25
25
Each system supports a different level of lineage scope. Check the sections below, or your system's individual lineage article, to confirm the scope of lineage currently available.
26
26
27
27
### Data processing systems
28
-
Data integration and ETL tools can push lineage into Azure Purview at execution time. Tools such as Data Factory, Data Share, Synapse, Azure Databricks, and so on, belong to this category of data processing systems. The data processing systems reference datasets as source from different databases and storage solutions to create target datasets. The list of data processing systems currently integrated with Azure Purview for lineage are listed in below table.
28
+
Data integration and ETL tools can push lineage into Microsoft Purview at execution time. Tools such as Data Factory, Data Share, Synapse, Azure Databricks, and so on, belong to this category of data processing systems. The data processing systems reference datasets as source from different databases and storage solutions to create target datasets. The list of data processing systems currently integrated with Microsoft Purview for lineage are listed in below table.
29
29
30
30
| Data processing system | Supported scope |
31
31
| ---------------------- | ------------|
@@ -35,7 +35,7 @@ Data integration and ETL tools can push lineage into Azure Purview at execution
35
35
| Azure Data Share |[Share snapshot](how-to-link-azure-data-share.md)|
36
36
37
37
### Data storage systems
38
-
Databases & storage solutions such as Oracle, Teradata, and SAP have query engines to transform data using scripting language. Data lineage from views/stored procedures/etc are collected into Azure Purview and stitched with lineage from other systems. Lineage is supported for the following data sources via Azure Purview data scan. Learn more about the supported lineage scenarios from the respective article.
38
+
Databases & storage solutions such as Oracle, Teradata, and SAP have query engines to transform data using scripting language. Data lineage from views/stored procedures/etc are collected into Microsoft Purview and stitched with lineage from other systems. Lineage is supported for the following data sources via Microsoft Purview data scan. Learn more about the supported lineage scenarios from the respective article.
39
39
40
40
|**Category**|**Data source**|
41
41
|---|---|
@@ -54,7 +54,7 @@ Databases & storage solutions such as Oracle, Teradata, and SAP have query engin
Data analytics and reporting systems like Azure ML and Power BI report lineage into Azure Purview. These systems will use the datasets from storage systems and process through their meta model to create BI Dashboards, ML experiments and so on.
57
+
Data analytics and reporting systems like Azure ML and Power BI report lineage into Microsoft Purview. These systems will use the datasets from storage systems and process through their meta model to create BI Dashboards, ML experiments and so on.
58
58
59
59
| Data analytics & reporting system | Supported scope |
60
60
| ---------------------- | ------------|
@@ -64,27 +64,27 @@ Data analytics and reporting systems like Azure ML and Power BI report lineage i
Lineage in Azure Purview includes datasets and processes. Datasets are also referred to as nodes while processes can be also called edges:
67
+
Lineage in Microsoft Purview includes datasets and processes. Datasets are also referred to as nodes while processes can be also called edges:
68
68
69
-
***Dataset (Node)**: A dataset (structured or unstructured) provided as an input to a process. For example, a SQL Table, Azure blob, and files (such as .csv and .xml), are all considered datasets. In the lineage section of Azure Purview, datasets are represented by rectangular boxes.
69
+
***Dataset (Node)**: A dataset (structured or unstructured) provided as an input to a process. For example, a SQL Table, Azure blob, and files (such as .csv and .xml), are all considered datasets. In the lineage section of Microsoft Purview, datasets are represented by rectangular boxes.
70
70
71
-
***Process (Edge)**: An activity or transformation performed on a dataset is called a process. For example, ADF Copy activity, Data Share snapshot and so on. In the lineage section of Azure Purview, processes are represented by round-edged boxes.
71
+
***Process (Edge)**: An activity or transformation performed on a dataset is called a process. For example, ADF Copy activity, Data Share snapshot and so on. In the lineage section of Microsoft Purview, processes are represented by round-edged boxes.
72
72
73
-
To access lineage information for an asset in Azure Purview, follow the steps:
73
+
To access lineage information for an asset in Microsoft Purview, follow the steps:
74
74
75
-
1. In the Azure portal, go to the [Azure Purview accounts page](https://aka.ms/purviewportal).
75
+
1. In the Azure portal, go to the [Microsoft Purview accounts page](https://aka.ms/purviewportal).
76
76
77
-
1. Select your Azure Purview account from the list, and then select **Open Azure Purview Studio** from the **Overview** page.
77
+
1. Select your Microsoft Purview account from the list, and then select **Open Microsoft Purview Studio** from the **Overview** page.
78
78
79
-
1. On the Azure Purview Studio **Home** page, search for a dataset name or the process name such as ADF Copy or Data Flow activity. And then press Enter.
79
+
1. On the Microsoft Purview Studio **Home** page, search for a dataset name or the process name such as ADF Copy or Data Flow activity. And then press Enter.
80
80
81
81
1. From the search results, select the asset and select its **Lineage** tab.
82
82
83
83
:::image type="content" source="./media/catalog-lineage-user-guide/select-lineage-from-asset.png" alt-text="Screenshot showing how to select the Lineage tab." border="true":::
84
84
85
85
## Asset-level lineage
86
86
87
-
Azure Purview supports asset level lineage for the datasets and processes. To see the asset level lineage go to the **Lineage** tab of the current asset in the catalog. Select the current dataset asset node. By default the list of columns belonging to the data appears in the left pane.
87
+
Microsoft Purview supports asset level lineage for the datasets and processes. To see the asset level lineage go to the **Lineage** tab of the current asset in the catalog. Select the current dataset asset node. By default the list of columns belonging to the data appears in the left pane.
88
88
89
89
:::image type="content" source="./media/catalog-lineage-user-guide/view-columns-from-lineage.png" alt-text="Screenshot showing how to select View columns in the lineage page" border="true":::
90
90
@@ -113,7 +113,7 @@ To see column-level lineage of a dataset, go to the **Lineage** tab of the curre
113
113
:::image type="content" source="./media/catalog-lineage-user-guide/use-toggle-to-filter-nodes.png" alt-text="Screenshot showing how to use the toggle to filter the list of nodes on the lineage page." lightbox="./media/catalog-lineage-user-guide/use-toggle-to-filter-nodes.png":::
114
114
115
115
## Process column lineage
116
-
Data process can take one or more input datasets to produce one or more outputs. In Azure Purview, column level lineage is available for process nodes.
116
+
Data process can take one or more input datasets to produce one or more outputs. In Microsoft Purview, column level lineage is available for process nodes.
117
117
1. Switch between input and output datasets from a drop down in the columns panel.
118
118
2. Select columns from one or more tables to see the lineage flowing from input dataset to corresponding output dataset.
0 commit comments