Skip to content

Commit 2370db2

Browse files
Merge pull request #245261 from linda33wj/main
Update connector and scan monitoring doc
2 parents f36359b + 07aac27 commit 2370db2

8 files changed

+38
-13
lines changed

articles/purview/catalog-managed-vnet.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ ms.author: zeinam
66
ms.service: purview
77
ms.subservice: purview-data-catalog
88
ms.topic: how-to
9-
ms.date: 02/17/2023
9+
ms.date: 07/18/2023
1010
ms.custom: references_regions
1111
# Customer intent: As a Microsoft Purview admin, I want to set up Managed Virtual Network and managed private endpoints for my Microsoft Purview account.
1212
---
@@ -167,7 +167,9 @@ Before deploying a Managed VNet and Managed VNet Runtime for a Microsoft Purview
167167

168168
### Deploy managed private endpoints for data sources
169169

170-
To scan any data sources using Managed VNet Runtime, you need to deploy and approve a managed private endpoint for the data source prior to create a new scan. To deploy and approve a managed private endpoint for a data source, follow these steps selecting data source of your choice from the list:
170+
You can use managed private endpoints to connect your data sources to ensure data security during transmission. If your data source allows public access and you want to connect via public network, you can skip this step. Scan run can be executed as long as the integration runtime can connect to your data source.
171+
172+
To deploy and approve a managed private endpoint for a data source, follow these steps selecting data source of your choice from the list:
171173

172174
1. Navigate to **Management**, and select **Managed private endpoints**.
173175

articles/purview/how-to-monitor-data-map-population.md

Lines changed: 18 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ In Microsoft Purview, you can scan various types of data sources and view the sc
1515

1616
## Monitor scan runs
1717

18-
1. Open the the Microsoft Purview governance portal by:
18+
1. Open the Microsoft Purview governance portal by:
1919

2020
- Browsing directly to [https://web.purview.azure.com](https://web.purview.azure.com) and selecting your Microsoft Purview account.
2121
- Opening the [Azure portal](https://portal.azure.com), searching for and selecting the Microsoft Purview account. Selecting the [**the Microsoft Purview governance portal**](https://web.purview.azure.com/) button.
@@ -62,8 +62,8 @@ You can click the **run ID** to check more about the scan run details:
6262
| Failed | The scan phase fails. You can check the error details by clicking the "More info" link next to it. |
6363
| Canceled | The scan run is canceled by user. |
6464
| In Progress | The scan is running in progress. |
65-
| Queued | The scan run is waiting for available integration runtime resource.<br>If you use self-hosted integration runtime, note each node can run a number of concurrent scans at the same time depending on your machine specification (CPU and memory). More scans will be in Queued status. |
66-
| Throttled | The scan run is being throttled. It means this Microsoft Purview account at the moment has more ongoing scan runs than the allowed max concurrent count. Learn more about the limit [here](how-to-manage-quotas.md). This particular scan run will be waiting and be executed once your other ongoing scan(s) finishes. |
65+
| Queued | The scan run is waiting for available integration runtime resource.<br>If you use self-hosted integration runtime, note each node can run a number of concurrent scans at the same time depending on your machine specification (CPU and memory). More scans are in Queued status. |
66+
| Throttled | The scan run is being throttled. It means this Microsoft Purview account at the moment has more ongoing scan runs than the allowed max concurrent count. Learn more about the limit [here](how-to-manage-quotas.md). This particular scan run is waiting and will be executed once your other ongoing scan(s) finishes. |
6767

6868
The scan run is not charged during "Throttled" or "Queued" status.
6969

@@ -91,6 +91,21 @@ You can click the **run ID** to check more about the scan run details:
9191

9292
- **Duration**: The ingestion duration and the start/end time.
9393

94+
## View the exception log (Preview)
95+
96+
When some assets or relationship fail to ingest into data map during scan, e.g. ingestion status ends up as partially completed, you can see a "**Download log**" button in the [scan run details](#scan-run-details) panel. It provides exception log files that capture the details of the failures.
97+
98+
The following table shows the schema of a log file.
99+
100+
| Column | Description |
101+
| ------ | ----------- |
102+
| TimeStamp | The UTC timestamp when the ingestion operation happens.|
103+
| ErrorCode | Error code of the exception. |
104+
| OperationItem | Identifier for the failed asset/relationship, usually using the fully qualified name. |
105+
| Message | More information on which asset/relationship failed to ingest due to what reason. If there is ingestion failure for resource set, it may apply to multiple assets matching the same naming pattern, and the message includes the impacted count. |
106+
107+
Currently, the exception log doesn't include failures happened during scan phase (metadata discovery). It will be added later.
108+
94109
## Monitor links
95110

96111
You can connect other services with Microsoft Purview to establish a "link", which will make the metadata and lineage of that service's assets available to Microsoft Purview. Currently, link is supported for [Azure Data Factory](how-to-link-azure-data-factory.md) and [Azure Synapse Analytics](how-to-lineage-azure-synapse-analytics.md).

articles/purview/register-scan-cassandra-source.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ ms.author: jingwang
66
ms.service: purview
77
ms.subservice: purview-data-map
88
ms.topic: how-to
9-
ms.date: 04/20/2023
9+
ms.date: 07/18/2023
1010
ms.custom: template-how-to, ignite-fall-2021
1111
---
1212

@@ -134,7 +134,7 @@ To create and run a new scan:
134134
1. **Maximum memory available** (applicable when using self-hosted integration runtime): Specify the maximum memory (in GB) available on your VM to be used for scanning processes. This value depends on the size of Cassandra server to be scanned.
135135
:::image type="content" source="media/register-scan-cassandra-source/scan.png" alt-text="scan Cassandra source" border="true":::
136136

137-
1. Select **Test connection** (available when using self-hosted integration runtime).
137+
1. Select **Test connection** to validate the settings.
138138

139139
1. Select **Continue**.
140140

articles/purview/register-scan-looker-source.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ ms.author: jingwang
66
ms.service: purview
77
ms.subservice: purview-data-map
88
ms.topic: how-to
9-
ms.date: 04/20/2023
9+
ms.date: 07/18/2023
1010
ms.custom: template-how-to, ignite-fall-2021
1111
---
1212

@@ -137,7 +137,7 @@ To create and run a new scan, follow these steps:
137137

138138
:::image type="content" source="media/register-scan-looker-source/setup-scan.png" alt-text="trigger scan" border="true":::
139139

140-
1. Select **Test connection** (available when using self-hosted integration runtime).
140+
1. Select **Test connection** to validate the settings.
141141

142142
1. Select **Continue**.
143143

articles/purview/register-scan-mysql.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ ms.author: jingwang
66
ms.service: purview
77
ms.subservice: purview-data-map
88
ms.topic: how-to
9-
ms.date: 04/20/2023
9+
ms.date: 07/18/2023
1010
ms.custom: template-how-to
1111
---
1212

@@ -135,6 +135,8 @@ To create and run a new scan, follow these steps:
135135
136136
:::image type="content" source="media/register-scan-mysql/scan.png" alt-text="scan MySQL" border="true":::
137137

138+
1. Select **Test connection** to validate the settings (available when using Azure Integration Runtime).
139+
138140
1. Select **Continue**.
139141

140142
1. Choose your **scan trigger**. You can set up a schedule or ran the scan once.

articles/purview/register-scan-postgresql.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ ms.author: jingwang
66
ms.service: purview
77
ms.subservice: purview-data-map
88
ms.topic: how-to
9-
ms.date: 04/20/2023
9+
ms.date: 07/18/2023
1010
ms.custom: template-how-to
1111
---
1212

@@ -139,6 +139,8 @@ To create and run a new scan, follow these steps:
139139
140140
:::image type="content" source="media/register-scan-postgresql/scan.png" alt-text="scan PostgreSQL" border="true":::
141141

142+
1. Select **Test connection** to validate the settings (available when using Azure Integration Runtime).
143+
142144
1. Select **Continue**.
143145

144146
1. Choose your **scan trigger**. You can set up a schedule or ran the scan once.

articles/purview/register-scan-salesforce.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ ms.author: jingwang
66
ms.service: purview
77
ms.subservice: purview-data-map
88
ms.topic: how-to
9-
ms.date: 04/20/2023
9+
ms.date: 07/18/2023
1010
ms.custom: template-how-to
1111
---
1212

@@ -38,7 +38,7 @@ When object is deleted from the data source, currently the subsequent scan won't
3838
- You need Data Source Administrator and Data Reader permissions to register a source and manage it in the Microsoft Purview governance portal. For more information about permissions, see [Access control in Microsoft Purview](catalog-permissions.md).
3939
- A Salesforce connected app, which will be used to access your Salesforce information.
4040
- If you need to create a connected app, you can follow the [Salesforce documentation](https://help.salesforce.com/s/articleView?id=sf.connected_app_create_basics.htm&type=5).
41-
- You will need to [enable OAuth for you Salesforce application](https://help.salesforce.com/s/articleView?id=sf.connected_app_create_api_integration.htm&type=5).
41+
- You will need to [enable OAuth for your Salesforce application](https://help.salesforce.com/s/articleView?id=sf.connected_app_create_api_integration.htm&type=5).
4242

4343
> [!NOTE]
4444
> **If your data store is not publicly accessible** (if your data store limits access from on-premises network, private network or specific IPs, etc.), **you will need to configure a self hosted integration runtime to connect to it**.
@@ -131,6 +131,8 @@ To create and run a new scan, follow these steps:
131131
132132
:::image type="content" source="media/register-scan-salesforce/scan.png" alt-text="scan Salesforce" border="true":::
133133

134+
1. Select **Test connection** to validate the settings (available when using Azure Integration Runtime).
135+
134136
1. Select **Continue**.
135137

136138
1. Choose your **scan trigger**. You can set up a schedule or ran the scan once.

articles/purview/register-scan-snowflake.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -228,6 +228,8 @@ To create and run a new scan, follow these steps:
228228
229229
:::image type="content" source="media/register-scan-snowflake/scan.png" alt-text="scan Snowflake" border="true":::
230230
231+
1. Select **Test connection** to validate the settings (available when using Azure Integration Runtime).
232+
231233
1. Select **Continue**.
232234
233235
1. Select a **scan rule set** for classification. You can choose between the system default, existing custom rule sets, or [create a new rule set](create-a-scan-rule-set.md) inline. Check the [Classification](apply-classifications.md) article to learn more.

0 commit comments

Comments
 (0)