Skip to content

Commit 180d5eb

Browse files
Merge pull request #235155 from linda33wj/main
Add limitation for source deletion detection
2 parents 02c71ff + 658a06e commit 180d5eb

File tree

1 file changed

+4
-3
lines changed

1 file changed

+4
-3
lines changed

articles/purview/concept-scans-and-ingestion.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ ms.author: shjia
66
ms.service: purview
77
ms.subservice: purview-data-map
88
ms.topic: conceptual
9-
ms.date: 03/13/2023
9+
ms.date: 04/20/2023
1010
ms.custom: ignite-fall-2021
1111
---
1212

@@ -64,7 +64,7 @@ If the toggle button is turned on, the new assets under a certain parent will be
6464
> * For any scans created or scheduled before the toggle button is introduced, the toggle state is set as on and can’t be changed. For any scans created or scheduled after the toggle button is introduced, the toggle state can’t be changed after the scan is saved. You need to create a new scan to change the toggle state.
6565
> * When the toggle button is turned off, for sources of storage type like Azure Data Lake Storage Gen 2 it may take up to 4 hours before the [browse by source type](how-to-browse-catalog.md#browse-by-source-type) experience becomes fully available after your scan job is completed.
6666
67-
### Known limitations
67+
#### Known limitations
6868
When the toggle button is turned off:
6969
* The file entities under a partially selected parent will not be scanned.
7070
* If all existing entities under a parent are explicitly selected, the parent will be considered as fully selected and any new assets under the parent will be included when you run the scan again.
@@ -92,7 +92,8 @@ To keep deleted files out of your catalog, it's important to run regular scans.
9292
When you enumerate large data stores like Data Lake Storage Gen2, there are multiple ways (including enumeration errors and dropped events) to miss information. A particular scan might miss that a file was created or deleted. So, unless the catalog is certain a file was deleted, it won't delete it from the catalog. This strategy means there can be errors when a file that doesn't exist in the scanned data store still exists in the catalog. In some cases, a data store might need to be scanned two or three times before it catches certain deleted assets.
9393

9494
> [!NOTE]
95-
> Assets that are marked for deletion are deleted after a successful scan. Deleted assets might continue to be visible in your catalog for some time before they are processed and removed.
95+
> - Assets that are marked for deletion are deleted after a successful scan. Deleted assets might continue to be visible in your catalog for some time before they are processed and removed.
96+
> - Currently, source deletion detection is not supported for the following sources: Azure Databricks, Cassandra, DB2, Erwin, Google BigQuery, Hive Metastore, Looker, MongoDB, MySQL, Oracle, PostgreSQL, Salesforce, SAP BW, SAP ECC, SAP HANA, SAP S/4HANA, Snowflake, and Teradata. When object is deleted from the data source, the subsequent scan won't automatically remove the corresponding asset in Microsoft Purview.
9697
9798
## Ingestion
9899

0 commit comments

Comments
 (0)