Skip to content

Commit a048a87

Browse files
authored
Merge pull request #197530 from djpmsft/purview-updates
Removing Search limitation
2 parents 6627007 + 19bb0d9 commit a048a87

File tree

2 files changed

+9
-8
lines changed

2 files changed

+9
-8
lines changed

articles/purview/concept-resource-sets.md

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ ms.author: daperlov
66
ms.service: purview
77
ms.subservice: purview-data-catalog
88
ms.topic: conceptual
9-
ms.date: 09/24/2021
9+
ms.date: 05/09/2022
1010
---
1111

1212
# Understanding resource sets
@@ -45,21 +45,18 @@ When Microsoft Purview detects resources that it thinks are part of a resource s
4545

4646
## Advanced resource sets
4747

48-
By default, Microsoft Purview determines the schema and classifications for resource sets based upon the [resource set file sampling rules](sources-and-scans.md#resource-set-file-sampling). Microsoft Purview can customize and further enrich your resource set assets through the **Advanced Resource Sets** capability. When Advanced Resource Sets are enabled, Microsoft Purview run extra aggregations to compute the following information about resource set assets:
48+
Microsoft Purview can customize and further enrich your resource set assets through the **Advanced Resource Sets** capability. Advanced resource sets allows Microsoft Purview to understand the underlying partitions of data ingested and enables the creation of [resource set pattern rules](how-to-resource-set-pattern-rules.md) that customize how Microsoft Purview groups resource sets during scanning.
49+
50+
When Advanced Resource Sets are enabled, Microsoft Purview run extra aggregations to compute the following information about resource set assets:
4951

50-
- Most up-to-date schema and classifications to accurately reflect schema drift from changing metadata.
5152
- A sample path from a file that comprises the resource set.
5253
- A partition count that shows how many files make up the resource set.
53-
- A schema count that shows how many unique schemas were found. This value is either a number between 1–5, or for values greater than 5, 5+.
54-
- A list of partition types when more than a single partition type is included in the resource set. For example, an IoT sensor might output both XML and JSON files, although both are logically part of the same resource set.
5554
- The total size of all files that comprise the resource set.
5655

5756
These properties can be found on the asset details page of the resource set.
5857

5958
:::image type="content" source="media/concept-resource-sets/resource-set-properties.png" alt-text="The properties computed when advanced resource sets is on" border="true":::
6059

61-
Enabling advanced resource sets also allows for the creation of [resource set pattern rules](how-to-resource-set-pattern-rules.md) that customize how Microsoft Purview groups resource sets during scanning.
62-
6360
### Turning on advanced resource sets
6461

6562
Advanced resource sets is off by default in all new Microsoft Purview instances. Advanced resource sets can be enabled from **Account information** in the management hub.
@@ -124,6 +121,11 @@ When scanning a storage account, Microsoft Purview uses a set of defined pattern
124121

125122
To customize or override how Microsoft Purview detects which assets are grouped as resource sets and how they are displayed within the catalog, you can define pattern rules in the management center. For step-by-step instructions and syntax, please see [resource set pattern rules](how-to-resource-set-pattern-rules.md).
126123

124+
## Known limitations with resource sets
125+
126+
- By default, resource set assets will only be deleted by a scan if [Advanced Resource sets](#advanced-resource-sets) are enabled. If this capability is off, resource set assets can only be deleted manually or via API.
127+
- Currently, resource set assets will apply the first schema and classification discovered by the scan. Subsequent scans won't update the schema.
128+
127129
## Next steps
128130

129131
To get started with Microsoft Purview, see [Quickstart: Create a Microsoft Purview account](create-catalog-portal.md).

articles/purview/how-to-search-catalog.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -83,7 +83,6 @@ The following table contains the operators that can be used to compose a search
8383
8484
### Known limitations
8585

86-
* Searching for classifications only matches on the formal classification name. For example, the keywords "World Cities" don't match classification "MICROSOFT.GOVERNMENT.CITY_NAME".
8786
* Grouping isn't supported within a field search. Customers should use operators to connect field searches. For example,`name:(alice AND bob)` is invalid search syntax, but `name:alice AND name:bob` is supported.
8887

8988
## Next steps

0 commit comments

Comments
 (0)