You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/purview/concept-resource-sets.md
+9-7Lines changed: 9 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ ms.author: daperlov
6
6
ms.service: purview
7
7
ms.subservice: purview-data-catalog
8
8
ms.topic: conceptual
9
-
ms.date: 09/24/2021
9
+
ms.date: 05/09/2022
10
10
---
11
11
12
12
# Understanding resource sets
@@ -45,21 +45,18 @@ When Microsoft Purview detects resources that it thinks are part of a resource s
45
45
46
46
## Advanced resource sets
47
47
48
-
By default, Microsoft Purview determines the schema and classifications for resource sets based upon the [resource set file sampling rules](sources-and-scans.md#resource-set-file-sampling). Microsoft Purview can customize and further enrich your resource set assets through the **Advanced Resource Sets** capability. When Advanced Resource Sets are enabled, Microsoft Purview run extra aggregations to compute the following information about resource set assets:
48
+
Microsoft Purview can customize and further enrich your resource set assets through the **Advanced Resource Sets** capability. Advanced resource sets allows Microsoft Purview to understand the underlying partitions of data ingested and enables the creation of [resource set pattern rules](how-to-resource-set-pattern-rules.md) that customize how Microsoft Purview groups resource sets during scanning.
49
+
50
+
When Advanced Resource Sets are enabled, Microsoft Purview run extra aggregations to compute the following information about resource set assets:
49
51
50
-
- Most up-to-date schema and classifications to accurately reflect schema drift from changing metadata.
51
52
- A sample path from a file that comprises the resource set.
52
53
- A partition count that shows how many files make up the resource set.
53
-
- A schema count that shows how many unique schemas were found. This value is either a number between 1–5, or for values greater than 5, 5+.
54
-
- A list of partition types when more than a single partition type is included in the resource set. For example, an IoT sensor might output both XML and JSON files, although both are logically part of the same resource set.
55
54
- The total size of all files that comprise the resource set.
56
55
57
56
These properties can be found on the asset details page of the resource set.
58
57
59
58
:::image type="content" source="media/concept-resource-sets/resource-set-properties.png" alt-text="The properties computed when advanced resource sets is on" border="true":::
60
59
61
-
Enabling advanced resource sets also allows for the creation of [resource set pattern rules](how-to-resource-set-pattern-rules.md) that customize how Microsoft Purview groups resource sets during scanning.
62
-
63
60
### Turning on advanced resource sets
64
61
65
62
Advanced resource sets is off by default in all new Microsoft Purview instances. Advanced resource sets can be enabled from **Account information** in the management hub.
@@ -124,6 +121,11 @@ When scanning a storage account, Microsoft Purview uses a set of defined pattern
124
121
125
122
To customize or override how Microsoft Purview detects which assets are grouped as resource sets and how they are displayed within the catalog, you can define pattern rules in the management center. For step-by-step instructions and syntax, please see [resource set pattern rules](how-to-resource-set-pattern-rules.md).
126
123
124
+
## Known limitations with resource sets
125
+
126
+
- By default, resource set assets will only be deleted by a scan if [Advanced Resource sets](#advanced-resource-sets) are enabled. If this capability is off, resource set assets can only be deleted manually or via API.
127
+
- Currently, resource set assets will apply the first schema and classification discovered by the scan. Subsequent scans won't update the schema.
128
+
127
129
## Next steps
128
130
129
131
To get started with Microsoft Purview, see [Quickstart: Create a Microsoft Purview account](create-catalog-portal.md).
Copy file name to clipboardExpand all lines: articles/purview/how-to-search-catalog.md
-1Lines changed: 0 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -83,7 +83,6 @@ The following table contains the operators that can be used to compose a search
83
83
84
84
### Known limitations
85
85
86
-
* Searching for classifications only matches on the formal classification name. For example, the keywords "World Cities" don't match classification "MICROSOFT.GOVERNMENT.CITY_NAME".
87
86
* Grouping isn't supported within a field search. Customers should use operators to connect field searches. For example,`name:(alice AND bob)` is invalid search syntax, but `name:alice AND name:bob` is supported.
0 commit comments