Skip to content

Commit 38d151e

Browse files
authored
Merge pull request #178281 from nibaccam/patch-36
Data| Remove preview for partition datasets
2 parents d81e27b + 2505e97 commit 38d151e

File tree

1 file changed

+1
-4
lines changed

1 file changed

+1
-4
lines changed

articles/machine-learning/how-to-create-register-datasets.md

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -245,13 +245,10 @@ labeled_dataset = labeled_dataset.filter(labeled_dataset['label'] == 'dog')
245245
labeled_dataset = labeled_dataset.filter((labeled_dataset['label']['isCrowd'] == True) & (labeled_dataset.file_metadata['Size'] > 100000))
246246
```
247247

248-
### Partition data (preview)
248+
### Partition data
249249

250250
You can partition a dataset by including the `partitions_format` parameter when creating a TabularDataset or FileDataset.
251251

252-
> [!IMPORTANT]
253-
> Creating dataset partitions is an [experimental](/python/api/overview/azure/ml/#stable-vs-experimental) preview capability, and may change at any time.
254-
255252
When you partition a dataset, the partition information of each file path is extracted into columns based on the specified format. The format should start from the position of first partition key until the end of file path.
256253

257254
For example, given the path `../Accounts/2019/01/01/data.jsonl` where the partition is by department name and time; the `partition_format='/{Department}/{PartitionDate:yyyy/MM/dd}/data.jsonl'` creates a string column 'Department' with the value 'Accounts' and a datetime column 'PartitionDate' with the value `2019-01-01`.

0 commit comments

Comments
 (0)