You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In this article, you will learn how to transform and save datasets in the designer so that you can prepare your own data for machine learning. Use the provided [Adult Census Income Binary Classification dataset](sample-designer-datasets.md) to prepare two datasets: one dataset that includes adult census information from only the United States and another dataset that only includes census information from non-US adults.
18
+
In this article, you learn how to transform and save datasets in Azure Machine Learning designer so that you can prepare your own data for machine learning.
19
+
20
+
You will use the sample [Adult Census Income Binary Classification](sample-designer-datasets.md) dataset to prepare two datasets: one dataset that includes adult census information from only the United States and another dataset that includes census information from non-US adults.
19
21
20
22
In this article, you learn how to:
21
23
22
24
1. Transform a dataset to prepare it for training.
23
25
1. Export the resulting datasets to a datastore.
26
+
1. View results.
24
27
25
28
This how-to is a prerequisite for the [how to retrain designer models](how-to-retrain-designer.md) article. In that article, you will learn how to use the transformed datasets to train multiple models.
26
29
27
30
## Transform a dataset
28
31
29
-
In this section, you learn how to import the sample dataset and split the data into US and non-US datasets using the **Split Data** module. For this how to, use **Adult Census Income Binary classification** as your starting point. For more information on how to import your own data into the designer, see [how to import data](how-to-designer-import-data.md).
32
+
In this section, you learn how to import the sample dataset and split the data into US and non-US datasets. For more information on how to import your own data into the designer, see [how to import data](how-to-designer-import-data.md).
30
33
31
34
### Import data
32
35
@@ -44,27 +47,27 @@ Use the following steps to import the sample dataset.
44
47
45
48
1. Select the **Adult Census Income** dataset module.
46
49
47
-
1. In the details pane that appears to the right of the canvas, select **Outputs**. Then select the visualize icon .
50
+
1. In the details pane that appears to the right of the canvas, select **Outputs**. Select the visualize icon .
48
51
49
52
1. Use the data preview window to explore the dataset. Take note of the "native-country" column values.
50
53
51
54
### Split the data
52
55
53
-
In this section, you use the [Split Data module](algorithm-module-reference/split-data.md) to identify rows that contain "United-States" in the "native-country" column.
56
+
In this section, you use the [Split Data module](algorithm-module-reference/split-data.md) to identify and split rows that contain "United-States" in the "native-country" column.
54
57
55
58
1. In the module palette to the left of the canvas, expand the **Data Transformation** section and find the **Split Data** module.
56
59
57
60
1. Drag the **Split Data** module onto the canvas, and drop the module below the dataset module.
58
61
59
-
1. Connect the **Adult Census Income Binary classification**dataset to the **Split Data** module.
62
+
1. Connect the dataset module to the **Split Data** module.
60
63
61
64
1. Select the **Split Data** module.
62
65
63
66
1. In the module details pane to the right of the canvas, set **Splitting mode** to **Regular Expression**.
64
67
65
68
1. Enter the **Regular Expression**: `\"native-country" United-States`.
66
69
67
-
The **Regular expression** mode tests a single column for a value. For more information on the Split Data module, see the related [algorithm reference page](algorithm-module-reference/split-data.md).
70
+
The **Regular expression** mode tests a single column for a value. For more information on the Split Data module, see the related [algorithm module reference page](algorithm-module-reference/split-data.md).
68
71
69
72
Your pipeline should look like this:
70
73
@@ -73,7 +76,7 @@ Your pipeline should look like this:
73
76
74
77
## Save the datasets
75
78
76
-
Now that your pipeline is set up to split the data, you need to specify where to persist the datasets to access them later. For this example, use the **Export Data** module to save your dataset to a datastore.
79
+
Now that your pipeline is set up to split the data, you need to specify where to persist the datasets. For this example, use the **Export Data** module to save your dataset to a datastore.
77
80
78
81
1. In the module palette to the left of the canvas, expand the **Data Input and Output** section and find the **Export Data** module.
79
82
@@ -85,9 +88,9 @@ Now that your pipeline is set up to split the data, you need to specify where to
85
88
86
89
.
87
90
88
-
1. Select the **Export Data** module connected to the *left*-most port of the **Split Data** module.
91
+
1. Select the **Export Data** module that is connected to the *left*-most port of the **Split Data** module.
89
92
90
-
The order of the output ports matter. The first output port (left) contains the rows where the Split Data regular expression is true. In this case, the first port contains rows for the US-based income, and the second port contains rows for the non-US based income.
93
+
The order of the output ports matter for the **Split Data** module. The first output port contains the rows where the regular expression is true. In this case, the first port contains rows for the US-based income, and the second port contains rows for the non-US based income.
91
94
92
95
1. In the module details pane to the right of the canvas, set the following options:
93
96
@@ -102,15 +105,15 @@ Now that your pipeline is set up to split the data, you need to specify where to
102
105
> [!NOTE]
103
106
> This article assumes that you have access to a datastore registered to the current Azure Machine Learning workspace. For instructions on how to setup a datastore, see [Connect to Azure storage services](how-to-access-data.md#azure-machine-learning-studio).
104
107
105
-
If you don't have a datastore, you can create one now. For example purposes, this article will save the datasets to the default blob storage account associated with the workspace. It will save the datasets into a new folder called `data`.
108
+
If you don't have a datastore, you can create one now. For example purposes, this article will save the datasets to the default blob storage account associated with the workspace. It will save the datasets into the `azureml` container in a new folder called `data`.
106
109
107
110
1. Select the **Export Data** module connected to the *right*-most port of the **Split Data** module.
108
111
109
112
1. In the module details pane to the right of the canvas, set the following options:
110
113
111
114
**Datastore type**: Azure Blob Storage
112
115
113
-
**Datastore**: Select an existing datastore or select "New datastore" to create one now.
116
+
**Datastore**: Select the same datastore as above
114
117
115
118
**Path**: `/data/non-us-income`
116
119
@@ -124,17 +127,21 @@ Now that your pipeline is set up to split the data, you need to specify where to
124
127
125
128
.
126
129
127
-
1. At the top of the canvas, select **Submit** to submit the run.
130
+
### Submit the run
131
+
132
+
Now that your pipeline is setup to split and export the data, submit a pipeline run.
133
+
134
+
1. At the top of the canvas, select **Submit**.
128
135
129
136
1. In the **Set up pipeline run** dialog, select **Create new**.
130
137
131
138
1. Provide a descriptive experiment name like "split-census-data".
132
139
133
140
1. Select **Submit**.
134
141
135
-
###View results
142
+
## View results
136
143
137
-
After the pipeline finishes running, you can view your results by navigating to your blob storage in the Azure portal. You can also view the intermediary results for the **Split Data** module to confirm that your data split correctly.
144
+
After the pipeline finishes running, you can view your results by navigating to your blob storage in the Azure portal. You can also view the intermediary results of the **Split Data** module to confirm that your data has split correctly.
138
145
139
146
1. Select the **Split Data** module.
140
147
@@ -156,4 +163,6 @@ Skip this section if you want to continue on with part 2 of this how to, [Retrai
156
163
157
164
## Next steps
158
165
159
-
In this article, you learned how to transform a dataset and save it to a registered datastore. Continue on with [Retrain models with Azure Machine Learning designer](how-to-retrain-designer.md) to use your transformed datasets and pipeline parameters to train machine learning models.
166
+
In this article, you learned how to transform a dataset and save it to a registered datastore.
167
+
168
+
Continue to the next part of this how-to series with [Retrain models with Azure Machine Learning designer](how-to-retrain-designer.md) to use your transformed datasets and pipeline parameters to train machine learning models.
0 commit comments