Skip to content

Commit 2a32044

Browse files
authored
Merge pull request #109757 from cartacioS/patch-33
Data guardrails updates
2 parents 6d6965d + af57e88 commit 2a32044

File tree

1 file changed

+18
-8
lines changed

1 file changed

+18
-8
lines changed

articles/machine-learning/how-to-use-automated-ml-for-ml-models.md

Lines changed: 18 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -174,17 +174,27 @@ Automated machine learning offers preprocessing and data guardrails automaticall
174174

175175
### Data guardrails
176176

177-
Data guardrails are applied automatically to help you identify potential issues with your data (e.g., missing values, class imbalance) and help take corrective actions for improved results. There are many best practices that are available and can be applied to achieve reliable results.
178-
179-
The following table describes the currently supported data guardrails, and the associated statuses that users may come across when submitting their experiment.
177+
Data guardrails are applied when automatic featurization is enabled or validation is set to auto. Data guardrails help you identify potential issues with your data (e.g., missing values, class imbalance) and help take corrective actions for improved results. There are many best practices that are available and can be applied to achieve reliable results. Users can review data guardrails in the studio within the **Data guardrails** tab of an Automated ML run or by setting ```show_output=True``` when submitting an experiment using the Python SDK. The following table describes the data guardrails currently supported, and the associated statuses that users may come across when submitting their experiment.
180178

181179
Guardrail|Status|Condition for trigger
182180
---|---|---
183-
Missing&nbsp;values&nbsp;imputation |**Passed** <br> <br> **Fixed**| No missing value in any of the input&nbsp;columns <br> <br> Some columns have missing values
184-
Cross validation|**Done**|If no explicit validation set is provided
185-
High&nbsp;cardinality&nbsp;feature&nbsp;detection| **Passed** <br> <br>**Done**| No high cardinality features were detected <br><br> High cardinality input columns were detected
186-
Class balance detection |**Passed** <br><br><br>**Alerted** |Classes are balanced in the training data; A dataset is considered balanced if each class has good representation in the dataset, as measured by number and ratio of samples <br> <br> Classes in the training data are imbalanced
187-
Time-series data consistency|**Passed** <br><br><br><br> **Fixed** |<br> The selected {horizon, lag, rolling window} value(s) were analyzed, and no potential out-of-memory issues were detected. <br> <br>The selected {horizon, lag, rolling window} values were analyzed and will potentially cause your experiment to run out of memory. The lag or rolling window has been turned off.
181+
Missing feature values imputation |**Passed** <br><br><br> **Done**| No missing feature values were detected in your training data. Learn more about [missing value imputation.](https://docs.microsoft.com/azure/machine-learning/how-to-use-automated-ml-for-ml-models#advanced-featurization-options) <br><br> Missing feature values were detected in your training data and imputed.
182+
High cardinality feature handling |**Passed** <br><br><br> **Done**| Your inputs were analyzed, and no high cardinality features were detected. Learn more about [high cardinality feature detection.](https://docs.microsoft.com/azure/machine-learning/how-to-use-automated-ml-for-ml-models#advanced-featurization-options) <br><br> High cardinality features were detected in your inputs and were handled.
183+
Validation split handling |**Done**| *The validation configuration was set to 'auto' and the training data contained **less** than 20,000 rows.* <br> Each iteration of the trained model was validated through cross-validation. Learn more about [validation data.](https://docs.microsoft.com/azure/machine-learning/how-to-configure-auto-train#train-and-validation-data) <br><br> *The validation configuration was set to 'auto' and the training data contained **more** than 20,000 rows.* <br> The input data has been split into a training dataset and a validation dataset for validation of the model.
184+
Class balancing detection |**Passed** <br><br><br><br> **Alerted** | Your inputs were analyzed, and all classes are balanced in your training data. A dataset is considered balanced if each class has good representation in the dataset, as measured by number and ratio of samples. <br><br><br> Imbalanced classes were detected in your inputs. To fix model bias fix the balancing problem. Learn more about [imbalanced data.](https://docs.microsoft.com/azure/machine-learning/concept-automated-ml#imbalance)
185+
Memory issues detection |**Passed** <br><br><br><br> **Done** |<br> The selected {horizon, lag, rolling window} value(s) were analyzed, and no potential out-of-memory issues were detected. Learn more about time-series [forecasting configurations.](https://docs.microsoft.com/azure/machine-learning/how-to-auto-train-forecast#configure-and-run-experiment) <br><br><br>The selected {horizon, lag, rolling window} values were analyzed and will potentially cause your experiment to run out of memory. The lag or rolling window configurations have been turned off.
186+
Frequency detection |**Passed** <br><br><br><br> **Done** |<br> The time series was analyzed and all data points are aligned with the detected frequency. <br> <br> The time series was analyzed and data points that do not align with the detected frequency were detected. These data points were removed from the dataset. Learn more about [data preparation for time-series forecasting.](https://docs.microsoft.com/azure/machine-learning/how-to-auto-train-forecast#preparing-data)
187+
188+
#### Data Guardrail States
189+
Data guardrails will display one of three states: 'Passed', 'Done, or 'Alerted'.
190+
191+
State| Description
192+
----|----
193+
Passed| No data problems were detected and no user action is required.
194+
Done| Changes were applied to your data. We encourage users to review the corrective actions Automated ML took to ensure the changes align with the expected results.
195+
Alerted| A data issue that could not be remedied was detected. We encourage users to revise and fix the issue.
196+
197+
Previous version of the Automated ML displayed a fourth state: 'Fixed'. Newer experiments will not display this state, and all guardrails which displayed the 'Fixed' state will now display 'Done'.
188198

189199
## Run experiment and view results
190200

0 commit comments

Comments
 (0)