You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/docusaurus/docs/cloud/connect/connect_databrickssql.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -35,7 +35,7 @@ import Tabs from '@theme/Tabs';
35
35
36
36
6. Click **Add x Asset(s)**.
37
37
38
-
7. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**, **Volume**, and **Completeness** anomalies. You can de-select recommendations you’d like to opt out of.
38
+
7. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**and **Volume** anomalies. You can de-select recommendations you’d like to opt out of. You can choose to generate Expectations to detect **Completeness** anomalies.
Copy file name to clipboardExpand all lines: docs/docusaurus/docs/cloud/connect/connect_postgresql.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -60,7 +60,7 @@ import Tabs from '@theme/Tabs';
60
60
61
61
6. Click **Add x Asset(s)**.
62
62
63
-
7. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**, **Volume**, and **Completeness** anomalies. You can de-select recommendations you’d like to opt out of.
63
+
7. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**and **Volume** anomalies. You can de-select recommendations you’d like to opt out of. You can choose to generate Expectations to detect **Completeness** anomalies.
Copy file name to clipboardExpand all lines: docs/docusaurus/docs/cloud/connect/connect_redshift.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -101,7 +101,7 @@ Run all queries in the [Amazon Redshift query editor v2](https://docs.aws.amazon
101
101
102
102
7. Click **Add x Asset(s)**.
103
103
104
-
8. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**, **Volume**, and **Completeness** anomalies. You can de-select recommendations you’d like to opt out of.
104
+
8. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**and **Volume** anomalies. You can de-select recommendations you’d like to opt out of. You can choose to generate Expectations to detect **Completeness** anomalies.
Copy file name to clipboardExpand all lines: docs/docusaurus/docs/cloud/connect/connect_snowflake.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -112,7 +112,7 @@ Then, you can use the GX Cloud UI to [add a Data Asset](/cloud/data_assets/manag
112
112
113
113
7. Click **Add x Asset(s)**.
114
114
115
-
8. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**, **Volume**, and **Completeness** anomalies. You can de-select recommendations you’d like to opt out of.
115
+
8. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**and **Volume** anomalies. You can de-select recommendations you’d like to opt out of. You can choose to generate Expectations to detect **Completeness** anomalies.
Copy file name to clipboardExpand all lines: docs/docusaurus/docs/cloud/data_assets/manage_data_assets.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,7 +24,7 @@ To add a Data Asset from an existing Data Source, complete the following steps:
24
24
25
25
4. Click **Add x Asset(s)**.
26
26
27
-
5. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**, **Volume**, and **Completeness** anomalies. You can de-select recommendations you’d like to opt out of.
27
+
5. Decide which [Anomaly Detection](/docs/cloud/overview/accelerating_test_coverage.md#anomaly-detection) options you want to enable. By default, GX Cloud adds [warning-severity](/docs/cloud/expectations/expectations_overview.md#failure-severity) Expectations to detect **Schema**and **Volume** anomalies. You can de-select recommendations you’d like to opt out of. You can choose to generate Expectations to detect **Completeness** anomalies.
| Edit |[Edit parameters](/cloud/expectations/manage_expectations.md#edit-an-expectation) with the GX Cloud UI |[Edit parameters with the GX Cloud API](/reference/api/expectations/Expectation_class.mdx) or the GX Cloud UI |
178
178
| Batch |[Define a Batch](/cloud/expectations/manage_expectations.md#optional-define-a-batch) in the GX Cloud UI | Define a Batch with the GX Cloud API when connecting to [SQL](/core/connect_to_data/sql_data/sql_data.md#create-a-batch-definition), [filesystem](/core/connect_to_data/filesystem_data/filesystem_data.md#create-a-batch-definition), or [dataframe](/core/connect_to_data/dataframes/dataframes.md#create-a-batch-definition) data |
179
-
| Validate |[Run a Validation](/docs/cloud/validations/manage_validations.md#run-a-validation) using the GX Cloud UI or [run a Checkpoint](/core/trigger_actions_based_on_results/run_a_checkpoint.md) with the GX Cloud API |[Create a Validation Definition and run it](/core/run_validations/run_validations.md) with the GX Cloud API |
179
+
| Ad hoc Validation |[Run a Validation](/docs/cloud/validations/manage_validations.md#run-a-validation) using the GX Cloud UI or [run a Checkpoint](/core/trigger_actions_based_on_results/run_a_checkpoint.md) with the GX Cloud API |[Create a Validation Definition and run it](/core/run_validations/run_validations.md) with the GX Cloud API |
180
+
| Recurring Validations |[Schedule Validations](/cloud/schedules/manage_schedules.md) in the GX Cloud UI | Not supported, use an [orchestrator](/cloud/connect/connect_airflow.md) to control recurring validations |
180
181
| Validation Results |[Access results in the Validations tab](/cloud/validations/manage_validations.md#view-validation-run-history) of the GX Cloud UI |[Access results with the GX Cloud API](/core/trigger_actions_based_on_results/choose_a_result_format/choose_a_result_format.md) or in the Validations tab of the GX Cloud UI |
181
-
| Schedule | Keep default schedule or [edit schedule](/cloud/schedules/manage_schedules.md) in the GX Cloud UI | Not supported, use an [orchestrator](/cloud/connect/connect_airflow.md) to control recurring validations |
182
182
| Expectation Suite | Automatically organized in a hidden default Expectation Suite | Manually grouped into [custom Expectation Suites](/core/define_expectations/organize_expectation_suites.md) via the GX Cloud API |
183
183
| Delete |[Delete Expectation](/docs/cloud/expectations/manage_expectations/#delete-an-expectation) with the GX Cloud UI |[Delete Expectation with the GX Cloud API](/reference/api/ExpectationSuite_class.mdx#great_expectations.ExpectationSuite.delete_expectation) or the GX Cloud UI |
Copy file name to clipboardExpand all lines: docs/docusaurus/docs/cloud/expectations/manage_expectations.md
+4-2Lines changed: 4 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,11 +32,13 @@ This page provides instructions for working with Expectations. To learn about Ex
32
32
33
33
5. Select an Expectation type.
34
34
35
-
6. Complete the mandatory and optional fields for the Expectation. A recurring [validation schedule](/cloud/schedules/manage_schedules.md) will be applied automatically to your Expectation.
35
+
6. Complete the mandatory and optional fields for the Expectation.
36
36
37
37
7. Click **Save** or click **Save & Add More** and then repeat steps 4 through 7 to add additional Expectations.
38
38
39
-
8. Optional. Run a Validation. See [Run a Validation](/cloud/validations/manage_validations.md#run-a-validation).
39
+
8. Optional. Run an ad hoc Validation. See [Run a Validation](/cloud/validations/manage_validations.md#run-a-validation).
40
+
41
+
9. Optional. Configure recurring Validations. See [Manage schedules](/docs/cloud/schedules/manage_schedules).
40
42
41
43
42
44
## Save time with ExpectAI <spanclass="beta">Beta</span>
Copy file name to clipboardExpand all lines: docs/docusaurus/docs/cloud/overview/accelerating_test_coverage.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,7 +11,7 @@ GX Cloud provides several conveniences to help you more quickly achieve test cov
11
11
12
12
## Anomaly Detection
13
13
14
-
When you [add a new Data Asset](/cloud/data_assets/manage_data_assets.md), GX Cloud by default generates Expectations to detect anomalies in the following data quality issues. You can also automate Anomaly Detection for these when you [add Expectations](/cloud/expectations/manage_expectations.md#add-an-expectation) for an existing Data Asset.
14
+
When you [add a new Data Asset](/cloud/data_assets/manage_data_assets.md), you can have GX Cloud generate Expectations to detect anomalies in the following data quality issues. You can also automate Anomaly Detection for these when you [add Expectations](/cloud/expectations/manage_expectations.md#add-an-expectation) for an existing Data Asset.
15
15
16
16
-[Schema](#schema)
17
17
-[Volume](#volume)
@@ -22,16 +22,16 @@ When you [add a new Data Asset](/cloud/data_assets/manage_data_assets.md), GX Cl
22
22
23
23
### Schema
24
24
25
-
To detect schema anomalies, we automatically generate a rule to [**expect table columns to match set**](/reference/learn/data_quality_use_cases/schema.md#expect-table-columns-to-match-set) using the Data Asset’s initial columns as the set to match. If the number or names of columns in the Data Asset change, this Expectation will fail.
25
+
To detect schema anomalies, we generate a rule to [**expect table columns to match set**](/reference/learn/data_quality_use_cases/schema.md#expect-table-columns-to-match-set) using the Data Asset’s initial columns as the set to match. If the number or names of columns in the Data Asset change, this Expectation will fail.
26
26
27
27
### Volume
28
28
29
-
To detect anomalies in row count, we automatically generate a rule to [**expect table row count to be between**](/reference/learn/data_quality_use_cases/volume.md#expect-table-row-count-to-be-between) a forecasted range that tests that the current validation run doesn’t deviate significantly from historical patterns. For example, if there is a sudden increase when volume has been stable or stagnation in a season when volume typically grows, then this Expectation will fail.
29
+
To detect anomalies in row count, we generate a rule to [**expect table row count to be between**](/reference/learn/data_quality_use_cases/volume.md#expect-table-row-count-to-be-between) a forecasted range that tests that the current validation run doesn’t deviate significantly from historical patterns. For example, if there is a sudden increase when volume has been stable or stagnation in a season when volume typically grows, then this Expectation will fail.
30
30
31
31
32
32
### Completeness
33
33
34
-
To detect completeness anomalies, we automatically generate rules for every column to [**expect column proportion of non-null values to be between**](/reference/learn/data_quality_use_cases/missingness.md#expect-column-proportion-of-non-null-values-to-be-between) a forecasted range that depends on the column's initial proportion of non-null values.
34
+
To detect completeness anomalies, we generate rules for every column to [**expect column proportion of non-null values to be between**](/reference/learn/data_quality_use_cases/missingness.md#expect-column-proportion-of-non-null-values-to-be-between) a forecasted range that depends on the column's initial proportion of non-null values.
35
35
36
36
- If a column initially has no null values, GX Cloud generates a rule to test that the column continues to have no null values.
37
37
- If a column initially has all null values, GX Cloud generates a rule to test that the column continues to have all null values.
Copy file name to clipboardExpand all lines: docs/docusaurus/docs/cloud/schedules/manage_schedules.md
+17-1Lines changed: 17 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,13 +4,29 @@ title: 'Manage schedules'
4
4
description: Create and manage schedules for Validations in GX Cloud.
5
5
---
6
6
7
-
Use a schedule to automate data quality checks with GX-managed Expectations. When you add your first Expectation in the GX Cloud UI for a Data Asset, including when you choose to auto-generate Expectations for Anomaly Detection, we enable a default schedule for that Asset's GX-managed Expectations. By default, GX-managed Expectations are scheduled to run every 24 hours. The first run will be at the start of the next hour after you add your first Expectation in the Cloud UI. You can keep the default schedule, edit it, or disable it.
7
+
Use a schedule to automate data quality checks with GX-managed Expectations.
8
8
9
9
:::note Schedules are for GX-managed Expectations only
10
10
To automate data quality checks for [API-managed Expectations](/cloud/expectations/manage_expectations.md#gx-managed-vs-api-managed-expectations), use an [orchestrator](/cloud/connect/connect_airflow.md).
11
11
:::
12
12
13
13
14
+
## Enable a schedule
15
+
16
+
1. In GX Cloud, select the relevant **Workspace** and then click **Data Assets**.
17
+
18
+
2. In the **Data Assets** list, click the Data Asset name.
19
+
20
+
3. Next to **No scheduled validation**, click <imgsrc="/img/pencil.png"alt="pencil icon"width="20"height="20"/> **Edit schedule**.
21
+
22
+
4. Turn the Validation schedule **ON**.
23
+
24
+
5. Select a **Frequency**.
25
+
26
+
6. Select a **Start time** for the first run of the new schedule.
27
+
28
+
7. Click **Save**.
29
+
14
30
## Edit a schedule
15
31
16
32
1. In GX Cloud, select the relevant **Workspace** and then click **Data Assets**.
0 commit comments