Skip to content

Commit bec678a

Browse files
SbloodySSbloodyS
authored
[DSIP-78][Data Quality] Remove data quality module (#16794)
1 parent 8340f3f commit bec678a

File tree

211 files changed

+54
-16517
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

211 files changed

+54
-16517
lines changed

‎.github/CODEOWNERS‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,6 @@
2626
/dolphinscheduler-common/ @SbloodyS
2727
/dolphinscheduler-dao/ @SbloodyS @ruanwenjun
2828
/dolphinscheduler-dao-plugin/ @SbloodyS @ruanwenjun
29-
/dolphinscheduler-data-quality/ @SbloodyS
3029
/dolphinscheduler-datasource-plugin/ @SbloodyS
3130
/dolphinscheduler-dist/ @SbloodyS
3231
/dolphinscheduler-e2e/ @SbloodyS

‎.github/actions/labeler/labeler.yml‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,6 @@ backend:
2323
- 'dolphinscheduler-common/**/*'
2424
- 'dolphinscheduler-dao/**/*'
2525
- 'dolphinscheduler-dao-plugin/**/*'
26-
- 'dolphinscheduler-data-quality/**/*'
2726
- 'dolphinscheduler-datasource-plugin/**/*'
2827
- 'dolphinscheduler-dist/**/*'
2928
- 'dolphinscheduler-extract/**/*'

‎config/plugins_config‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -77,7 +77,6 @@ dolphinscheduler-storage-s3
7777
dolphinscheduler-task-aliyunserverlessspark
7878
dolphinscheduler-task-chunjun
7979
dolphinscheduler-task-datafactory
80-
dolphinscheduler-task-dataquality
8180
dolphinscheduler-task-datasync
8281
dolphinscheduler-task-datax
8382
dolphinscheduler-task-dinky

‎deploy/kubernetes/dolphinscheduler/README.md‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -131,7 +131,6 @@ Please refer to the [Quick Start in Kubernetes](../../../docs/docs/en/guide/inst
131131
| conf.common."aws.s3.endpoint" | string | `"http://minio:9000"` | You need to set this parameter when private cloud s3. If S3 uses public cloud, you only need to set resource.aws.region or set to the endpoint of a public cloud such as S3.cn-north-1.amazonaws.com.cn |
132132
| conf.common."aws.s3.region" | string | `"ca-central-1"` | The AWS Region to use. if resource.storage.type=S3, This configuration is required |
133133
| conf.common."conda.path" | string | `"/opt/anaconda3/etc/profile.d/conda.sh"` | set path of conda.sh |
134-
| conf.common."data-quality.jar.dir" | string | `nil` | data quality option |
135134
| conf.common."data.basedir.path" | string | `"/tmp/dolphinscheduler"` | user data local directory path, please make sure the directory exists and have read write permissions |
136135
| conf.common."datasource.encryption.enable" | bool | `false` | datasource encryption enable |
137136
| conf.common."datasource.encryption.salt" | string | `"!@#$%^&*"` | datasource encryption salt |

‎deploy/kubernetes/dolphinscheduler/values.yaml‎

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -336,9 +336,6 @@ conf:
336336
# -- datasource encryption salt
337337
datasource.encryption.salt: '!@#$%^&*'
338338

339-
# -- data quality option
340-
data-quality.jar.dir:
341-
342339
# -- Whether hive SQL is executed in the same session
343340
support.hive.oneSession: false
344341

@@ -987,7 +984,6 @@ api:
987984
# cloud: []
988985
# logic: []
989986
# dataIntegration: []
990-
# dataQuality: []
991987
# machineLearning: []
992988
# other: []
993989

‎docs/configs/docsdev.js‎

Lines changed: 0 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -457,10 +457,6 @@ export default {
457457
}
458458
],
459459
},
460-
{
461-
title: 'Data Quality',
462-
link: '/en-us/docs/dev/user_doc/guide/data-quality.html',
463-
},
464460
{
465461
title: 'Remote Logging',
466462
link: '/en-us/docs/dev/user_doc/guide/remote-logging.html',
@@ -1160,10 +1156,6 @@ export default {
11601156
}
11611157
],
11621158
},
1163-
{
1164-
title: '数据质量',
1165-
link: '/zh-cn/docs/dev/user_doc/guide/data-quality.html',
1166-
},
11671159
{
11681160
title: '远程日志存储',
11691161
link: '/zh-cn/docs/dev/user_doc/guide/remote-logging.html',

‎docs/docs/en/architecture/configuration.md‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -224,7 +224,6 @@ The default configuration is as follows:
224224
| yarn.job.history.status.address | http://ds1:19888/ws/v1/history/mapreduce/jobs/%s | job history status url of yarn |
225225
| datasource.encryption.enable | false | whether to enable datasource encryption |
226226
| datasource.encryption.salt | !@#$%^&* | the salt of the datasource encryption |
227-
| data-quality.jar.dir | | the jar of data quality |
228227
| support.hive.oneSession | false | specify whether hive SQL is executed in the same session |
229228
| sudo.enable | true | whether to enable sudo |
230229
| alert.rpc.port | 50052 | the RPC port of Alert Server |

0 commit comments

Comments
 (0)