Skip to content

Commit 2c61a58

Browse files
committed
finally raise an error if one of the data quality check fails
1 parent 0a281cb commit 2c61a58

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

scripts/jobs/planning/tascomi_create_daily_snapshot.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -357,5 +357,6 @@ def purge_today_partition(
357357
finally:
358358
if len(dq_errors) > 0:
359359
logger.error(f"DQ Errors: {dq_errors}")
360+
raise Exception(f"Data quality check failed: {'; '.join(dq_errors)}")
360361
spark.sparkContext._gateway.close()
361362
spark.stop()

0 commit comments

Comments
 (0)