Skip to content

Commit d8c26be

Browse files
anshbansalsleeperdeep
authored andcommitted
fix(ingest): add error handling (datahub-project#11905)
1 parent f59a905 commit d8c26be

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

metadata-ingestion/src/datahub/ingestion/source/gc/dataprocess_cleanup.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -401,7 +401,10 @@ def get_workunits_internal(self) -> Iterable[MetadataWorkUnit]:
401401
total_runs=job.get("entity").get("runs").get("total"),
402402
)
403403
if datajob_entity.total_runs > 0:
404-
self.delete_dpi_from_datajobs(datajob_entity)
404+
try:
405+
self.delete_dpi_from_datajobs(datajob_entity)
406+
except Exception as e:
407+
logger.error(f"While trying to delete {datajob_entity} got {e}")
405408
if (
406409
datajob_entity.total_runs == 0
407410
and self.config.delete_empty_data_jobs

0 commit comments

Comments
 (0)