Skip to content

Commit 40a4436

Browse files
committed
NRL-1320 Exit if df is null
1 parent 0ee2fd4 commit 40a4436

File tree

1 file changed

+2
-0
lines changed
  • terraform/account-wide-infrastructure/modules/glue/src

1 file changed

+2
-0
lines changed

terraform/account-wide-infrastructure/modules/glue/src/pipeline.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -89,6 +89,8 @@ def transform(self, dataframe):
8989
def load(self, data):
9090
"""Load transformed data into Parquet format"""
9191
self.logger.info(f"Loading data into {self.target_path} as Parquet")
92+
if not data:
93+
return None
9294
for name, dataframe in data.items():
9395
name = name.replace("--", "_")
9496
dataframe.write.mode("append").partitionBy(*self.partition_cols).parquet(

0 commit comments

Comments
 (0)