Skip to content

Commit a3d9501

Browse files
committed
fix: removing created cast function
1 parent fe97979 commit a3d9501

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/bronze/python/incremental_load.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -120,7 +120,7 @@ def delta_load(spark: SparkSession, jdbc_url:str, MYSQL_USER:str, MYSQL_SECRET:s
120120

121121
last_update = datetime.now().isoformat()
122122
#incremental_df = new_df.withColumn("created", F.date_format("created", "yyyy-MM-dd'T'HH:mm:ss.SSSSSS"))
123-
incremental_df = add_ingestion_metadata_column(df=incremental_df,table=table)
123+
incremental_df = add_ingestion_metadata_column(df=new_df,table=table)
124124
saveTale = f"bronze_local.entidades.{table}"
125125
incremental_df.write.format("iceberg").mode("append").saveAsTable(saveTale)
126126

0 commit comments

Comments
 (0)