Skip to content

Commit fe97979

Browse files
committed
fix: removing created cast function
1 parent 6908e62 commit fe97979

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/bronze/python/incremental_load.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -119,7 +119,7 @@ def delta_load(spark: SparkSession, jdbc_url:str, MYSQL_USER:str, MYSQL_SECRET:s
119119
.load()
120120

121121
last_update = datetime.now().isoformat()
122-
incremental_df = new_df.withColumn("created", F.date_format("created", "yyyy-MM-dd'T'HH:mm:ss.SSSSSS"))
122+
#incremental_df = new_df.withColumn("created", F.date_format("created", "yyyy-MM-dd'T'HH:mm:ss.SSSSSS"))
123123
incremental_df = add_ingestion_metadata_column(df=incremental_df,table=table)
124124
saveTale = f"bronze_local.entidades.{table}"
125125
incremental_df.write.format("iceberg").mode("append").saveAsTable(saveTale)

0 commit comments

Comments
 (0)