0.14.0 (2025-09-08)
·
207 commits
to develop
since this release
Features
- Add Spark 4.0 support. (#297)
- Add
Icebergconnection support. For now this is alpha version, and behavior may change in future. (#378, #386)
Breaking Changes
-
Drop Spark 2 support. Minimal supported Spark version is 3.2. (#383)
Also dropped:
Greenplum.package_spark_2_3Greenplum.package_spark_2_4
-
Update DB connectors/drivers to latest versions:
- MongoDB
10.4.1→10.5.0 - MySQL
9.2.0→9.4.0 - MSSQL
12.8.10→13.2.0 - Oracle
23.7.0.25.01→23.9.0.25.07 - Postgres
42.7.5→42.7.7
- MongoDB
-
Update Excel package name from
com.crealytics:spark-exceltodev.mauch:spark-excel. (#382) -
Now
Excel.get_packages(package_version=...)parameter is mandatory. (#382)
Improvements
- Return full file/directory path from
FileConnection.list_dirandFileConnection.walk. (#381)
Previously these methods returned only file names. - Speed up removing S3 and Samba directories with
recursive=True. (#380)
Bug fixes
- Treat S3 objects with names ending with a
/slash as directory marker. (#379)