python-v1.2.0

What's Changed

• feat!: kernel log replay by @roeap in #3660
• chore: update hdfs object store to 0.15 by @Kimahriman in #3681
• fix(pandas): implement-automatic-conversion-for-pandas-null-types by @fvaleye in #3695
• fix(format): fix formatting in Python for conversion file by @fvaleye in #3705
• chore: remove unused dependencies by @rtyler in #3698
• fix: enabling correctly pulling partition values out of column mapped tables by @rtyler in #3706
• feat!: use kernel predicates on file streams by @roeap in #3669
• fix: reintroduce the 100 commit checkpoint interval by @rtyler in #3708
• chore: follow up changes on rust-v0.28.0 by @rtyler in #3712
• chore(cargo): add cargo-machete to detect and remove unused dependencies by @fvaleye in #3713
• chore: update kernel to 0.15.1 by @roeap in #3714
• feat(storage): expand user with tilde in local path by @fvaleye in #3717
• chore: bump to a minor version for a small core release with the new kernel by @rtyler in #3718
• feat: domain metadata read support by @roeap in #3678
• chore!: remove deprecated methods by @roeap in #3715
• refactor: move table provider to dedicated mod by @roeap in #3726
• feat(url): use Url in Rust for accessing to DeltaTable, use only string-based api in Python by @fvaleye in #3707
• chore(ci): cache rust dependencies in the CI by @fvaleye in #3728
• refactor: avoid explicit mutex in MergeBarrier by @roeap in #3734
• fix: re-export the DecimalType for consumers by @rtyler in #3738
• fix: write_deltalake with mode="overwrite" mode and schema_mode=None does not overwrite schema metadata by @FrankPortman in #3747
• feat: add per column Parquet Encoding support for Delta Table column by @niltecedu in #3737
• fix: better error handles in unity client by @hntd187 in #3752
• feat(datafusion): add insert_into operation with DataFusion by @fvaleye in #3762
• fix: ensure that invalid URLs are bubbled up as errors when parsed by @rtyler in #3766
• feat: change history() to return an Iterator by @rtyler in #3764
• chore: update docs by @ion-elgreco in #3761
• feat: update to DataFusion 50, pyo3 24, pyo3-arrow 0.11 by @alamb in #3749
• feat: allow OptimizeBuilder to accept SessionConfig for finer-grained control of execution by @rtyler in #3763
• feat(unity-catalog): support credentials via storage options by @fvaleye in #3769
• fix: check if eligible to read by @ion-elgreco in #3771
• chore: upgrade the aws dependencies in deltalake-aws by @rtyler in #3772
• chore: pin cargo-machete action to the sha right before a regression by @rtyler in #3779
• chore: fix some typos in comment by @juejinyuxitu in #3781
• chore: upgrade to delta-kernel-rs 0.16.0 and remove more dependencies by @rtyler in #3773
• feat: get the delta table row count based on the table history by @ohadmata in #3732
• fix: somehow the right test value didn't make it into the pr by @rtyler in #3788
• fix: correct RecordBatchWriter interior schema mutation outside of evolution by @rtyler in #3783
• fix: use a safe checkpoint when cleaning up metadata by @corwinjoy in #3748
• chore(deps): update sqlparser requirement from 0.56.0 to 0.59.0 by @dependabot[bot] in #3792
• chore(ci): add automatic cache cleanup for closed main branch PRs by @fvaleye in #3793
• chore(deps): update foyer requirement from 0.17.2 to 0.20.0 by @dependabot[bot] in #3791
• refactor: use EagerSnapshot in datafusion module by @roeap in #3796
• feat: allow passing a SessionState into a OptimizeBuilder by @abhi-airspace-intelligence in #3802
• refactor: remove table_url from Snapshot by @roeap in #3803
• fix: maintaining load config from state by @ion-elgreco in #3805
• refactor: consolidate extension planners by @roeap in #3804
• ci: split out integration tests by @roeap in #3806
• feat: access tombstones via TombstoneView by @roeap in #3809
• refactor: use EagerSnapshot in vacuum operation by @roeap in #3812
• fix: avoid overflow for large table state by @roeap in #3801
• refactor: avoid downcasting to SessionState by @roeap in #3813
• feat: add deletion_vector_descriptor method by @zeevm in #3721
• refactor: move find_files into dedicated mod by @roeap in #3815
• chore: remove unreferenced file by @roeap in #3819
• feat: shim kernel Scan and ScanBuilder by @roeap in #3818
• chore(deps): update datatest-stable requirement from 0.2 to 0.3 by @dependabot[bot] in #3817
• feat: expose arrow schema on snapshots by @roeap in #3822
• fix: update deprecation versions to next release by @roeap in #3828
• chore: unify inconsistent SessionState in datafusion operations by @abhi-airspace-intelligence in #3816
• fix(rust): protect recent uncommitted files in vacuum full mode by @vsmanish1772 in #3835
• feat: enable ability to do writes through Unity Catalog by @hntd187 in #3834
• chore(performance): optimize JSON parsing in get_actions and snapshot reading by @fvaleye in #3830
• refactor(bench): remove baseline while keeping the json_parsing benchmark by @fvaleye in #3838
• perf(path): only clone string for the path by @fvaleye in #3841
• feat(tracing): add tracing spans to all I/O sections by @fvaleye in #3795
• feat(bench): add new benchmarking script, harness, and profiling guide by @abhiaagarwal in #3840
• chore: bump version from 1.1.4 to 1.2.0 by @ion-elgreco in #3842

New Contributors

• @FrankPortman made their first contribution in #3747
• @niltecedu made their first contribution in #3737
• @juejinyuxitu made their first contribution in #3781
• @ohadmata made their first contribution in #3732
• @abhi-airspace-intelligence made their first contribution in #3802
• @vsmanish1772 made their first contribution in #3835

Full Changelog: python-v1.1.4...python-v1.2.0