Commit 57780bc

authored

perf: [iceberg] Remove IcebergFileStream, use iceberg-rust's parallelization, bump iceberg-rust to latest, cache SchemaAdapter (#3051)

1 parent 4589172 commit 57780bcCopy full SHA for 57780bc

7 files changed

+377

-591

lines changed

native
- Cargo.lock
- Cargo.toml
- core
  - Cargo.toml
  - src/execution
    - operators
      - iceberg_scan.rs
    - planner.rs
spark/src
- main/scala/org/apache/spark/sql/comet
  - CometIcebergNativeScanExec.scala
- test/scala/org/apache/comet
  - CometIcebergNativeSuite.scala

+377

-591

lines changed

Comments

(0)