Skip to content

Commit 2056ace

Browse files
authored
Update Iceberg docs for 0.10 release (#2355)
1 parent bb318a5 commit 2056ace

File tree

1 file changed

+1
-4
lines changed

1 file changed

+1
-4
lines changed

docs/source/user-guide/latest/iceberg.md

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,7 @@ $SPARK_HOME/bin/spark-shell \
8080
--conf spark.sql.catalog.spark_catalog.type=hadoop \
8181
--conf spark.sql.catalog.spark_catalog.warehouse=/tmp/warehouse \
8282
--conf spark.plugins=org.apache.spark.CometPlugin \
83-
--conf spark.comet.exec.shuffle.enabled=false \
83+
--conf spark.shuffle.manager=org.apache.spark.sql.comet.execution.shuffle.CometShuffleManager \
8484
--conf spark.sql.iceberg.parquet.reader-type=COMET \
8585
--conf spark.comet.explainFallback.enabled=true \
8686
--conf spark.memory.offHeap.enabled=true \
@@ -143,8 +143,5 @@ scala> spark.sql(s"SELECT * from t1").explain()
143143
```
144144

145145
## Known issues
146-
- We temporarily disable Comet when there are delete files in Iceberg scan, see Iceberg [1.8.1 diff](https://github.com/apache/datafusion-comet/blob/main/dev/diffs/iceberg/1.8.1.diff) and this [PR](https://github.com/apache/iceberg/pull/13793)
147-
- Iceberg scan w/ delete files lead to [runtime exceptions](https://github.com/apache/datafusion-comet/issues/2117) and [incorrect results](https://github.com/apache/datafusion-comet/issues/2118)
148-
- Enabling `CometShuffleManager` leads to [runtime exceptions](https://github.com/apache/datafusion-comet/issues/2086)
149146
- Spark Runtime Filtering isn't [working](https://github.com/apache/datafusion-comet/issues/2116)
150147
- You can bypass the issue by either setting `spark.sql.adaptive.enabled=false` or `spark.comet.exec.broadcastExchange.enabled=false`

0 commit comments

Comments
 (0)