File tree Expand file tree Collapse file tree 1 file changed +8
-4
lines changed
docs/source/contributor-guide Expand file tree Collapse file tree 1 file changed +8
-4
lines changed Original file line number Diff line number Diff line change @@ -67,16 +67,16 @@ ENABLE_COMET=true build/sbt "hive/testOnly * -- -n org.apache.spark.tags.SlowHiv
6767```
6868#### Steps to run individual test suites through SBT
69691 . Open SBT with Comet enabled
70- ``` sbt
71- ENABLE_COMET = true sbt - Dspark .test.includeSlowTests= true
70+ ``` shell
71+ ENABLE_COMET=true sbt -J-Xmx4096m - Dspark.test.includeSlowTests=true
7272```
73732 . Run individual tests (Below code runs test named ` SPARK-35568 ` in the ` spark-sql ` module)
74- ``` sbt
74+ ``` shell
7575 sql/testOnly org.apache.spark.sql.DynamicPartitionPruningV1SuiteAEOn -- -z " SPARK-35568"
7676```
7777#### Steps to run individual test suites in IntelliJ IDE
78781 . Add below configuration in VM Options for your test case (apache-spark repository)
79- ``` sbt
79+ ``` shell
8080-Dspark.comet.enabled=true -Dspark.comet.debug.enabled=true -Dspark.plugins=org.apache.spark.CometPlugin -DXmx4096m -Dspark.executor.heartbeatInterval=20000 -Dspark.network.timeout=10000 --add-exports=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED
8181```
82822 . Set ` ENABLE_COMET=true ` in environment variables
@@ -138,8 +138,12 @@ wiggle --replace ./sql/core/src/test/scala/org/apache/spark/sql/SubquerySuite.sc
138138The diff file can be generated using the ` git diff ` command. It may be necessary to set the ` core.abbrev `
139139configuration setting to use 11 digits hashes for consistency with existing diff files.
140140
141+ Note that there is an ` IgnoreComet.scala ` that is not part of the Spark codebase, and therefore needs to be added
142+ using ` git add ` before generating the diff.
143+
141144``` shell
142145git config core.abbrev 11;
146+ git add sql/core/src/test/scala/org/apache/spark/sql/IgnoreComet.scala
143147git diff v3.5.6 > ../datafusion-comet/dev/diffs/3.5.6.diff
144148```
145149
You can’t perform that action at this time.
0 commit comments