Skip to content

Commit 38258a5

Browse files
committed
[SPARK-52077][PYTHON][CONNECT][TEST] Skip ArrowUDTFParityTests in Spark Connect compatibility test
### What changes were proposed in this pull request? This PR proposes to skip ArrowUDTFParityTests in Spark Connect compatibility test for now. ### Why are the changes needed? After #50099, the compatibility test fails https://github.com/apache/spark/actions/runs/14959668798/job/42019945629 In fact, UDTF with Arrow is still under development so we can skip the tests for now ### Does this PR introduce _any_ user-facing change? No, test-only. ### How was this patch tested? Will monitor the build. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #50856 from HyukjinKwon/SPARK-44856-followup. Authored-by: Hyukjin Kwon <gurwls223@apache.org> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org> (cherry picked from commit dfc8175) Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
1 parent 2a6ddde commit 38258a5

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

python/pyspark/sql/tests/connect/test_parity_udtf.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -132,6 +132,10 @@ def test_udtf_with_wrong_num_input(self):
132132
super(UDTFParityTests, self).test_udtf_with_wrong_num_input()
133133

134134

135+
@unittest.skipIf(
136+
os.environ.get("SPARK_SKIP_CONNECT_COMPAT_TESTS") == "1",
137+
"Python UDTF with Arrow is still under development.",
138+
)
135139
class ArrowUDTFParityTests(UDTFArrowTestsMixin, UDTFParityTests):
136140
@classmethod
137141
def setUpClass(cls):

0 commit comments

Comments
 (0)