Skip to content

[SPARK-52077][PYTHON][CONNECT][TEST] Skip ArrowUDTFParityTests in Spark Connect compatibility test#50856

Closed
HyukjinKwon wants to merge 1 commit intoapache:masterfrom
HyukjinKwon:SPARK-44856-followup
Closed

[SPARK-52077][PYTHON][CONNECT][TEST] Skip ArrowUDTFParityTests in Spark Connect compatibility test#50856
HyukjinKwon wants to merge 1 commit intoapache:masterfrom
HyukjinKwon:SPARK-44856-followup

Conversation

@HyukjinKwon
Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR proposes to skip ArrowUDTFParityTests in Spark Connect compatibility test for now.

Why are the changes needed?

After #50099, the compatibility test fails https://github.com/apache/spark/actions/runs/14959668798/job/42019945629

In fact, UDTF with Arrow is still under development so we can skip the tests for now

Does this PR introduce any user-facing change?

No, test-only.

How was this patch tested?

Will monitor the build.

Was this patch authored or co-authored using generative AI tooling?

No.

@HyukjinKwon HyukjinKwon force-pushed the SPARK-44856-followup branch from b8cf950 to 602c93c Compare May 12, 2025 09:27
@HyukjinKwon
Copy link
Copy Markdown
Member Author

Merged to master, branch-4.0 and branch-3.5.

HyukjinKwon added a commit that referenced this pull request May 12, 2025
…rk Connect compatibility test

This PR proposes to skip ArrowUDTFParityTests in Spark Connect compatibility test for now.

After #50099, the compatibility test fails https://github.com/apache/spark/actions/runs/14959668798/job/42019945629

In fact, UDTF with Arrow is still under development so we can skip the tests for now

No, test-only.

Will monitor the build.

No.

Closes #50856 from HyukjinKwon/SPARK-44856-followup.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
(cherry picked from commit dfc8175)
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
HyukjinKwon added a commit that referenced this pull request May 12, 2025
…rk Connect compatibility test

### What changes were proposed in this pull request?

This PR proposes to skip ArrowUDTFParityTests in Spark Connect compatibility test for now.

### Why are the changes needed?

After #50099, the compatibility test fails https://github.com/apache/spark/actions/runs/14959668798/job/42019945629

In fact, UDTF with Arrow is still under development so we can skip the tests for now

### Does this PR introduce _any_ user-facing change?

No, test-only.

### How was this patch tested?

Will monitor the build.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #50856 from HyukjinKwon/SPARK-44856-followup.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
(cherry picked from commit dfc8175)
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
yhuang-db pushed a commit to yhuang-db/spark that referenced this pull request Jun 9, 2025
…rk Connect compatibility test

### What changes were proposed in this pull request?

This PR proposes to skip ArrowUDTFParityTests in Spark Connect compatibility test for now.

### Why are the changes needed?

After apache#50099, the compatibility test fails https://github.com/apache/spark/actions/runs/14959668798/job/42019945629

In fact, UDTF with Arrow is still under development so we can skip the tests for now

### Does this PR introduce _any_ user-facing change?

No, test-only.

### How was this patch tested?

Will monitor the build.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#50856 from HyukjinKwon/SPARK-44856-followup.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 14, 2025
…rk Connect compatibility test

This PR proposes to skip ArrowUDTFParityTests in Spark Connect compatibility test for now.

After apache#50099, the compatibility test fails https://github.com/apache/spark/actions/runs/14959668798/job/42019945629

In fact, UDTF with Arrow is still under development so we can skip the tests for now

No, test-only.

Will monitor the build.

No.

Closes apache#50856 from HyukjinKwon/SPARK-44856-followup.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
(cherry picked from commit 9bb0409)
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants