Skip to content

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Apr 7, 2025

What changes were proposed in this pull request?

This PR aims to change the visibility of the following.

  • enum SparkConnectError
  • StorageLevel fields

In addition, this PR changes the following test suite to use only public APIs of SparkConnect by changing the import statement. This will help us validate the visibility change easily.

  • DataFrameTests
  • DataFrameReaderTests
  • DataFrameWriterTests
  • SQLTests

Why are the changes needed?

To allow users to use SparkConnectError and StorageLevel.

Does this PR introduce any user-facing change?

No. This is a visibility change on the unreleased versions.

How was this patch tested?

Pass the CIs and manual review.

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun
Copy link
Member Author

Thank you, @viirya . Merged to main.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-51736 branch April 7, 2025 14:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants