Skip to content

Conversation

@zhengruifeng
Copy link
Contributor

What changes were proposed in this pull request?

Avoid repeatedly fetching config binary_as_bytes

Why are the changes needed?

Method _get_binary_as_bytes trigger a Config RPC to fetch the config value

Does this PR introduce any user-facing change?

No

How was this patch tested?

CI

Was this patch authored or co-authored using generative AI tooling?

No

@github-actions
Copy link

github-actions bot commented Jan 7, 2026

JIRA Issue Information

=== Improvement SPARK-54933 ===
Summary: Avoid repeatedly fetching config binary_as_bytes in toLocalIterator
Assignee: None
Status: Open
Affected: ["4.2.0"]


This comment was automatically generated by GitHub Actions

@HyukjinKwon
Copy link
Member

Merged to master.

@zhengruifeng zhengruifeng deleted the to_local_iter_conf branch January 8, 2026 00:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants