You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[SPARK-51850] Fix DataFrame.execute to reset previously received Arrow batch data
### What changes were proposed in this pull request?
This PR aims to fix `DataFrame.execute` to reset previously received Arrow batch data.
### Why are the changes needed?
To prevent wrong data duplication when repeating execution on the same `DataFrame`.
### Does this PR introduce _any_ user-facing change?
This, this is a bug fix.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes#72 from dongjoon-hyun/SPARK-51850.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
0 commit comments