Skip to content

Conversation

@nsivabalan
Copy link
Contributor

Describe the issue this Pull Request addresses

Summary and Changelog

Impact

Risk Level

Documentation Update

Contributor's checklist

  • Read through contributor's guide
  • Enough context is provided in the sections above
  • Adequate tests were added if applicable

XianghuiBai and others added 30 commits December 6, 2025 11:50
…lustering for partitions with only one left small file (apache#14087)
* feat: introduce pk filter push-down to base file

---------

Signed-off-by: TheR1sing3un <[email protected]>
* perf: reduce unnecessary row group metadata loading

---------

Signed-off-by: TheR1sing3un <[email protected]>
…e should the meta fields be eliminated (apache#14230)

Signed-off-by: TheR1sing3un <[email protected]>
1. introduce pk filter to log file

Signed-off-by: TheR1sing3un <[email protected]>
…rPushDown` (apache#14332)

1. push down pk filters to log file when spark enable `parquetFilterPushDown`

The previous judgment logic was a typo error.
Whether to push down depends on the `parquetFilterPushDown`,
while whether to perform a record filter at the parquet level depends on the `parquetRecordFilterEnabled`

Signed-off-by: TheR1sing3un <[email protected]>
…ion in the compaction plan (apache#14362)

fix the metrics for file slice with filtered log files.

---------

Signed-off-by: TheR1sing3un <[email protected]>
Co-authored-by: danny0405 <[email protected]>
the corner case: the load instant range is contained within one of the archived file instant range.

---------

Signed-off-by: TheR1sing3un <[email protected]>
Co-authored-by: danny0405 <[email protected]>
@github-actions github-actions bot added the size:XL PR with lines of changes > 1000 label Dec 12, 2025
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Copy link
Contributor

@yihua yihua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Closing the testing-only PR

@yihua yihua closed this Dec 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XL PR with lines of changes > 1000

Projects

None yet

Development

Successfully merging this pull request may close these issues.