Skip to content

branch-4.0: [optimize](parquet-reader) Optimize performance by parquet bloom filter. #59727

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morningman merged 1 commit into from
Jan 12, 2026
Merged

branch-4.0: [optimize](parquet-reader) Optimize performance by parquet bloom filter. #59727

morningman merged 1 commit into from
Jan 12, 2026

Conversation

@kaka11chen
Copy link
Contributor

@kaka11chen kaka11chen commented Jan 9, 2026 •
edited by morningman
Loading

Cherry-pick #57959

@kaka11chen kaka11chen requested a review from yiguolei as a code owner January 9, 2026 09:47
@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 9, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@kaka11chen
Copy link
Contributor Author

kaka11chen commented Jan 9, 2026

run buildall

@kaka11chen kaka11chen changed the title [optimize](parquet-reader) Optimize performace by parquet bloom filter. [optimize](parquet-reader) Optimize performance by parquet bloom filter. Jan 9, 2026
@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 9, 2026

FE UT Coverage Report

Increment line coverage 66.67% (2/3) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

doris-robot commented Jan 9, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.53% (1756/2208)
Line Coverage 65.50% (30815/47047)
Region Coverage 65.92% (15307/23221)
Branch Coverage 56.57% (8132/14374)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 9, 2026

BE UT Coverage Report

Increment line coverage 49.35% (189/383) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.29% (18698/35087)
Line Coverage 39.04% (172896/442897)
Region Coverage 33.75% (133685/396162)
Branch Coverage 34.71% (57821/166560)

@morningman morningman changed the title [optimize](parquet-reader) Optimize performance by parquet bloom filter. branch-4.0: [optimize](parquet-reader) Optimize performance by parquet bloom filter. Jan 10, 2026
@kaka11chen
[optimize](parquet-reader) Optimize performace by parquet bloom filte…
cd00116 
…r. (apache#57959)

### What problem does this PR solve?

Problem Summary:

### Release note

Optimize performance by reading parquet bloom filter. 
parquet bloom filter:
https://parquet.apache.org/docs/file-format/bloomfilter/


### Query Performance Test Results

SQL Query | Optimized Version (time(s)) | Original Version (time(s))
-- | -- | --
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
= 'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d4'; | 0.02 | 0.23
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
IN ('cfcd2084-cfcd-cfcd-cfcd-cfcd208495d6',
'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d7'); | 0.04 | 0.24
@kaka11chen kaka11chen force-pushed the cherry-pick-57959-4.0 branch from d55be61 to cd00116 Compare January 12, 2026 01:50
@kaka11chen
Copy link
Contributor Author

kaka11chen commented Jan 12, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Jan 12, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.53% (1756/2208)
Line Coverage 65.52% (30824/47047)
Region Coverage 65.93% (15310/23221)
Branch Coverage 56.62% (8139/14374)

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 12, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Jan 12, 2026

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 12, 2026

PR approved by anyone and no changes requested.

@doris-robot
Copy link

doris-robot commented Jan 12, 2026

BE UT Coverage Report

Increment line coverage 49.35% (189/383) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.34% (18717/35092)
Line Coverage 39.10% (173161/442922)
Region Coverage 33.80% (133914/396179)
Branch Coverage 34.77% (57912/166566)

@morningman morningman merged commit 00503bc into apache:branch-4.0 Jan 12, 2026
24 of 27 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yiguolei yiguolei yiguolei approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@kaka11chen @hello-stephen @doris-robot @yiguolei @morningman