-
Notifications
You must be signed in to change notification settings - Fork 3.7k
[fix](parquet)Parse Parquet INT96 physical type data into a no-timezone datetime. #59514
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
|
run buildall |
TPC-H: Total hot run time: 31901 ms |
TPC-DS: Total hot run time: 174160 ms |
ClickBench: Total hot run time: 27.17 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
|
run buildall |
FE UT Coverage ReportIncrement line coverage |
TPC-H: Total hot run time: 32002 ms |
TPC-DS: Total hot run time: 172457 ms |
ClickBench: Total hot run time: 26.9 s |
FE Regression Coverage ReportIncrement line coverage |
|
run buildall |
1 similar comment
|
run buildall |
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
FE UT Coverage ReportIncrement line coverage |
TPC-H: Total hot run time: 31788 ms |
TPC-DS: Total hot run time: 172805 ms |
|
run buildall |
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
TPC-H: Total hot run time: 32331 ms |
TPC-DS: Total hot run time: 173246 ms |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
What problem does this PR solve?
Problem Summary:
This PR fixes the semantics of reading Parquet INT96 values. Previously, INT96 was interpreted as a time zone–aware type, causing the read results to vary with the set timezone configuration.
This PR changes the behavior to always convert INT96 values to UTC, treating them as time zone–independent timestamps.
Release note
Parse Parquet INT96 physical type data into a no-timezone datetime.
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)