v1.2.856-nightly

What's Changed

Exciting New Features ✨

• feat: add explicit FLUSH PRIVILEGES to refresh role cache for query node by @camilesing in #19066
• feat: heuristic rule for fuse parquet dictionary page by @dantengsky in #19024
• feat: spill profile metrics by @BohuTANG in #19075
• feat(query): add metrics session_acquired_queries_total by @everpcpc in #19087

Code Refactor 🎉

• refactor(query): supports parallel data transmission between nodes by @zhang2014 in #18984
• refactor: build the runtime filter during the HashJoin block collection process by @SkyFan2002 in #19058

Build/Testing/CI Infra Changes 🔌

• ci: benchmark optimize by @everpcpc in #19086

Others 📒

• chore: combine the logic that triggers automatic compression upon write by @zhyass in #19050
• chore: revert structured spill config by @BohuTANG in #19088

Full Changelog: v1.2.855-nightly...v1.2.856-nightly

v1.2.855-nightly

What's Changed

Exciting New Features ✨

• feat: perf small_union and small_symmetric_difference by @KKould in #19069

Thoughtful Bug Fix 🔧

• fix: http handler cut block to pages using memory size after gc. by @youngsofun in #19071
• fix: query error when stream_consume_batch_size_hint is not 0 by @zhyass in #19074

Code Refactor 🎉

• refactor: try reduce aggregate hash index cost on hot path by @dqhl76 in #19072

Build/Testing/CI Infra Changes 🔌

• ci: fix do not sync debug symbols to R2 by @everpcpc in #19078
• ci: rename debug symbol for publish by @everpcpc in #19080
• ci: benchmark tpch1000 with local disk cache by @everpcpc in #19081

Full Changelog: v1.2.854-nightly...v1.2.855-nightly

v1.2.854-nightly

What's Changed

Exciting New Features ✨

• feat(query): row access policy support rbac by @TCeason in #19064
• feat(query): add THROW support to SQL procedures by @TCeason in #19067

Build/Testing/CI Infra Changes 🔌

• ci: fix missing token for publish dbg by @everpcpc in #19070

Others 📒

• chore(query): replace custom wrappers with intrinsics::assume by @zhang2014 in #19063

Full Changelog: v1.2.853-nightly...v1.2.854-nightly

v1.2.853-nightly

What's Changed

Exciting New Features ✨

• feat: perf bitmap intersect by @KKould in #19041
• feat(query): speed up string→timestamp/date/timestamptz parsing via DayLUT fast path by @TCeason in #19045
• feat: improve scan IO profile metrics by @BohuTANG in #18975
• feat: impl bitmap_construct_agg by @KKould in #19053

Thoughtful Bug Fix 🔧

• fix(query): fix filter bug with small block-size by @sundy-li in #19047
• fix: Pruning multithreading without accumulating time by @KKould in #19044

Code Refactor 🎉

• refactor: bytes view calc total_bytes_len lazy. by @youngsofun in #19056

Build/Testing/CI Infra Changes 🔌

• ci: add benchmark for tpch1000 by @everpcpc in #19057
• ci: fix bendsql run for benchmark by @everpcpc in #19059
• ci: fix benchmark database by @everpcpc in #19060
• ci: adjust tpch1000 benchmark timeout by @everpcpc in #19061
• ci: fix tpch1000 benchmark timeout by @everpcpc in #19062
• ci: comment ignore ndjson files for benchmark by @everpcpc in #19065
• ci: update database for benchmark by @everpcpc in #19068

Others 📒

• chore: revert "fix: fix memory_size of sliced string view. (#19014)" by @youngsofun in #19051
• chore: map log target to short semantic categories by @forsaken628 in #18925

Full Changelog: v1.2.852-nightly...v1.2.853-nightly

v1.2.852-nightly

What's Changed

Exciting New Features ✨

• feat: improve runtime filter check via SIMD by @SkyFan2002 in #19039

Build/Testing/CI Infra Changes 🔌

• ci: add a flag to allow skip trim debug info by @dqhl76 in #19043

Others 📒

• chore: eliminate several unnecessary branches from the hot path of the aggregate function by @forsaken628 in #19028
• chore: improve explain perf to support flag inlined function by @dqhl76 in #19042

Full Changelog: v1.2.851-nightly...v1.2.852-nightly

v1.2.851-nightly

What's Changed

Exciting New Features ✨

• feat: better display of retained identity by @camilesing in #19029

Thoughtful Bug Fix 🔧

• fix(query): Fix inverted index matched score caused panic by @b41sh in #19032
• fix: implements bitmap comparison by @dantengsky in #19038
• fix(query): fix stack overflow errors thrown during serialization by @zhang2014 in #19040

Code Refactor 🎉

• refactor: Optimize timestamp/timestamptz function by DayLUT by @TCeason in #19031

Others 📒

• chore(query): set enable_experimental_virtual_column default as 0 by @b41sh in #19033

Full Changelog: v1.2.850-nightly...v1.2.851-nightly

v1.2.850-nightly

What's Changed

Exciting New Features ✨

• feat: add cost to explain pruning stats by @KKould in #19015
• feat: add column update_on for user functions table by @KKould in #19018
• feat(query): add DATE ± INTERVAL -> DATE function by @TCeason in #19022

Code Refactor 🎉

• refactor(query): decrease call tzdb parse by @TCeason in #19004

Full Changelog: v1.2.849-nightly...v1.2.850-nightly

v1.2.849-nightly

What's Changed

Exciting New Features ✨

• feat: support position column in common sql query by @KKould in #19012
• feat: improve runtime filter [Part 3] by @SkyFan2002 in #19006
• feat: enable Decimal64 handling in fuse table deserialization by @dantengsky in #19008
• feat(query): Inverted Index Top-N Pruning for ORDER BY + LIMIT Queries by @b41sh in #19016

Thoughtful Bug Fix 🔧

• fix: load of large zip file. by @youngsofun in #19010
• fix(rbac): forbiden grant create-ownership-object privilege to user by @TCeason in #18987
• fix: fix memory_size of sliced string view. by @youngsofun in #19014
• fix: runtime filters not work when probe keys are simple casts of non-nullable columns to nullable types by @SkyFan2002 in #19020

Code Refactor 🎉

• refactor(func): optimize function array_aggregate by @forsaken628 in #19005
• refactor: move aggregation spill logic into partial aggregate by @dqhl76 in #18999
• refactor(query): add the matcher id when calling the optimizer apply by @zhang2014 in #19017

Build/Testing/CI Infra Changes 🔌

• ci: ttc test with arrow body format. by @youngsofun in #18985
• ci: 'onlyif http'->'skipif mysql' to cover ttc tests by @youngsofun in #19011
• ci: refactor databend-go compat test. by @youngsofun in #19023

Full Changelog: v1.2.848-nightly...v1.2.849-nightly

v1.2.848-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix: unable to get field on rank limit when rule_eager_aggregation applied by @KKould in #19007
• fix: pivot extra columns on projection by @KKould in #18994

Code Refactor 🎉

• refactor: bump crates arrow* and parquet to version 56 by @dantengsky in #18997

Others 📒

• chore(ut): support for const columns as input to function unit tests by @forsaken628 in #19009
• chore(query): enable to cache the previous python import directory for python udf by @sundy-li in #19003

Full Changelog: v1.2.847-nightly...v1.2.848-nightly

v1.2.847-nightly

What's Changed

Others 📒

• chore: make query service start after meta by @everpcpc in #19002
• chore(query): Refresh virtual column support limit and selection by @b41sh in #19001

Full Changelog: v1.2.846-nightly...v1.2.847-nightly