v1.2.863-nightly

What's Changed

Exciting New Features ✨

• feat: allow retry with the same query id when starting query. by @youngsofun in #19184
• feat: add tag DDL support (CREATE/DROP/SHOW only) by @TCeason in #19109
• feat(function): high performance bitmap_count,bitmap_intersect without deserialization by @forsaken628 in #19149
• feat(query): Standardize Nested Type String Quoting and Variant Serialization for JSON Compatibility by @b41sh in #19164
• feat: support self join elimination by @SkyFan2002 in #19169

Thoughtful Bug Fix 🔧

• fix(query): Fix inverted index JSON array matched all rows by @b41sh in #19185

Build/Testing/CI Infra Changes 🔌

• ci: update JDBC compat test by @youngsofun in #19176
• ci: adjust runner sizes by @everpcpc in #19180

Others 📒

• chore: remove noisy logs by @SkyFan2002 in #19178
• chore(query): log hash join stage timings by @zhang2014 in #19179
• chore: remove bendpy from default workspace members by @everpcpc in #19183
• chore(query): support read nested column in iceberg tables by @sundy-li in #19182
• chore: Rewrite multi-arg COUNT(DISTINCT) via inner group-by by @KKould in #19160

Full Changelog: v1.2.862-nightly...v1.2.863-nightly

v1.2.862-nightly

What's Changed

Exciting New Features ✨

• feat: clustering_statistics support specify snapshot by @zhyass in #19148
• feat(query): Enhanced Inverted Index for VARIANT Type to precise matching Object within Arrays by @b41sh in #19096

Thoughtful Bug Fix 🔧

• fix: allow credential chain for system_history tables by @dqhl76 in #19167

Code Refactor 🎉

• refactor(query): use unchecked utf8 for payload flush by @zhang2014 in #19159
• refactor: prioritize table options for retention policy by @dantengsky in #19162
• refactor(query): send runtime filter packets as data blocks by @zhang2014 in #19170
• refactor(query): streamline flight exchange coordination by @zhang2014 in #19175

Build/Testing/CI Infra Changes 🔌

• ci: upgrade llvm in build-tool image by @everpcpc in #19166
• ci: install missing packages by @everpcpc in #19171
• ci: enable unit test by @everpcpc in #19172
• ci: update unit test. by @youngsofun in #19168

Others 📒

• chore: ndv upper cutoff by @forsaken628 in #19133
• chore(query): add stats for new final aggregators by @dqhl76 in #19156
• chore(query): add probe rows log for hash join by @zhang2014 in #19165
• chore: Date/Time elements are used in AggregateDistinct in numerical form, reducing the memory usage of the Set. by @KKould in #19157

Full Changelog: v1.2.861-nightly...v1.2.862-nightly

v1.2.861-nightly

What's Changed

Exciting New Features ✨

• feat(storage): organize storage credential configs for security by @bohutang in #19147

Thoughtful Bug Fix 🔧

• fix(query): fix fragment not found in warehouse level table by @zhang2014 in #19152
• fix: recluster final infinite loop by @zhyass in #19151

Others 📒

• chore(query): revert "fix(query): update opendal (#19110)" by @zhang2014 in #19146

Full Changelog: v1.2.860-nightly...v1.2.861-nightly

v1.2.860-nightly

What's Changed

Exciting New Features ✨

• feat: enhance table function fuse_encoding by @dantengsky in #19127
• feat(query): support flight keepalive settings by @zhang2014 in #19141

Thoughtful Bug Fix 🔧

• fix: where comparing old and new bitmap versions occurred when directly comparing bytes in join and group by operations. by @KKould in #19082
• fix: distinct_eliminated is rewritten as distinct_on_group_key by @KKould in #19142

Code Refactor 🎉

• refactor: system.build_options as key-value by @bohutang in #19137
• refactor: release table lock earlier during DML execution by @dantengsky in #19113
• refactor(query): window supports const columns by @forsaken628 in #19140
• refactor: reduce max page size of http handler to 4MB. by @youngsofun in #19136

Others 📒

• chore(query): add release profile for aarch64 by @zhang2014 in #19135
• chore(query): allow_anonymous when key token is empty by @sundy-li in #19143

Full Changelog: v1.2.859-nightly...v1.2.860-nightly

v1.2.859-nightly

What's Changed

Others 📒

• chore(query): add aarch64 profile with optimization level 3 by @dantengsky in #19105

Full Changelog: v1.2.858-nightly...v1.2.859-nightly

v1.2.858-nightly

What's Changed

Exciting New Features ✨

• feat(query): Inverted Index and Vector Index support hybrid cache by @b41sh in #19124

Thoughtful Bug Fix 🔧

• fix: change history tables' clean operations timing check and update mechanism by @dqhl76 in #19095
• fix(query): update opendal by @sundy-li in #19110
• fix(query): Fix drop Aggregating index failed by @b41sh in #19131

Code Refactor 🎉

• refactor(optimizer): simplify the implementation of rule eager aggregation by @forsaken628 in #19112
• refactor: vacuum temporary files also cleans inactive temp table data by @dantengsky in #19092

Build/Testing/CI Infra Changes 🔌

• ci: prepare upgrade toolchain by @everpcpc in #19116
• ci: fix build build-tool image by @everpcpc in #19117
• ci: cargo-nextest install target by @everpcpc in #19118
• ci: fix install cargo nextest by @everpcpc in #19119
• ci: fix install cargo-nextest by @everpcpc in #19120
• ci: fix install rust tools by @everpcpc in #19121
• ci: install tools binary without binstall by @everpcpc in #19122
• ci: remove some tools from build-tool image by @everpcpc in #19123
• ci: sccache prefix with toolchain version by @everpcpc in #19129
• ci: remove mold from build & tmp disable unit test by @everpcpc in #19130

Others 📒

• chore: adjust cloud image build timeout from 60 minutes to 120 minutes by @dantengsky in #19102
• chore: remove unused settings for aggregation by @dqhl76 in #19103
• chore(ci): try enable ENABLE_SCCACHE again by @sundy-li in #19128
• chore: rename body_format query_result_format. by @youngsofun in #19132

Full Changelog: v1.2.857-nightly...v1.2.858-nightly

v1.2.857-nightly

What's Changed

Exciting New Features ✨

• feat(query): tighten procedure overload resolution by @TCeason in #19084
• feat: basic support of schema evolution in copy for parquet by @youngsofun in #19094
• feat: extend join condition dedup to anti/semi joins by @SkyFan2002 in #19097
• feat(query): add create_query to /v1/catalog/list_database_tables by @everpcpc in #19099

Thoughtful Bug Fix 🔧

• fix: udf args recursion crash and binding not found on table by @KKould in #19091
• fix(query): fix stale indices in process_or by @sundy-li in #19085

Code Refactor 🎉

• refactor: reduce the memory of the HashIndex in the AggregateHashTable by @forsaken628 in #19046

Others 📒

• chore: avoid bloom filter clone by @SkyFan2002 in #19098
• chore: remove format! in heavy IO loop by @dqhl76 in #19077

Full Changelog: v1.2.856-nightly...v1.2.857-nightly

v1.2.856-nightly

What's Changed

Exciting New Features ✨

• feat: add explicit FLUSH PRIVILEGES to refresh role cache for query node by @camilesing in #19066
• feat: heuristic rule for fuse parquet dictionary page by @dantengsky in #19024
• feat: spill profile metrics by @bohutang in #19075
• feat(query): add metrics session_acquired_queries_total by @everpcpc in #19087

Code Refactor 🎉

• refactor(query): supports parallel data transmission between nodes by @zhang2014 in #18984
• refactor: build the runtime filter during the HashJoin block collection process by @SkyFan2002 in #19058

Build/Testing/CI Infra Changes 🔌

• ci: benchmark optimize by @everpcpc in #19086

Others 📒

• chore: combine the logic that triggers automatic compression upon write by @zhyass in #19050
• chore: revert structured spill config by @bohutang in #19088

Full Changelog: v1.2.855-nightly...v1.2.856-nightly

v1.2.855-nightly

What's Changed

Exciting New Features ✨

• feat: perf small_union and small_symmetric_difference by @KKould in #19069

Thoughtful Bug Fix 🔧

• fix: http handler cut block to pages using memory size after gc. by @youngsofun in #19071
• fix: query error when stream_consume_batch_size_hint is not 0 by @zhyass in #19074

Code Refactor 🎉

• refactor: try reduce aggregate hash index cost on hot path by @dqhl76 in #19072

Build/Testing/CI Infra Changes 🔌

• ci: fix do not sync debug symbols to R2 by @everpcpc in #19078
• ci: rename debug symbol for publish by @everpcpc in #19080
• ci: benchmark tpch1000 with local disk cache by @everpcpc in #19081

Full Changelog: v1.2.854-nightly...v1.2.855-nightly

v1.2.854-nightly

What's Changed

Exciting New Features ✨

• feat(query): row access policy support rbac by @TCeason in #19064
• feat(query): add THROW support to SQL procedures by @TCeason in #19067

Build/Testing/CI Infra Changes 🔌

• ci: fix missing token for publish dbg by @everpcpc in #19070

Others 📒

• chore(query): replace custom wrappers with intrinsics::assume by @zhang2014 in #19063

Full Changelog: v1.2.853-nightly...v1.2.854-nightly