Merge branch 'ClickHouse:master' into ci_mod

Author: Blargian

.github/workflows/create_release.yml

@@ -135,9 +135,10 @@ jobs:
           ./utils/list-versions/update-docker-version.sh
           echo "Generate ChangeLog"
           export CI=1
+          docker pull clickhouse/style-test:latest
           docker run -u "${UID}:${GID}" -e PYTHONUNBUFFERED=1 -e CI=1 --network=host \
             --volume=".:/wd" --workdir="/wd" \
-            clickhouse/style-test \
+            clickhouse/style-test:latest \
             ./tests/ci/changelog.py -v --debug-helpers \
             --gh-user-or-token ${{ secrets.ROBOT_CLICKHOUSE_COMMIT_TOKEN }} \
             --jobs=5 \

CHANGELOG.md

@@ -114,7 +114,7 @@
 
 #### Bug Fix (user-visible misbehavior in an official stable release)
 * Fix incorrect projection analysis when `count(Nullable)` is used in aggregate projections. This fixes [#74495](https://github.com/ClickHouse/ClickHouse/issues/74495) . This PR also adds some logs around projection analysis to clarify why a projection is used or why not. [#74498](https://github.com/ClickHouse/ClickHouse/pull/74498) ([Amos Bird](https://github.com/amosbird)).
-* Fix "Part <...> does not contain in snapshot of previous virtual parts. (PART_IS_TEMPORARILY_LOCKED)" during DETACH PART. [#76039](https://github.com/ClickHouse/ClickHouse/pull/76039) ([Aleksei Filatov](https://github.com/aalexfvk)).
+* Fix `Part <...> does not contain in snapshot of previous virtual parts. (PART_IS_TEMPORARILY_LOCKED)` during `DETACH PART`. [#76039](https://github.com/ClickHouse/ClickHouse/pull/76039) ([Aleksei Filatov](https://github.com/aalexfvk)).
 * Fix not working skip indexes with expression with literals in analyzer and remove trivial casts during indexes analysis. [#77229](https://github.com/ClickHouse/ClickHouse/pull/77229) ([Pavel Kruglov](https://github.com/Avogar)).
 * Fix a bug when `close_session` query parameter didn't have any effect leading to named sessions being closed only after `session_timeout`. [#77336](https://github.com/ClickHouse/ClickHouse/pull/77336) ([Alexey Katsman](https://github.com/alexkats)).
 * Fixed receiving messages from NATS server without attached Materialized Views. [#77392](https://github.com/ClickHouse/ClickHouse/pull/77392) ([Dmitry Novikov](https://github.com/dmitry-sles-novikov)).

ci/docker/style-test/requirements.txt

@@ -3,4 +3,8 @@ yamllint==1.26.3
 codespell==2.2.1
 mypy==1.15.0
 pylint==3.1.0
-tqdm==4.67.1  # required for change log generation
+# required for change log generation:
+tqdm==4.67.1
+thefuzz==0.22.1
+PyGitHub==2.6.1
+boto3==1.37.38

ci/jobs/scripts/check_style/aspell-ignore/en/aspell-dict.txt

@@ -1728,6 +1728,7 @@ distinctdynamictypes
 distinctjsonpaths
 distro
 divideDecimal
+divideOrNull
 dmesg
 doesnt
 domainRFC
@@ -2038,6 +2039,7 @@ inodes
 instantiation
 instantiations
 intDiv
+intDivOrNull
 intDivOrZero
 intExp
 intHash
@@ -2264,6 +2266,7 @@ mmap
 mmapped
 modularization
 moduli
+moduloOrNull
 moduloOrZero
 mongoc
 mongocxx
@@ -2476,6 +2479,7 @@ positionCaseInsensitive
 positionCaseInsensitiveUTF
 positionUTF
 positiveModulo
+positiveModuloOrNull
 postfix
 postfixes
 postgres

contrib/cctz

@@ -38,7 +38,7 @@ RUN arch=${TARGETARCH:-amd64} \
 # lts / testing / prestable / etc
 ARG REPO_CHANNEL="stable"
 ARG REPOSITORY="https://packages.clickhouse.com/tgz/${REPO_CHANNEL}"
-ARG VERSION="25.3.2.39"
+ARG VERSION="25.3.3.42"
 ARG PACKAGES="clickhouse-keeper"
 ARG DIRECT_DOWNLOAD_URLS=""
 

docker/keeper/Dockerfile

@@ -35,7 +35,7 @@ RUN arch=${TARGETARCH:-amd64} \
 # lts / testing / prestable / etc
 ARG REPO_CHANNEL="stable"
 ARG REPOSITORY="https://packages.clickhouse.com/tgz/${REPO_CHANNEL}"
-ARG VERSION="25.3.2.39"
+ARG VERSION="25.3.3.42"
 ARG PACKAGES="clickhouse-client clickhouse-server clickhouse-common-static"
 ARG DIRECT_DOWNLOAD_URLS=""
 

docker/server/Dockerfile.alpine

@@ -28,7 +28,7 @@ RUN sed -i "s|http://archive.ubuntu.com|${apt_archive}|g" /etc/apt/sources.list
 
 ARG REPO_CHANNEL="stable"
 ARG REPOSITORY="deb [signed-by=/usr/share/keyrings/clickhouse-keyring.gpg] https://packages.clickhouse.com/deb ${REPO_CHANNEL} main"
-ARG VERSION="25.3.2.39"
+ARG VERSION="25.3.3.42"
 ARG PACKAGES="clickhouse-client clickhouse-server clickhouse-common-static"
 
 #docker-official-library:off

docker/server/Dockerfile.ubuntu

@@ -0,0 +1,41 @@
+---
+sidebar_position: 1
+sidebar_label: 2025
+---
+
+# 2025 Changelog
+
+### ClickHouse release v25.3.3.42-lts (c4bfe68b052) FIXME as compared to v25.3.2.39-lts (3ec1fd3f690)
+
+#### Improvement
+* Backported in [#78899](https://github.com/ClickHouse/ClickHouse/issues/78899): Fix `IN` clause type coercion for `BFloat16` (i.e. `SELECT toBFloat16(1) IN [1, 2, 3];` now returns `1`). Closes [#78754](https://github.com/ClickHouse/ClickHouse/issues/78754). [#78839](https://github.com/ClickHouse/ClickHouse/pull/78839) ([Raufs Dunamalijevs](https://github.com/rienath)).
+* Backported in [#79137](https://github.com/ClickHouse/ClickHouse/issues/79137): Remove settings during `recoverLostReplica` same as it was done in: https://github.com/ClickHouse/ClickHouse/pull/78637. [#79113](https://github.com/ClickHouse/ClickHouse/pull/79113) ([Nikita Mikhaylov](https://github.com/nikitamikhaylov)).
+
+#### Bug Fix (user-visible misbehavior in an official stable release)
+* Backported in [#78790](https://github.com/ClickHouse/ClickHouse/issues/78790): Fix not working skip indexes with expression with literals in analyzer and remove trivial casts during indexes analysis. [#77229](https://github.com/ClickHouse/ClickHouse/pull/77229) ([Pavel Kruglov](https://github.com/Avogar)).
+* Backported in [#79285](https://github.com/ClickHouse/ClickHouse/issues/79285): Fixed refreshable materialized view in Replicated database not working on newly added replicas. [#77774](https://github.com/ClickHouse/ClickHouse/pull/77774) ([Michael Kolupaev](https://github.com/al13n321)).
+* Backported in [#78438](https://github.com/ClickHouse/ClickHouse/issues/78438): Fix metadata override in Database Replicated which could have happened due to a RENAME query executed right after an ALTER query. [#78107](https://github.com/ClickHouse/ClickHouse/pull/78107) ([Nikolay Degterinsky](https://github.com/evillique)).
+* Backported in [#78547](https://github.com/ClickHouse/ClickHouse/issues/78547): Mask azure access signature to be not visible to user or in logs. [#78189](https://github.com/ClickHouse/ClickHouse/pull/78189) ([Kseniia Sumarokova](https://github.com/kssenii)).
+* Backported in [#78528](https://github.com/ClickHouse/ClickHouse/issues/78528): Fix prefetch of substreams with prefixes in Wide parts. [#78205](https://github.com/ClickHouse/ClickHouse/pull/78205) ([Pavel Kruglov](https://github.com/Avogar)).
+* Backported in [#78952](https://github.com/ClickHouse/ClickHouse/issues/78952): Not schedule RefreshMV task if a replica's `disable_insertion_and_mutation` is true. A task is some insertion, it will failed if `disable_insertion_and_mutation` is true. [#78277](https://github.com/ClickHouse/ClickHouse/pull/78277) ([Xu Jia](https://github.com/XuJia0210)).
+* Backported in [#78979](https://github.com/ClickHouse/ClickHouse/issues/78979): Validate access to underlying tables for the Merge engine. [#78339](https://github.com/ClickHouse/ClickHouse/pull/78339) ([Pervakov Grigorii](https://github.com/GrigoryPervakov)).
+* Backported in [#78649](https://github.com/ClickHouse/ClickHouse/issues/78649): FINAL modifier can be lost for `Distributed` engine table. [#78428](https://github.com/ClickHouse/ClickHouse/pull/78428) ([Yakov Olkhovskiy](https://github.com/yakov-olkhovskiy)).
+* Backported in [#78534](https://github.com/ClickHouse/ClickHouse/issues/78534): Revert "Apply preserve_most attribute at some places in code" since it may lead to crashes. [#78449](https://github.com/ClickHouse/ClickHouse/pull/78449) ([Azat Khuzhin](https://github.com/azat)).
+* Backported in [#78760](https://github.com/ClickHouse/ClickHouse/issues/78760): Set at least one stream for reading in case there are zero planned streams after applying `max_streams_to_max_threads_ratio` setting. [#78505](https://github.com/ClickHouse/ClickHouse/pull/78505) ([Eduard Karacharov](https://github.com/korowa)).
+* Backported in [#78614](https://github.com/ClickHouse/ClickHouse/issues/78614): ClickHouse is now able to figure out its cgroup v2 on systems with both cgroups v1 and v2 enabled. [#78566](https://github.com/ClickHouse/ClickHouse/pull/78566) ([Grigory Korolev](https://github.com/gkorolev)).
+* Backported in [#78772](https://github.com/ClickHouse/ClickHouse/issues/78772): ObjectStorage cluster table functions failed when used with table level-settings. [#78587](https://github.com/ClickHouse/ClickHouse/pull/78587) ([Daniil Ivanik](https://github.com/divanik)).
+* Backported in [#78685](https://github.com/ClickHouse/ClickHouse/issues/78685): Remove query settings during attach. [#78637](https://github.com/ClickHouse/ClickHouse/pull/78637) ([Raúl Marín](https://github.com/Algunenano)).
+* Backported in [#78945](https://github.com/ClickHouse/ClickHouse/issues/78945): Fix crash in REFRESHABLE MV in case of ALTER after incorrect shutdown. [#78858](https://github.com/ClickHouse/ClickHouse/pull/78858) ([Azat Khuzhin](https://github.com/azat)).
+* Backported in [#79272](https://github.com/ClickHouse/ClickHouse/issues/79272): Keeper fix: Avoid triggering watches on failed multi requests. [#79247](https://github.com/ClickHouse/ClickHouse/pull/79247) ([Antonio Andelic](https://github.com/antonio2368)).
+
+#### NO CL CATEGORY
+
+* Backported in [#78326](https://github.com/ClickHouse/ClickHouse/issues/78326):. [#78097](https://github.com/ClickHouse/ClickHouse/pull/78097) ([Nikolai Kochetov](https://github.com/KochetovNicolai)).
+
+#### NOT FOR CHANGELOG / INSIGNIFICANT
+
+* Backported in [#78333](https://github.com/ClickHouse/ClickHouse/issues/78333): Add Database Prefix in Kafka Table Logs for Improved Accuracy. [#76720](https://github.com/ClickHouse/ClickHouse/pull/76720) ([VicoWu](https://github.com/VicoWu)).
+* Backported in [#78607](https://github.com/ClickHouse/ClickHouse/issues/78607): Log invalid HTTP version string. [#78264](https://github.com/ClickHouse/ClickHouse/pull/78264) ([Christoph Wurm](https://github.com/cwurm)).
+* Backported in [#78400](https://github.com/ClickHouse/ClickHouse/issues/78400): CI: Fix for migration to pyjwt auth. [#78396](https://github.com/ClickHouse/ClickHouse/pull/78396) ([Max Kainov](https://github.com/maxknv)).
+* Backported in [#78735](https://github.com/ClickHouse/ClickHouse/issues/78735): We do not count tables from the `system` database when we check the limit of tables, so we should also not check the limits for tables in `system` database. [#78653](https://github.com/ClickHouse/ClickHouse/pull/78653) ([Nikolay Degterinsky](https://github.com/evillique)).
+

docs/changelogs/v25.3.3.42-lts.md

@@ -237,7 +237,7 @@ CPU time is consumed by threads when they are not blocked and work on CPU-intens
 * Master thread — the first thread that starts working on a query or background activity like a merge or a mutation.
 * Worker thread — the additional threads that master can spawn to work on CPU-intensive tasks.
 
-It may be desirable to use separate resources for master and worker threads to achieve better responsiveness. A high number of worker threads can easily monopolize CPU resource when high `max_thread` query setting values are used. Then incoming queries should block and wait a CPU slot for its master thread to start execution. To avoid this the following configuration could be used:
+It may be desirable to use separate resources for master and worker threads to achieve better responsiveness. A high number of worker threads can easily monopolize CPU resource when high `max_threads` query setting values are used. Then incoming queries should block and wait a CPU slot for its master thread to start execution. To avoid this the following configuration could be used:
 
 ```sql
 CREATE RESOURCE worker_cpu (WORKER THREAD)