Releases: redpanda-data/redpanda
Releases · redpanda-data/redpanda
v25.3.9
v25.3.8
Bug Fixes
- Fixes duplicate message writes in Iceberg when disk or memory reservation errors occur. by @ballard26 in #29397
Improvements
- #29652
rpk redpanda admin config log-level set: Added --help-loggers flag to display the list of available loggers without setting any log level. by @r-vasquez in #29653 - #29652
rpk redpanda admin config log-level set: now dynamically discovers available loggers from the local Redpanda binary or the Admin API. by @r-vasquez in #29653 - PR #29075 [v25.3.x] admin: update shadow indexing api doc by @nvartolomei
- PR #29520 [v25.3.x] coordinated compaction improvements by @bashtanov
- PR #29541 [v25.3.x]
storage: manage priority logs inhousekeeping_loop[take 2] by @WillemKauf - PR #29586 [v25.3.x] bazel: Update protobuf to 33.5 by @michael-redpanda
- PR #29607 [v25.3.x] rptests/util/repeat_check: make it work correctly in
wait_untilby @bashtanov
Full Changelog: v25.3.7...v25.3.8
v25.3.7
Bug Fixes
- Fixed admin API service restart to handle pandaproxy and schema_registry on the correct shard. by @pgellert in #29523
- Fixes a bug where truncation does not propagate to sink if source start offset has moved ahead of sink high watermark. by @bharathv in #29446
- firm up start offset update logic by @joe-redpanda in #29467
- PR #29393 [v25.3.x] cloud_io: handle key_not_found when listing bucket objects by @nvartolomei
- PR #29477 [v25.3.x] iobuf: fix operator<=> and operator== for string_view comparisons by @travisdowns
- PR #29497 [v25.3.x] kafka: Clamp consume deadline to 5s by @Lazin
Improvements
- Adds native support for buf's protovalidate to Schema Registry by @michael-redpanda in #29417
- Improve performance of Shadow Link when scaling to thousands of topics but making internal data structures copy on write by @michael-redpanda in #29231
- Upgrade libxml2 to latest minor version by @tyson-redpanda in #29433
- PR #29503 [v25.3.x] bazel: Update OpenSSL to 3.0.19 by @michael-redpanda
- PR #29531 [v25.3.x] cluster_link: improve comment for prefix truncation delay logic by @michael-redpanda
- PR #29537 [v25.3.x] kafka/client: fix race condition in direct_consumer_test by @ballard26
Full Changelog: v25.3.6...v25.3.7
v25.3.6
Bug Fixes
- Fixed an issue where Kafka fetch session responses could omit partitions with changed metadata (high watermark, log start offset, last stable offset) when the fetch retried internally due to min_bytes not being satisfied. by @pgellert in #29349
- Fixed cluster link replication attempting prefix truncation on partitions that do not support it (e.g., cloud topics) by @michael-redpanda in #29296
- Fixed file cleanup issue in
datalake::record_multiplexer. by @ballard26 in #29277 - #29299 Fix the
partition_responsefor a produce request to aLogAppendTimetopic to accurately reflect thetimestamp_type. by @WillemKauf in #29301 - guarantee invalid lso gets converted to a retryable error when relevant by @joe-redpanda in #29307
Improvements
- Improve cluster linking shadow topic prefix truncation error message. by @pgellert in #29303
- Schema Registry: Optimise compatibility checking for json to allow more nested schemas. by @BenPope in #29317
- PR #28757 [CORE-14007] Fix timeout handling in TS by @Lazin
- PR #29294 c/topic_table: use chunked_hash_map for lifecycle markers by @bashtanov
- PR #29330 bazel: Update seastar to latest by @StephanDollberg
Full Changelog: v25.3.5...v25.3.6
v25.2.14
Bug Fixes
- Adds better validation to arrays and strings being read off the wire from
kafkaclients. by @WillemKauf in #29228 - Fix a cache collision in in-memory spillover manifest cache which could lead to new topic reading data from the old topic with the same name for a short period of time. by @nvartolomei in #29089
- Iceberg: Allow bucket names with dots. Also, reject URIs returned by catalog that look like
s3://bucket.s3.amazonaws.com/path/to/object. by @nvartolomei in #29095 - Reduces a window in which Redpanda may end up missing data when using the
object_storagecatalog for Iceberg Topics. Reminder: theobject_storageis generally unsafe and should not be used in production. by @andrwng in #28532 - #29297 Fix the
partition_responsefor a produce request to aLogAppendTimetopic to accurately reflect thetimestamp_type. by @WillemKauf in #29300 - prevents state machine from loading local snapshot with offsets greater than log dirty offset by @mmaslankaprv in #29007
Improvements
- Connection errors now report the resolved address where possible. by @BenPope in #29204
- kafka/client: Improve retry to logic to properly rotate all provided seed servers. by @BenPope in #29205
- PR #28312 [CORE-14442] rm_stm: do not reinsert producer to active tx producers list if present by @mmaslankaprv
- PR #29292 c/topic_table: use chunked_hash_map for lifecycle markers by @bashtanov
Full Changelog: v25.2.13...v25.2.14
v25.3.5
Features
- Cluster health report now includes node IDs of nodes that exceed the disk usage reporting thresholds. by @bharathv in #29141
- Iceberg: Support customizing Iceberg catalog namespace (defaults to
redpanda) at cluster level. by @nvartolomei in #29169 - Snapshot id correlated with table update transaction is now available in Datalake REST API by @mmaslankaprv in #29256
- rpk shadow config generate: now supports --print-template along with --for-cloud by @r-vasquez in #29126
- rpk: WCR supports
--cluster-uuid-overrideby @daisukebe in #29185 - rpk: rpk can now be used to create Redpanda roles in Redpanda Cloud using the
rpk security rolecommand. by @r-vasquez in #29211
Bug Fixes
- Adds better validation to arrays and strings being read off the wire from
kafkaclients. by @WillemKauf in #29227 - PR #29243 Fix bug in
iobuf::operator<=>by @ballard26 - PR #29273 bytes: ensure
iobuf::operator<=>(...)is an unsigned byte-wise comparison by @ballard26 - PR #28682 health_monitor: Fix oversized alloc in MTT scenarios by @StephanDollberg
- PR #29147 CORE-14619 rpk: fix version check logic for semver by @pgellert
Improvements
- Connection errors now report the resolved address where possible. by @BenPope in #29202
- rpk shadow create [cloud]: now rpk validates if the secret exists in the Shadow cluster before sending a request to create by @r-vasquez in #29129
- rpk shadow describe now supports the --format json/yaml flag. by @r-vasquez in #29130
- PR #29275 Improve descriptions for OpenAPI (backport) by @kbatuigas
Full Changelog: v25.3.4...v25.3.5
v25.3.4
Features
- Enable compaction of transactional control batches per delete.retention.ms. This feature cannot be enabled at the same time as any tiered storage topic properties (i.e this feature is only accessible for local topics). by @bashtanov in #29109
Bug Fixes
- Fix a cache collision in in-memory spillover manifest cache which could lead to new topic reading data from the old topic for a short period of time. by @nvartolomei in #29086
- Iceberg: Allow bucket names with dots. Also, reject URIs returned by catalog that look like
s3://bucket.s3.amazonaws.com/path/to/object. by @nvartolomei in #29096
Full Changelog: v25.3.3...v25.3.4
v25.3.3
Bug Fixes
- Fixes incorrect reporting of partition movement progress in decommission/reconfiguration status output. by @bharathv in #29055
- Prevent a slew of races between operations in the
storagelayer that could lead to attempting to append to a closed segment or a failed assert by @WillemKauf in #28545 - Updated C-Ares to 1.34.6 to address CVE-2025-62408 by @michael-redpanda in #29052
- Variety of fixes to reduce noise in log concerning internal kafka client authentication and authorization by @michael-redpanda in #28927
- prevents state machine from loading local snapshot with offsets greater than log dirty offset by @mmaslankaprv in #29008
Improvements
- Improve timeout logic for failover link to not timeout when processing thousands of shadow topics by @michael-redpanda in #28997
- Increase frequency of topic reconciliation loop to reduce time it takes to failover topics by @michael-redpanda in #28997
- Reduce log noise by @michael-redpanda in #28997
rpk shadownow has visual feedback on long-running operations. by @r-vasquez in #29078- reduce test failures on data_migrations_api_test by @joe-redpanda in #28829
- rpk shadow describe now shows Schema Registry sync mode. by @r-vasquez in #29035
- rpk: consume warns when requested end offset is lower than available start offset by @daisukebe in #29049
- PR #29030 [v25.3.x] Fetch read concurrency fix by @ballard26
- PR #29042 [v25.3.x] [CORE-15015]
security&kafka: audit log deflaking by @WillemKauf
Full Changelog: v25.3.2...v25.3.3
v25.2.13
Bug Fixes
- Fix an issue where an unhandled exception in archival could lead to an input_stream asserting in its destructor. by @oleiman in #28923
- Fixed a rare bug that causes timequeries against partitions using tiered storage to incorrectly return no result when the partition's local log is empty but retains an active segment. by @wdberkeley in #28898
- PR #28868 [v25.2.x] archival: treat purge key_not_found error as success by @andrwng
Full Changelog: v25.2.12...v25.2.13
v25.3.2
Features
- Rpk can now generate a dashboard for monitoring Redpanda Serverless clusters via
rpk generate grafana-dashboard --dashboard serverless. by @nicolaferraro in #28894 - #28931 [UX-746] rpk shadow (cloud): add failure reason by @r-vasquez
Bug Fixes
- Attempt to fail over a topic that isn't being Shadowed now returns a
404rather than a409by @michael-redpanda in #28742 - Fix an issue where an unhandled exception in archival could lead to an input_stream asserting in its destructor. by @oleiman in #28924
- Fixed a bug where if a user updates a Shadow Link with the same password the password set at timestamp was cleared. Now if they use the same password, the timestamp is kept at its previous value by @michael-redpanda in #28863
- Fixed a rare bug that causes timequeries against partitions using tiered storage to incorrectly return no result when the partition's local log is empty but retains an active segment. by @wdberkeley in #28871
- Fixes a bug in which a
segmentcould be incorrectly marked as having finished self compaction during a race with alogshutdown by @WillemKauf in #28799 - #28853 Avoids runaway replicators after topics got deleted. Additionally improve some observability related to shadow requests. by @bharathv in #28869
- schema_registry/swagger: Fix type for
versionin GET/compatibility/subjects/{subject}/versions/{version}by @BenPope in #28766
Markdown - #28596 [CORE-14647] ct: Take max applied epoch into account by @Lazin
- #28621 tx_gateway: do not log error on shutdown by @mmaslankaprv
- #28681 [CORE-13776] Handle rpk.describe_group racing with __consumer_offsets creation by @dotnwat
- #28694 [CORE-14665] security/audit: Fix stuck misconfigured state by @IoannisRP
- #28755 cluster: fix topic label aggregation on restart by @ballard26
- #28808 Recovery throttler fix by @bashtanov
- #28827 [CORE-8225] cloud_storage_clients/abs: Drop showonly=files when using a delimiter by @wdberkeley
- #28888 [CORE-14922] test: ignore expired cert log lines by @dotnwat
- #28909 shadowing/tests/verifier: use unique_id suffix for group names by @bharathv
- #28910 [CORE-14907] Fix overflow in coordinated recovery throttling by @bashtanov
- #28940 when lowering recovery rate with recoveries in flight don't wait for available bytes to converge by @bashtanov
Improvements
- Adds support for SASL/PLAIN authentication for Shadow Linking by @michael-redpanda in #28942
- Aliases the following enum variants: by @michael-redpanda in #28876
ACLPattern.ACL_PATTERN_PREFIXtoACLPattern.ACL_PATTERN_PREFIXEDPatternType.PATTERN_TYPE_PREFIXEDtoPatternType.PATTERN_TYPE_PREFIX
- Fixes a vulnerability in aioboto3 by pinning the urllib3 dependency. by @tyson-redpanda in #28919
- Minor improvements to http client for better connection reuse in certain edge cases. by @nvartolomei in #28822
- The message printed by
rpk config exportis now written to stderr instead of stdout, preventing it from interfering with the exported configuration when stdout is used as the output destination. i.e.rpk config export --all -f /dev/stdoutby @simon0191 in #28761 - The restart is no longer required if the cloud storage auth token is invalidated. by @Lazin in #28712
- Updated default console image version in rpk container commands to v3.3.0 by @vbotbuildovich in #28638
- fix shard placement table race condition by @joe-redpanda in #28675
- partitions with an in-flight move and original replica quorum loss will now be reported as immutable by @joe-redpanda in #28687
- rpk cluster config set: Poll operation status before returning by @paulzhang97 in #28794
- rpk shadow is now supported in Redpanda Cloud by @r-vasquez in #28917
- #28849 http: Add TCP keepalive to http APIs by @StephanDollberg
- #28673 admin: Store decommission_status partitions in a chunked array by @wdberkeley
- #28752 bazel: remove kafka/server dep from txn_reader by @rockwotj
- #28790 [CORE-7351] Improve chances of finding a scrubber hit by @dotnwat
- #28813 bazel: Update seastar ref by @StephanDollberg
- #28914
Add Shadow Link information to metrics by @michael-redpanda
Full Changelog: v25.3.1...v25.3.2