You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/reference/partials/properties/topic-properties.adoc
+54-14Lines changed: 54 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -317,9 +317,11 @@ endif::[]
317
317
318
318
The retention time for tombstone records in a compacted topic. Redpanda removes tombstone records after the retention limit is exceeded.
319
319
320
-
If you have enabled Tiered Storage and set <<redpandaremoteread,`redpanda.remote.read`>> or <<redpandaremotewrite,`redpanda.remote.write`>> for the topic, you cannot enable tombstone removal.
320
+
This property supports three states:
321
321
322
-
If both `delete.retention.ms` and the cluster property config_ref:tombstone_retention_ms,true,properties/cluster-properties[] are set, `delete.retention.ms` overrides the cluster level tombstone retention for an individual topic.
322
+
* Positive value: Sets the milliseconds to retain tombstone records before removal.
323
+
* 0: Tombstone records are immediately eligible for removal.
324
+
* Negative value: No per-topic limit applied, inherits cluster default from tombstone_retention_ms.
323
325
324
326
[cols="1s,2a"]
325
327
|===
@@ -497,7 +499,13 @@ endif::[]
497
499
// tag::category-tiered-storage[]
498
500
=== initial.retention.local.target.bytes
499
501
500
-
A size-based initial retention limit for Tiered Storage that determines how much data in local storage is transferred to a partition replica when a cluster is resized. If `null` (default), all locally retained data is transferred.
502
+
A size-based initial retention limit for Tiered Storage that determines how much data in local storage is transferred to a partition replica when a cluster is resized.
503
+
504
+
This property supports three states:
505
+
506
+
* Positive value: Sets the maximum bytes of local data to transfer during cluster resize.
507
+
* 0: No local data is transferred during cluster resize.
508
+
* Negative value: All locally retained data is transferred (default behavior).
501
509
502
510
[cols="1s,2a"]
503
511
|===
@@ -544,7 +552,13 @@ endif::[]
544
552
// tag::category-tiered-storage[]
545
553
=== initial.retention.local.target.ms
546
554
547
-
A time-based initial retention limit for Tiered Storage that determines how much data in local storage is transferred to a partition replica when a cluster is resized. If `null` (default), all locally retained data is transferred.
555
+
A time-based initial retention limit for Tiered Storage that determines how much data in local storage is transferred to a partition replica when a cluster is resized.
556
+
557
+
This property supports three states:
558
+
559
+
* Positive value: Sets the maximum age (milliseconds) of local data to transfer during cluster resize.
560
+
* 0: No local data is transferred during cluster resize.
561
+
* Negative value: All locally retained data is transferred (default behavior).
548
562
549
563
[cols="1s,2a"]
550
564
|===
@@ -830,7 +844,13 @@ endif::[]
830
844
// tag::category-retention-compaction[]
831
845
=== min.cleanable.dirty.ratio
832
846
833
-
The minimum ratio between the number of bytes in dirty segments and the total number of bytes in closed segments that must be reached before a partition's log is eligible for compaction in a compact topic.
847
+
The minimum ratio between dirty and total bytes in closed segments before a partition's log is eligible for compaction in a compact topic.
848
+
849
+
This property supports three states:
850
+
851
+
* Positive value: Sets the minimum dirty ratio (0.0 to 1.0) required before compaction.
852
+
* 0: Compaction is always eligible regardless of dirty ratio.
853
+
* Negative value: Uses the cluster default from min_cleanable_dirty_ratio.
834
854
835
855
[cols="1s,2a"]
836
856
|===
@@ -1701,9 +1721,11 @@ endif::[]
1701
1721
1702
1722
A size-based retention limit that configures the maximum size that a topic partition can grow before becoming eligible for cleanup.
1703
1723
1704
-
If `retention.bytes` is set to a positive value, it overrides the cluster property xref:cluster-properties.adoc#retention_bytes[`retention_bytes`] for the topic, and the total retained size for the topic is `retention.bytes` multiplied by the number of partitions for the topic.
1724
+
This property supports three states:
1705
1725
1706
-
When both size-based (`retention.bytes`) and time-based (`retention.ms`) retention limits are set, cleanup occurs when either limit is reached.
1726
+
* Positive value: Sets the maximum bytes per partition. When exceeded, oldest data becomes eligible for cleanup.
1727
+
* 0: Partitions are immediately eligible for cleanup.
1728
+
* Negative value: No per-topic limit applied, inherits cluster default from retention_bytes.
1707
1729
1708
1730
[cols="1s,2a"]
1709
1731
|===
@@ -1752,7 +1774,13 @@ endif::[]
1752
1774
// tag::category-tiered-storage[]
1753
1775
=== retention.local.target.bytes
1754
1776
1755
-
A size-based retention limit for Tiered Storage that configures the maximum size that a topic partition in local storage can grow before becoming eligible for cleanup. It applies per partition and is equivalent to <<retentionbytes, `retention.bytes`>> without Tiered Storage.
1777
+
A size-based retention limit for Tiered Storage that configures the maximum size that a topic partition in local storage can grow before becoming eligible for cleanup.
1778
+
1779
+
This property supports three states:
1780
+
1781
+
* Positive value: Sets the maximum bytes per partition in local storage before cleanup.
1782
+
* 0: Data in local storage is immediately eligible for cleanup.
1783
+
* Negative value: No per-topic limit applied, inherits cluster default.
1756
1784
1757
1785
[cols="1s,2a"]
1758
1786
|===
@@ -1799,7 +1827,13 @@ endif::[]
1799
1827
// tag::category-tiered-storage[]
1800
1828
=== retention.local.target.ms
1801
1829
1802
-
A time-based retention limit for Tiered Storage that sets the maximum duration that a log's segment file for a topic is retained in local storage before it's eligible for cleanup. This property is equivalent to <<retentionms, `retention.ms`>> without Tiered Storage.
1830
+
A time-based retention limit for Tiered Storage that sets the maximum duration that a log's segment file for a topic is retained in local storage before cleanup.
1831
+
1832
+
This property supports three states:
1833
+
1834
+
* Positive value: Sets the maximum milliseconds to retain data in local storage.
1835
+
* 0: Data in local storage is immediately eligible for cleanup.
1836
+
* Negative value: No per-topic limit applied, inherits cluster default.
1803
1837
1804
1838
[cols="1s,2a"]
1805
1839
|===
@@ -1848,11 +1882,13 @@ endif::[]
1848
1882
// tag::category-retention-compaction[]
1849
1883
=== retention.ms
1850
1884
1851
-
A time-based retention limit that configures the maximum duration that a log's segment file for a topic is retained before it becomes eligible to be cleaned up. To consume all data, a consumer of the topic must read from a segment before its `retention.ms` elapses, otherwise the segment may be compacted and/or deleted. If a non-positive value, no per-topic limit is applied.
1885
+
A time-based retention limit that configures the maximum duration that a log's segment file for a topic is retained before it becomes eligible to be cleaned up.
1852
1886
1853
-
If `retention.ms` is set to a positive value, it overrides the cluster property xref:./cluster-properties.adoc#log_retention_ms[`log_retention_ms`] for the topic.
1887
+
This property supports three states:
1854
1888
1855
-
When both size-based (`retention.bytes`) and time-based (`retention.ms`) retention limits are set, the earliest occurring limit applies.
1889
+
* Positive value: Sets the maximum milliseconds to retain data. After this duration, segments become eligible for cleanup.
1890
+
* 0: Data is immediately eligible for cleanup.
1891
+
* Negative value: No per-topic limit applied, inherits cluster default from log_retention_ms.
1856
1892
1857
1893
[cols="1s,2a"]
1858
1894
|===
@@ -1954,9 +1990,13 @@ endif::[]
1954
1990
// tag::category-segment-message[]
1955
1991
=== segment.ms
1956
1992
1957
-
The maximum duration that a log segment of a topic is active (open for writes and not deletable). A periodic event, with `segment.ms` as its period, forcibly closes the active segment and transitions, or rolls, to a new active segment. The closed (inactive) segment is then eligible to be cleaned up according to cleanup and retention properties.
1993
+
The maximum duration that a log segment of a topic is active (open for writes and not deletable). A periodic event forcibly closes the active segment and transitions to a new active segment.
1994
+
1995
+
This property supports three states:
1958
1996
1959
-
If set to a positive duration, `segment.ms` overrides the cluster property xref:./cluster-properties.adoc#log_segment_ms[`log_segment_ms`]. Values are automatically clamped between the cluster bounds set by xref:./cluster-properties.adoc#log_segment_ms_min[`log_segment_ms_min`] (default: 10 minutes) and xref:./cluster-properties.adoc#log_segment_ms_max[`log_segment_ms_max`] (default: 1 year). If your configured value exceeds these bounds, Redpanda uses the bound value and logs a warning. Check current cluster bounds with `rpk cluster config get log_segment_ms_min log_segment_ms_max`.
1997
+
* Positive value: Sets the maximum milliseconds a segment remains active before rolling to a new segment.
1998
+
* 0: Segments are immediately eligible for closure.
1999
+
* Negative value: Uses the cluster default from log_segment_ms.
0 commit comments