Skip to content

Commit 54de33e

Browse files
committed
topic prop update
1 parent 35f93d9 commit 54de33e

File tree

1 file changed

+54
-14
lines changed

1 file changed

+54
-14
lines changed

modules/reference/partials/properties/topic-properties.adoc

Lines changed: 54 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -317,9 +317,11 @@ endif::[]
317317

318318
The retention time for tombstone records in a compacted topic. Redpanda removes tombstone records after the retention limit is exceeded.
319319

320-
If you have enabled Tiered Storage and set <<redpandaremoteread,`redpanda.remote.read`>> or <<redpandaremotewrite,`redpanda.remote.write`>> for the topic, you cannot enable tombstone removal.
320+
This property supports three states:
321321

322-
If both `delete.retention.ms` and the cluster property config_ref:tombstone_retention_ms,true,properties/cluster-properties[] are set, `delete.retention.ms` overrides the cluster level tombstone retention for an individual topic.
322+
* Positive value: Sets the milliseconds to retain tombstone records before removal.
323+
* 0: Tombstone records are immediately eligible for removal.
324+
* Negative value: No per-topic limit applied, inherits cluster default from tombstone_retention_ms.
323325

324326
[cols="1s,2a"]
325327
|===
@@ -497,7 +499,13 @@ endif::[]
497499
// tag::category-tiered-storage[]
498500
=== initial.retention.local.target.bytes
499501

500-
A size-based initial retention limit for Tiered Storage that determines how much data in local storage is transferred to a partition replica when a cluster is resized. If `null` (default), all locally retained data is transferred.
502+
A size-based initial retention limit for Tiered Storage that determines how much data in local storage is transferred to a partition replica when a cluster is resized.
503+
504+
This property supports three states:
505+
506+
* Positive value: Sets the maximum bytes of local data to transfer during cluster resize.
507+
* 0: No local data is transferred during cluster resize.
508+
* Negative value: All locally retained data is transferred (default behavior).
501509

502510
[cols="1s,2a"]
503511
|===
@@ -544,7 +552,13 @@ endif::[]
544552
// tag::category-tiered-storage[]
545553
=== initial.retention.local.target.ms
546554

547-
A time-based initial retention limit for Tiered Storage that determines how much data in local storage is transferred to a partition replica when a cluster is resized. If `null` (default), all locally retained data is transferred.
555+
A time-based initial retention limit for Tiered Storage that determines how much data in local storage is transferred to a partition replica when a cluster is resized.
556+
557+
This property supports three states:
558+
559+
* Positive value: Sets the maximum age (milliseconds) of local data to transfer during cluster resize.
560+
* 0: No local data is transferred during cluster resize.
561+
* Negative value: All locally retained data is transferred (default behavior).
548562

549563
[cols="1s,2a"]
550564
|===
@@ -830,7 +844,13 @@ endif::[]
830844
// tag::category-retention-compaction[]
831845
=== min.cleanable.dirty.ratio
832846

833-
The minimum ratio between the number of bytes in dirty segments and the total number of bytes in closed segments that must be reached before a partition's log is eligible for compaction in a compact topic.
847+
The minimum ratio between dirty and total bytes in closed segments before a partition's log is eligible for compaction in a compact topic.
848+
849+
This property supports three states:
850+
851+
* Positive value: Sets the minimum dirty ratio (0.0 to 1.0) required before compaction.
852+
* 0: Compaction is always eligible regardless of dirty ratio.
853+
* Negative value: Uses the cluster default from min_cleanable_dirty_ratio.
834854

835855
[cols="1s,2a"]
836856
|===
@@ -1701,9 +1721,11 @@ endif::[]
17011721

17021722
A size-based retention limit that configures the maximum size that a topic partition can grow before becoming eligible for cleanup.
17031723

1704-
If `retention.bytes` is set to a positive value, it overrides the cluster property xref:cluster-properties.adoc#retention_bytes[`retention_bytes`] for the topic, and the total retained size for the topic is `retention.bytes` multiplied by the number of partitions for the topic.
1724+
This property supports three states:
17051725

1706-
When both size-based (`retention.bytes`) and time-based (`retention.ms`) retention limits are set, cleanup occurs when either limit is reached.
1726+
* Positive value: Sets the maximum bytes per partition. When exceeded, oldest data becomes eligible for cleanup.
1727+
* 0: Partitions are immediately eligible for cleanup.
1728+
* Negative value: No per-topic limit applied, inherits cluster default from retention_bytes.
17071729

17081730
[cols="1s,2a"]
17091731
|===
@@ -1752,7 +1774,13 @@ endif::[]
17521774
// tag::category-tiered-storage[]
17531775
=== retention.local.target.bytes
17541776

1755-
A size-based retention limit for Tiered Storage that configures the maximum size that a topic partition in local storage can grow before becoming eligible for cleanup. It applies per partition and is equivalent to <<retentionbytes, `retention.bytes`>> without Tiered Storage.
1777+
A size-based retention limit for Tiered Storage that configures the maximum size that a topic partition in local storage can grow before becoming eligible for cleanup.
1778+
1779+
This property supports three states:
1780+
1781+
* Positive value: Sets the maximum bytes per partition in local storage before cleanup.
1782+
* 0: Data in local storage is immediately eligible for cleanup.
1783+
* Negative value: No per-topic limit applied, inherits cluster default.
17561784

17571785
[cols="1s,2a"]
17581786
|===
@@ -1799,7 +1827,13 @@ endif::[]
17991827
// tag::category-tiered-storage[]
18001828
=== retention.local.target.ms
18011829

1802-
A time-based retention limit for Tiered Storage that sets the maximum duration that a log's segment file for a topic is retained in local storage before it's eligible for cleanup. This property is equivalent to <<retentionms, `retention.ms`>> without Tiered Storage.
1830+
A time-based retention limit for Tiered Storage that sets the maximum duration that a log's segment file for a topic is retained in local storage before cleanup.
1831+
1832+
This property supports three states:
1833+
1834+
* Positive value: Sets the maximum milliseconds to retain data in local storage.
1835+
* 0: Data in local storage is immediately eligible for cleanup.
1836+
* Negative value: No per-topic limit applied, inherits cluster default.
18031837

18041838
[cols="1s,2a"]
18051839
|===
@@ -1848,11 +1882,13 @@ endif::[]
18481882
// tag::category-retention-compaction[]
18491883
=== retention.ms
18501884

1851-
A time-based retention limit that configures the maximum duration that a log's segment file for a topic is retained before it becomes eligible to be cleaned up. To consume all data, a consumer of the topic must read from a segment before its `retention.ms` elapses, otherwise the segment may be compacted and/or deleted. If a non-positive value, no per-topic limit is applied.
1885+
A time-based retention limit that configures the maximum duration that a log's segment file for a topic is retained before it becomes eligible to be cleaned up.
18521886

1853-
If `retention.ms` is set to a positive value, it overrides the cluster property xref:./cluster-properties.adoc#log_retention_ms[`log_retention_ms`] for the topic.
1887+
This property supports three states:
18541888

1855-
When both size-based (`retention.bytes`) and time-based (`retention.ms`) retention limits are set, the earliest occurring limit applies.
1889+
* Positive value: Sets the maximum milliseconds to retain data. After this duration, segments become eligible for cleanup.
1890+
* 0: Data is immediately eligible for cleanup.
1891+
* Negative value: No per-topic limit applied, inherits cluster default from log_retention_ms.
18561892

18571893
[cols="1s,2a"]
18581894
|===
@@ -1954,9 +1990,13 @@ endif::[]
19541990
// tag::category-segment-message[]
19551991
=== segment.ms
19561992

1957-
The maximum duration that a log segment of a topic is active (open for writes and not deletable). A periodic event, with `segment.ms` as its period, forcibly closes the active segment and transitions, or rolls, to a new active segment. The closed (inactive) segment is then eligible to be cleaned up according to cleanup and retention properties.
1993+
The maximum duration that a log segment of a topic is active (open for writes and not deletable). A periodic event forcibly closes the active segment and transitions to a new active segment.
1994+
1995+
This property supports three states:
19581996

1959-
If set to a positive duration, `segment.ms` overrides the cluster property xref:./cluster-properties.adoc#log_segment_ms[`log_segment_ms`]. Values are automatically clamped between the cluster bounds set by xref:./cluster-properties.adoc#log_segment_ms_min[`log_segment_ms_min`] (default: 10 minutes) and xref:./cluster-properties.adoc#log_segment_ms_max[`log_segment_ms_max`] (default: 1 year). If your configured value exceeds these bounds, Redpanda uses the bound value and logs a warning. Check current cluster bounds with `rpk cluster config get log_segment_ms_min log_segment_ms_max`.
1997+
* Positive value: Sets the maximum milliseconds a segment remains active before rolling to a new segment.
1998+
* 0: Segments are immediately eligible for closure.
1999+
* Negative value: Uses the cluster default from log_segment_ms.
19602000

19612001
[cols="1s,2a"]
19622002
|===

0 commit comments

Comments
 (0)