You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/manage/pages/schema-reg/schema-id-validation.adoc
+10-10Lines changed: 10 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -87,8 +87,8 @@ When <<enable-schema-id-validation,schema ID validation is enabled>>, Redpanda u
87
87
88
88
To customize the subject name strategy per topic, set the following client topic properties:
89
89
90
-
* Set `redpanda.key.schema.id.validation` to `true` to enable key schema ID validation for the topic, and set `redpanda.key.subject.name.strategy` to the desired subject name strategy for keys of the topic (default: `TopicNameStrategy`).
91
-
* Set `redpanda.value.schema.id.validation` to `true` to enable value schema ID validation for the topic, and set `redpanda.value.subject.name.strategy` to the desired subject name strategy for values of the topic (default: `TopicNameStrategy`).
90
+
* Set xref:reference:properties/topic-properties.adoc#redpandakeyschemavalidation[`redpanda.key.schema.id.validation`] to `true` to enable key schema ID validation for the topic, and set xref:reference:properties/topic-properties.adoc#redpandakeysubjectnamestrategy[`redpanda.key.subject.name.strategy`] to the desired subject name strategy for keys of the topic (default: `TopicNameStrategy`).
91
+
* Set xref:reference:properties/topic-properties.adoc#redpandavalueschemavalidation[`redpanda.value.schema.id.validation`] to `true` to enable value schema ID validation for the topic, and set xref:reference:properties/topic-properties.adoc#redpandavaluesubjectnamestrategy[`redpanda.value.subject.name.strategy`] to the desired subject name strategy for values of the topic (default: `TopicNameStrategy`).
92
92
93
93
[NOTE]
94
94
====
@@ -97,17 +97,17 @@ The `redpanda.` properties have corresponding `confluent.` properties.
Copy file name to clipboardExpand all lines: modules/manage/partials/tiered-storage.adoc
-8Lines changed: 0 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1186,7 +1186,6 @@ rpk cluster config set cloud_storage_enable_segment_uploads true
1186
1186
For some applications, where the newest data is more valuable than historical data, data accumulation can be worse than data loss. In such cases, where you cannot afford to lose the most recently-produced data by rejecting produce requests after producers have filled the local disks during the period of paused uploads, there is a less safe pause and resume mechanism. This mechanism prioritizes the ability to receive new data over retaining data that cannot be uploaded when disks are full:
1187
1187
1188
1188
- Set the xref:reference:properties/object-storage-properties.adoc#cloud_storage_enable_remote_allow_gaps[`cloud_storage_enable_remote_allow_gaps`] cluster configuration property to `true`. This allows for gaps in the logs of all Tiered Storage topics in the cluster.
1189
-
- Set the `redpanda.remote.allow_gaps` configuration property to `true`. This allows gaps for one specific topic. This topic-level configuration option overrides the cluster-level default.
1190
1189
1191
1190
When you pause uploads and set one of these properties to `true`, there may be gaps in the range of offsets stored in object storage. You can seamlessly resume uploads by setting `*allow_gaps` to `true` at either the cluster or topic level. If set to `false`, disk space could be depleted and produce requests would be throttled.
1192
1191
@@ -1199,19 +1198,12 @@ rpk cluster config set cloud_storage_enable_segment_uploads false
1199
1198
# To avoid overflow when allowing gaps in the log.
1200
1199
# In this example, data that is not uploaded to cloud storage may be
1201
1200
# deleted if a disk fills before uploads are resumed.
Copy file name to clipboardExpand all lines: modules/reference/pages/properties/object-storage-properties.adoc
+2-1Lines changed: 2 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -712,6 +712,7 @@ When set to `true`, Redpanda can re-upload data for compacted topics to object s
712
712
713
713
---
714
714
715
+
[[cloud_storage_enable_remote_allow_gaps]]
715
716
=== cloud_storage_enable_remote_allow_gaps
716
717
717
718
Controls the eviction of locally stored log segments when Tiered Storage uploads are paused. Set to `false` to only evict data that has already been uploaded to object storage. If the retained data fills the local volume, Redpanda throttles producers. Set to `true` to allow the eviction of locally stored log segments, which may create gaps in offsets.
@@ -790,7 +791,7 @@ Enables adjacent segment merging. The segments are reuploaded if there is an opp
790
791
791
792
=== cloud_storage_enable_segment_uploads
792
793
793
-
Controls the upload of log segments to Tiered Storage. If set to `false`, this property temporarily pauses all log segment uploads from the Redpanda cluster. When the uploads are paused, the <<cloud_storage_enable_remote_allow_gaps, `cloud_storage_enable_remote_allow_gaps`>> cluster configuration and `redpanda.remote.allowgaps` topic properties control local retention behavior.
794
+
Controls the upload of log segments to Tiered Storage. If set to `false`, this property temporarily pauses all log segment uploads from the Redpanda cluster. When the uploads are paused, the <<cloud_storage_enable_remote_allow_gaps, `cloud_storage_enable_remote_allow_gaps`>> cluster configuration and xref:properties/topic-properties.adoc#redpandaremoteallowgaps[`redpanda.remote.allowgaps`] topic properties control local retention behavior.
Copy file name to clipboardExpand all lines: modules/reference/pages/properties/topic-properties.adoc
+127-1Lines changed: 127 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -739,4 +739,130 @@ Controls how often the data in the Iceberg table is refreshed with new data from
739
739
740
740
**Related topics**:
741
741
742
-
- xref:manage:iceberg/about-iceberg-topics.adoc[]
742
+
- xref:manage:iceberg/about-iceberg-topics.adoc[]
743
+
744
+
---
745
+
== Schema Registry and Validation Properties
746
+
747
+
The following properties control server-side schema ID validation for topics when using Schema Registry.
748
+
749
+
[[redpandakeyschemavalidation]]
750
+
=== redpanda.key.schema.id.validation
751
+
752
+
Enable validation of the schema ID for keys on a record. When enabled, Redpanda validates that the schema ID encoded in the record's key is registered in the Schema Registry according to the configured subject name strategy.
753
+
754
+
*Type:* boolean
755
+
756
+
*Default:* `false`
757
+
758
+
**Related topics**:
759
+
760
+
- xref:manage:schema-reg/schema-id-validation.adoc[Server-Side Schema ID Validation]
761
+
762
+
---
763
+
[[redpandakeysubjectnamestrategy]]
764
+
=== redpanda.key.subject.name.strategy
765
+
766
+
The subject name strategy for keys when `redpanda.key.schema.id.validation` is enabled. This determines how the topic and schema are mapped to a subject name in the Schema Registry.
- xref:manage:schema-reg/schema-id-validation.adoc[Server-Side Schema ID Validation]
777
+
778
+
---
779
+
[[redpandavalueschemavalidation]]
780
+
=== redpanda.value.schema.id.validation
781
+
782
+
Enable validation of the schema ID for values on a record. When enabled, Redpanda validates that the schema ID encoded in the record's value is registered in the Schema Registry according to the configured subject name strategy.
783
+
784
+
*Type:* boolean
785
+
786
+
*Default:* `false`
787
+
788
+
**Related topics**:
789
+
790
+
- xref:manage:schema-reg/schema-id-validation.adoc[Server-Side Schema ID Validation]
791
+
792
+
---
793
+
[[redpandavaluesubjectnamestrategy]]
794
+
=== redpanda.value.subject.name.strategy
795
+
796
+
The subject name strategy for values when `redpanda.value.schema.id.validation` is enabled. This determines how the topic and schema are mapped to a subject name in the Schema Registry.
- xref:manage:schema-reg/schema-id-validation.adoc[Server-Side Schema ID Validation]
807
+
808
+
---
809
+
[[confluentkeyschemavalidation]]
810
+
=== confluent.key.schema.validation
811
+
812
+
Enable validation of the schema ID for keys on a record. This is a compatibility alias for `redpanda.key.schema.id.validation`. When enabled, Redpanda validates that the schema ID encoded in the record's key is registered in the Schema Registry according to the configured subject name strategy.
813
+
814
+
*Type:* boolean
815
+
816
+
*Default:* `false`
817
+
818
+
**Related topics*:
819
+
820
+
- xref:manage:schema-reg/schema-id-validation.adoc[Server-Side Schema ID Validation]
821
+
822
+
---
823
+
[[confluentkeysubjectnamestrategy]]
824
+
=== confluent.key.subject.name.strategy
825
+
826
+
The subject name strategy for keys when `confluent.key.schema.validation` is enabled. This is a compatibility alias for `redpanda.key.subject.name.strategy` that determines how the topic and schema are mapped to a subject name in the Schema Registry.
- xref:manage:schema-reg/schema-id-validation.adoc[Server-Side Schema ID Validation]
837
+
838
+
---
839
+
[[confluentvalueschemavalidation]]
840
+
=== confluent.value.schema.validation
841
+
842
+
Enable validation of the schema ID for values on a record. This is a compatibility alias for `redpanda.value.schema.id.validation`. When enabled, Redpanda validates that the schema ID encoded in the record's value is registered in the Schema Registry according to the configured subject name strategy.
843
+
844
+
*Type:* boolean
845
+
846
+
*Default:* `false`
847
+
848
+
**Related topics**:
849
+
850
+
- xref:manage:schema-reg/schema-id-validation.adoc[Server-Side Schema ID Validation]
851
+
852
+
---
853
+
[[confluentvaluesubjectnamestrategy]]
854
+
=== confluent.value.subject.name.strategy
855
+
856
+
The subject name strategy for values when `confluent.value.schema.validation` is enabled. This is a compatibility alias for `redpanda.value.subject.name.strategy`. This determines how the topic and schema are mapped to a subject name in the Schema Registry.
0 commit comments