Skip to content

Commit fd13906

Browse files
micheleRPFeediver1
andauthored
DOC-1610-max-message-size-for-Redpanda-Cloud (#458)
* DOC-1610-max-message-size-for-Redpanda-Cloud * minor edit * minor edit * update create-topic.adoc * fix what's new * minor edit * Update modules/get-started/pages/whats-new-cloud.adoc Co-authored-by: Joyce Fee <[email protected]> * edit existing serverless message size from 20 MB to 20 MiB --------- Co-authored-by: Joyce Fee <[email protected]>
1 parent e546332 commit fd13906

File tree

4 files changed

+39
-20
lines changed

4 files changed

+39
-20
lines changed

modules/get-started/pages/cloud-overview.adoc

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -53,6 +53,11 @@ Redpanda Cloud offers three fully-managed cloud deployment options, each designe
5353
| Up to 45,600
5454
| Up to 112,500
5555

56+
| *Max message size (MiB)*
57+
| 8 (default), 20 (max)
58+
| 20 (default), 32 (max)
59+
| 20 (default), 32 (max)
60+
5661
| *Private networking*
5762
| ✗
5863
| ✓

modules/get-started/pages/cluster-types/serverless.adoc

Lines changed: 10 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -16,21 +16,16 @@ Serverless is the fastest and easiest way to start data streaming. With Serverle
1616

1717
Each Serverless cluster has the following maximum usage limits:
1818

19-
[cols="1,2",options="header"]
20-
|===
21-
| Metric | Limit
22-
23-
| Ingress | 100 MB/s
24-
| Egress | 300 MB/s
25-
| Partitions | 5,000
26-
| Message size | 20 MiB
27-
| Retention | unlimited
28-
| Storage | unlimited
29-
| Users | 30
30-
| ACLs | 120
31-
| Consumer groups | 200
32-
| Connections | 10,000
33-
|===
19+
* **Ingress**: 100 MB/s
20+
* **Egress**: 300 MB/s
21+
* **Partitions**: 5,000
22+
* **Message size**: 20 MiB
23+
* **Retention**: unlimited
24+
* **Storage**: unlimited
25+
* **Users**: 30
26+
* **ACLs**: 120
27+
* **Consumer groups**: 200
28+
* **Connections**: 10,000
3429

3530

3631
NOTE: The partition limit is the number of logical partitions before replication occurs. Redpanda Cloud uses a replication factor of 3.

modules/get-started/pages/create-topic.adoc

Lines changed: 18 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66

77
Topics provide a way to organize events. After creating a cluster, you can create a topic in it. Each cluster can have up to 40,000 topics.
88

9-
Topic properties are populated from information stored in the broker. Redpanda features, such as Tiered Storage, are enabled and configured by default in Redpanda Cloud. For Dedicated and BYOC clusters, you can optionally overwrite some settings.
9+
Topic properties are populated from information stored in the broker. Redpanda features, such as Tiered Storage, are enabled and configured by default in Redpanda Cloud. You can optionally overwrite some settings.
1010

1111
include::develop:partial$topic-properties-warning.adoc[]
1212

@@ -22,16 +22,29 @@ include::develop:partial$topic-properties-warning.adoc[]
2222
| The number of partitions for the topic.
2323

2424
| *Replication factor*
25-
| The number of partition replicas for the topic. Redpanda Cloud requires a minimum of 3 topic replicas. If a topic is created with a replication factor of 1, Redpanda resets the replication factor to 3.
25+
| The number of partition replicas for the topic.
26+
27+
Redpanda Cloud requires a minimum of 3 topic replicas. If a topic is created with a replication factor of 1, Redpanda resets the replication factor to 3.
2628

2729
| *Cleanup policy*
28-
| The policy that determines how to clean up old log segments. The default is *delete*.
30+
| The policy that determines how to clean up old log segments.
31+
32+
The default is *delete*.
2933

3034
| *Retention time*
31-
| The maximum length of time to keep messages in a topic. The default is *7 days*.
35+
| The maximum length of time to keep messages in a topic.
36+
37+
The default is *7 days*.
3238

3339
| *Retention size*
34-
| The maximum size of each partition. If a partition reaches this size and more messages are added, the oldest messages are deleted. The default is *infinite*.
40+
| The maximum size of each partition. If a partition reaches this size and more messages are added, the oldest messages are deleted.
41+
42+
The default is *infinite*.
43+
44+
| *Message size*
45+
| The maximum size of a message or batch for a newly-created topic.
46+
47+
The default is *20 MiB* for BYOC and Dedicated clusters, and *8 MiB* for Serverless clusters. You can increase this value up to *32 MiB* for BYOC and Dedicated clusters, and *20 MiB* for Serverless clusters, with the `message.max.bytes` topic property.
3548
|===
3649

3750

modules/get-started/pages/whats-new-cloud.adoc

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,12 @@ You can now create xref:get-started:cluster-types/serverless.adoc[Serverless clu
1616

1717
You can view details about Kafka client connections using `rpk` or the Data Plane API. This allows you to view detailed information about active client connections on a cluster, and identify and troubleshoot problematic clients. For more information, see the xref:manage:cluster-maintenance/manage-throughput.adoc#view-connected-client-details[connected client details] example in the Manage Throughput guide.
1818

19+
=== Increased message size limit
20+
21+
Redpanda Cloud increased the xref:get-started:create-topic.adoc[message size limit] on newly-created topics. BYOC and Dedicated clusters have a default message size limit of 20 MiB with a maximum of 32 MiB. Serverless clusters have a default message size limit of 8 MiB with a maximum of 20 MiB. Configure the message size limit with the `max_message_bytes` topic property.
22+
23+
The message size setting on existing topics is not changed, but the message size limit on existing topics can only be updated to the new maximum.
24+
1925
=== Redpanda Connect updates
2026

2127
Redpanda Connect provides a simplified xref:develop:connect/connect-quickstart.adoc[quickstart] experience in the UI that helps you to start building data pipelines. The quickstart wizard creates pipelines to stream data into and out of Redpanda, populating the required YAML configuration automatically.

0 commit comments

Comments
 (0)