You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fix MCP server by including mcp directory in npm package. (#161)
* Fix MCP server by including mcp directory in npm package.
The MCP server was failing with 'Prompts directory not found' because
the mcp/ directory wasn't being published to npm. Added mcp to the
files array in package.json to ensure prompts and resources are
included in published packages.
* Update README
* Update README
:description: This document explains how data archiving can be configured.
3
+
4
+
== Overview
5
+
6
+
Tiered Storage allows data to be moved to object storage like S3 or GCS. This feature was introduced in Redpanda and it is used by many customers to reduce storage costs. In this guide, you will learn how to configure archiving.
7
+
8
+
== Prerequisites
9
+
10
+
Before you begin, the following prerequisites must be met:
11
+
12
+
* A Redpanda cluster should be running
13
+
* AWS credentials need to be configured
14
+
* The S3 bucket must have been created already
15
+
* You should have admin access to the Redpanda UI
16
+
17
+
== Configuration Steps
18
+
19
+
=== Step 1: Enable Tiered Storage
20
+
21
+
First, tiered storage needs to be enabled on your cluster. This can be done by running the following command:
22
+
23
+
[,bash]
24
+
----
25
+
rpk cluster config set cloud_storage_enabled true
26
+
----
27
+
28
+
After the command is executed, the cluster will be restarted automatically.
29
+
30
+
=== Step 2: Configure the S3 Bucket
31
+
32
+
The bucket needs to be configured next. Go to the Redpanda Console and click on the Settings tab. The following settings should be entered:
33
+
34
+
|===
35
+
| Setting | Value
36
+
37
+
| cloud_storage_bucket | your-bucket-name
38
+
| cloud_storage_region | us-east-1
39
+
|===
40
+
41
+
NOTE: It is recommended that versioning is enabled on your bucket.
42
+
43
+
=== Step 3: Set Retention Policy
44
+
45
+
Data retention can be configured at the topic level. You should utilize the `rpk` command line tool:
The above command sets retention to approximately 1GB. After this is done, old segments will be uploaded to S3 and deleted locally.
53
+
54
+
== Verifying the Setup
55
+
56
+
To verify that archiving is working, the following steps can be taken:
57
+
58
+
1. Data should be produced to a topic
59
+
2. Wait for segments to be uploaded (this usually takes a few minutes)
60
+
3. The S3 bucket can be checked using the AWS CLI or Console
61
+
62
+
You can also run this command to check the status:
63
+
64
+
[,bash]
65
+
----
66
+
rpk cluster storage status
67
+
----
68
+
69
+
== Troubleshooting
70
+
71
+
If data is not being uploaded, the following should be checked:
72
+
73
+
* Credentials - it's possible that the AWS credentials are invalid or expired
74
+
* Bucket permissions - write access must be granted to Redpanda
75
+
* Network - connectivity to S3 should be verified
76
+
77
+
TIP: Logs can be very helpful here. They can be viewed using `rpk debug logs`.
78
+
79
+
== Summary
80
+
81
+
In this guide, tiered storage configuration was explained. By following these steps, your data will be automatically archived to S3, which helps reduce costs while maintaining data availability.
0 commit comments