Skip to content

Commit b02aef5

Browse files
paulohtb6JakeSCahillasimms41
authored
docs: DOC-1649 Redpanda Cloud MCP Server (#369)
* docs: add the new rpk cloud mcp reference * DOC-1649 Redpanda MCP Server docs * Improve GIF * Add alias * Clarify config * Clarify config * Apply suggestions * Add details about endpoint availability * Update modules/ai-agents/pages/mcp/local/overview.adoc * Update overview.adoc * Update overview.adoc * Update quickstart.adoc * Update configuration.adoc * Update configuration.adoc * Add extra context and links * Optional * Fix anchor * Apply suggestions from code review Co-authored-by: Angela Simms <[email protected]> --------- Co-authored-by: JakeSCahill <[email protected]> Co-authored-by: Jake Cahill <[email protected]> Co-authored-by: Angela Simms <[email protected]>
1 parent 79d6d11 commit b02aef5

File tree

11 files changed

+338
-98
lines changed

11 files changed

+338
-98
lines changed

local-antora-playbook.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,9 @@ content:
1616
branches: HEAD
1717
- url: https://github.com/redpanda-data/documentation
1818
branches: [main, v/*, shared, site-search]
19+
- url: https://github.com/redpanda-data/docs-site
20+
branches: [main]
21+
start_paths: [home]
1922
- url: https://github.com/redpanda-data/redpanda-labs
2023
branches: main
2124
start_paths: [docs,'*/docs']

modules/ROOT/nav.adoc

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -69,9 +69,10 @@
6969
** xref:security:secrets.adoc[Secrets]
7070
** xref:security:cloud-safety-reliability.adoc[Safety and Reliability]
7171
72-
73-
* xref:develop:agents/about.adoc[AI Agents]
74-
** xref:develop:agents/create-support-agent.adoc[]
72+
* xref:ai-agents:mcp/local/index.adoc[]
73+
** xref:ai-agents:mcp/local/overview.adoc[Overview]
74+
** xref:ai-agents:mcp/local/quickstart.adoc[Quickstart]
75+
** xref:ai-agents:mcp/local/configuration.adoc[Configure]
7576
7677
* xref:develop:connect/about.adoc[Redpanda Connect]
7778
** xref:develop:connect/connect-quickstart.adoc[Quickstart]
@@ -486,6 +487,9 @@
486487
***** xref:reference:rpk/rpk-cloud/rpk-cloud-cluster-select.adoc[]
487488
**** xref:reference:rpk/rpk-cloud/rpk-cloud-login.adoc[]
488489
**** xref:reference:rpk/rpk-cloud/rpk-cloud-logout.adoc[]
490+
**** rpk cloud mcp
491+
***** xref:reference:rpk/rpk-cloud/rpk-cloud-mcp-install.adoc[]
492+
***** xref:reference:rpk/rpk-cloud/rpk-cloud-mcp-stdio.adoc[]
489493
*** xref:reference:rpk/rpk-cluster/rpk-cluster.adoc[]
490494
**** xref:reference:rpk/rpk-cluster/rpk-cluster-config.adoc[]
491495
***** xref:reference:rpk/rpk-cluster/rpk-cluster-config-get.adoc[]
Lines changed: 200 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,200 @@
1+
= Configure Redpanda Cloud MCP
2+
:page-beta: true
3+
:description: Learn how to configure the Redpanda Cloud MCP Server for your AI assistant, including auto and manual client setup, enabling deletes, and security considerations.
4+
5+
This page explains how to configure the Redpanda Cloud MCP Server for your AI assistant, including auto and manual client setup, enabling deletes, and security considerations.
6+
7+
== Prerequisites
8+
9+
* At least version 25.2.3 of xref:manage:rpk/rpk-install.adoc[`rpk` installed on your computer]
10+
* Access to a Redpanda Cloud account
11+
* Supported AI client (Claude, Claude Code, or other MCP-compatible client)
12+
13+
== Endpoint availability
14+
15+
The MCP server exposes Redpanda Cloud API endpoints for both the link:https://docs.redpanda.com/api/doc/cloud-controlplane/[Control Plane] and the link:https://docs.redpanda.com/api/doc/cloud-dataplane/[Data Plane] through `rpk`. Available endpoints depend on your `rpk` version. Newer API features require updated versions of `rpk`.
16+
17+
TIP: Keep `rpk` updated to the latest version to access new Redpanda Cloud features through the MCP server. New MCP endpoints are documented in Redpanda link:https://github.com/redpanda-data/redpanda/releases[release notes].
18+
19+
== Auto-configured clients (Claude and Claude Code)
20+
21+
For some supported clients, you can install and configure the MCP integration using the xref:reference:rpk/rpk-cloud/rpk-cloud-mcp-install.adoc[`rpk cloud mcp install` command].
22+
For Claude and Claude Code, run one of these commands:
23+
24+
```bash
25+
# Choose one
26+
rpk cloud mcp install --client claude
27+
rpk cloud mcp install --client claude-code
28+
```
29+
30+
If you need to update the integration, re-run the install command for your client.
31+
32+
== Manual configuration for other MCP clients
33+
34+
If you're using another MCP-compatible client, you can manually configure it to use Redpanda Cloud MCP Server. Follow these steps:
35+
36+
Add an MCP server entry to your client's configuration (example shown in JSON). Adjust paths for your system.
37+
38+
```json
39+
"mcpServers": {
40+
"redpandaCloud": {
41+
"command": "rpk",
42+
"args": [
43+
"--config",
44+
"<path-to-rpk.yaml>", <1>
45+
"cloud",
46+
"mcp",
47+
"stdio"
48+
]
49+
}
50+
}
51+
```
52+
<1> Optional: The `--config` flag lets you target a specific `rpk.yaml`, which contains the configuration for connecting to your cluster. Always use the same configuration path as you used for `rpk cloud login` to ensure it has your token. Default paths vary by operating system. See the xref:reference:rpk/rpk-cloud/rpk-cloud-login.adoc[`rpk cloud login`] reference for the default paths.
53+
54+
[TIP]
55+
====
56+
You can also <<local, start the server manually in a terminal to observe logs and troubleshoot>>.
57+
====
58+
59+
== Enable delete operations
60+
61+
Destructive operations are **disabled by default**. To allow delete operations, add `--allow-delete` to the MCP server invocation.
62+
63+
CAUTION: Enabling delete operations permits actions like **deleting topics or clusters**. Restrict access to your AI client and double-check prompts.
64+
65+
[tabs]
66+
====
67+
Auto-configured clients::
68+
+
69+
--
70+
```bash
71+
# Choose one
72+
rpk cloud mcp install --client claude --allow-delete
73+
rpk cloud mcp install --client claude-code --allow-delete
74+
```
75+
--
76+
Manual configuration example::
77+
+
78+
--
79+
```json
80+
"mcpServers": {
81+
"redpandaCloud": {
82+
"command": "rpk",
83+
"args": [
84+
"cloud",
85+
"mcp",
86+
"stdio",
87+
"--allow-delete"
88+
]
89+
}
90+
}
91+
```
92+
--
93+
====
94+
95+
== Configuration locations and paths
96+
97+
All `rpk` commands accept a `--config` flag, which lets you specify the exact `rpk.yaml` configuration file to use for connecting to your Redpanda cluster. This flag overrides the default search path and ensures that the command uses the credentials and settings from the file you provide.
98+
99+
Always use the same configuration path for both `rpk cloud login` and any MCP server setup or install commands to avoid authentication issues. By default, `rpk` searches for config files in standard locations depending on your operating system. See the xref:reference:rpk/rpk-cloud/rpk-cloud-login.adoc[reference documentation] for details. Use an absolute path and make sure your user has read and write permissions.
100+
101+
CAUTION: The `rpk` configuration file contains your Redpanda Cloud token. Keep the file secure and never share it.
102+
103+
For example, if you want to use a custom config path, specify it for both login and the MCP install command:
104+
105+
[source,bash]
106+
----
107+
rpk cloud login --config /Users/<user>/my-rpk-config.yaml
108+
rpk cloud mcp install --client claude --config /Users/<user>/my-rpk-config.yaml
109+
----
110+
111+
Or for Claude Code:
112+
113+
[source,bash]
114+
----
115+
rpk cloud login --config /Users/<user>/my-rpk-config.yaml
116+
rpk cloud mcp install --client claude-code --config /Users/<user>/my-rpk-config.yaml
117+
----
118+
119+
== Remove the MCP server
120+
121+
To remove the MCP server, delete or disable the `mcpServers.redpandaCloud` entry in your client's config (steps vary by client).
122+
123+
== Security considerations
124+
125+
* Avoid enabling `--allow-delete` unless required.
126+
* For most local use cases, such as with Claude or Claude Code, log in with your personal Redpanda Cloud user account for better security and easier management.
127+
* If you are deploying the MCP server as part of an application or shared environment, consider using a xref:security:cloud-authentication.adoc#authenticate-to-the-cloud-api[service account] with tailored roles. To log in as a service account, use:
128+
+
129+
[source,bash]
130+
----
131+
rpk cloud login --client-id <service-account-client-id> --client-secret <service-account-client-secret> --save
132+
----
133+
* Regularly review and rotate your credentials.
134+
135+
== Troubleshooting
136+
137+
=== Quick checks
138+
139+
. Make sure you are using at least version 25.2.3 of `rpk`.
140+
. If you see authentication errors, run `rpk cloud login` again.
141+
. Ensure you installed for the right client:
142+
+
143+
```bash
144+
rpk cloud mcp install --client claude
145+
# or
146+
rpk cloud mcp install --client claude-code
147+
```
148+
. If using another MCP client, verify your `mcpServers.redpandaCloud` entry (paths, JSON syntax, and args order).
149+
150+
. [[local]]Start the server manually using the xref:reference:rpk/rpk-cloud/rpk-cloud-mcp-stdio.adoc[`rpk cloud mcp stdio` command] (one-time login required) to verify connectivity to Redpanda Cloud endpoints:
151+
152+
+
153+
[source,bash]
154+
----
155+
rpk cloud login
156+
rpk cloud mcp stdio
157+
----
158+
+
159+
.. Send the following newline-delimited JSON-RPC messages (each on its own line):
160+
+
161+
[source,json]
162+
----
163+
{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2025-06-18","capabilities":{"roots":{},"sampling":{},"elicitation":{}},"clientInfo":{"name":"ManualTest","version":"0.1.0"}}}
164+
{"jsonrpc":"2.0","method":"notifications/initialized"}
165+
{"jsonrpc":"2.0","id":2,"method":"tools/list"}
166+
----
167+
+
168+
Expected response shapes (examples):
169+
+
170+
[source,json]
171+
----
172+
{"jsonrpc":"2.0","id":1,"result":{"capabilities":{...}}}
173+
{"jsonrpc":"2.0","id":2,"result":{"tools":[{"name":"...","description":"..."}, ...]}}
174+
----
175+
+
176+
.. Stop the server with `Ctrl+C`.
177+
178+
== Common issues
179+
180+
The server runs locally, but it must reach Redpanda Cloud endpoints to perform operations.
181+
182+
=== Client can't find the MCP server
183+
184+
* Re-run the install for your MCP client.
185+
* Confirm the path in `--config /path/to/rpk.yaml` exists and is readable.
186+
* Double-check your client's configuration format and syntax.
187+
188+
=== Unauthorized errors or token errors
189+
190+
Your capabilities depend on your Redpanda Cloud account permissions. If an operation fails with a permissions error, contact your account admin.
191+
192+
* Run `rpk cloud login` to refresh the token.
193+
* Ensure your account has the necessary permissions for the requested operation.
194+
195+
=== Deletes not working
196+
197+
* By default, delete operations are **disabled**. Add `--allow-delete` to the server invocation (auto or manual configuration) and restart the client.
198+
* For auto-configured clients, you may need to edit the generated config or re-run the install command and adjust the entry.
199+
200+
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
= Redpanda Cloud MCP Server
2+
:page-beta: true
3+
:description: Find links to information about the Redpanda Cloud MCP Server and its features for building and managing AI agents that can interact with your Redpanda Cloud account and clusters.
4+
:page-layout: index
5+
:page-aliases: develop:agents/about.adoc
Lines changed: 50 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,50 @@
1+
2+
= About the Redpanda Cloud MCP Server
3+
:page-beta: true
4+
:description: Learn about the Redpanda Cloud MCP Server, which lets AI assistants securely access and operate your Redpanda Cloud account and clusters.
5+
6+
The Redpanda Cloud MCP Server lets AI assistants securely access and operate your Redpanda Cloud account and clusters. MCP provides controlled access to:
7+
8+
* link:https://docs.redpanda.com/api/doc/cloud-controlplane/[Control Plane] actions, such as creating a Redpanda Cloud cluster or listing clusters.
9+
* link:https://docs.redpanda.com/api/doc/cloud-dataplane/[Data Plane] actions, such as creating topics or listing topics.
10+
11+
By speaking natural language to your assistant, you can ask it to perform Redpanda operations on your behalf. The MCP server runs locally on your machine and authenticates to Redpanda Cloud using a Redpanda Cloud token.
12+
13+
image::shared:cloud-mcp.gif[A terminal window showing Claude Code invoking Redpanda Cloud MCP to list topics in a cluster.]
14+
15+
== What you can do
16+
17+
You can do anything that's available in the Control Plane or Data Plane APIs. Typical requests you can make to your assistant once connected include:
18+
19+
* Create a Redpanda Cloud cluster named `dev-mcp`.
20+
* List topics in `dev-mcp`.
21+
* Create a topic `orders-raw` with 6 partitions.
22+
23+
NOTE: The MCP server does **not** expose delete endpoints by default. You can enable delete endpoints when you create the server if you intentionally want to allow delete operations.
24+
25+
== Use cases
26+
27+
* Test automation: Create short-lived clusters, create topics, and validate pipelines quickly.
28+
* Operational assistance: Inspect a cluster's health or list topics during incidents.
29+
* Onboarding and demos: Let team members issue high-level requests without memorizing every CLI flag.
30+
31+
== How it works
32+
33+
. Authenticate to Redpanda Cloud and receive a token using the xref:reference:rpk/rpk-cloud/rpk-cloud-login.adoc[`rpk cloud login` command].
34+
. Configure your MCP client using the xref:reference:rpk/rpk-cloud/rpk-cloud-mcp-install.adoc[`rpk cloud mcp install`] command. Your client then starts the server on-demand using xref:reference:rpk/rpk-cloud/rpk-cloud-mcp-stdio.adoc[`rpk cloud mcp stdio`], authenticating with the Redpanda Cloud token from `rpk cloud login`.
35+
. Prompt your assistant to perform Redpanda operations. The Redpanda Cloud MCP Server executes them in your Redpanda Cloud account using your Redpanda Cloud token.
36+
37+
=== Components
38+
39+
* AI client (Claude, Claude Code, or any other MCP client) that connects to the MCP server.
40+
* Redpanda CLI (`rpk`) for obtaining a token and starting the local MCP server.
41+
* Redpanda Cloud account that the local MCP server can connect to and issue API requests.
42+
43+
== Next steps
44+
45+
* xref:ai-agents:mcp/local/quickstart.adoc[]
46+
* xref:ai-agents:mcp/local/configuration.adoc[]
47+
48+
== Suggested reading
49+
50+
The Redpanda documentation site has a read-only MCP server that provides access to Redpanda docs and examples. This server has no access to your Redpanda Cloud account or clusters. See xref:home:ROOT:mcp-setup.adoc[].
Lines changed: 67 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,67 @@
1+
= Redpanda Cloud MCP Quickstart
2+
:page-beta: true
3+
:description: Connect your Claude AI assistant to your Redpanda Cloud account and clusters using the Redpanda Cloud MCP Server.
4+
5+
In this quickstart, you'll get your Claude AI assistant talking to Redpanda Cloud using the xref:ai-agents:mcp/local/overview.adoc[Redpanda Cloud MCP Server].
6+
7+
////
8+
To be used when Remote MCP is ready for public beta
9+
10+
If you're trying to deploy your own MCP server as a managed service inside your cluster, see xref:ai-agents:mcp/remote/quickstart.adoc[].
11+
////
12+
13+
== Prerequisites
14+
15+
* At least version 25.2.3 of xref:manage:rpk/rpk-install.adoc[`rpk` installed on your computer]
16+
* Access to a Redpanda Cloud account
17+
* link:https://support.anthropic.com/en/articles/10065433-installing-claude-desktop[Claude] or link:https://docs.anthropic.com/en/docs/claude-code/setup[Claude Code] installed
18+
+
19+
TIP: For other clients, see xref:ai-agents:mcp/local/configuration.adoc[].
20+
21+
== Set up the MCP server
22+
23+
. Verify your `rpk` version
24+
+
25+
```bash
26+
rpk version
27+
```
28+
+
29+
Ensure the version is at least 25.2.3.
30+
31+
. Log in to Redpanda Cloud
32+
+
33+
```bash
34+
rpk cloud login
35+
```
36+
+
37+
A browser window opens. Sign in to grant access. After you sign in, `rpk` stores a token locally. This token is not shared with your AI assistant. It is used by the MCP server to authenticate requests to your Redpanda Cloud account.
38+
39+
. Install the MCP integration. Choose one client:
40+
+
41+
```bash
42+
# Claude desktop
43+
rpk cloud mcp install --client claude
44+
45+
# Claude Code (IDE)
46+
rpk cloud mcp install --client claude-code
47+
```
48+
+
49+
This command configures the MCP server for your client. If you need to update the integration, re-run the install command for your client.
50+
51+
== Start prompting
52+
53+
Launch Claude or Claude Code and try one of these prompts:
54+
55+
* “Create a Redpanda Cloud cluster named `dev-mcp`.”
56+
* “List topics in `dev-mcp`.”
57+
* “Create a topic `orders-raw` with 6 partitions.”
58+
59+
:note-caption: Delete operations are opt-in
60+
61+
NOTE: The MCP server does *not* expose API endpoints that result in delete operations by default. Use `--allow-delete` only if you intentionally want to enable delete operations. See xref:ai-agents:mcp/local/configuration.adoc#enable_delete_operations[Enable delete operations].
62+
63+
:note-caption: Note
64+
65+
== Next steps
66+
67+
* xref:ai-agents:mcp/local/configuration.adoc[]

modules/develop/pages/agents/about.adoc

Lines changed: 0 additions & 7 deletions
This file was deleted.

0 commit comments

Comments
 (0)