Skip to content

Commit e62b1fe

Browse files
committed
Rewrite the Kafka Getting Started guide
1 parent 9766a6b commit e62b1fe

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

59 files changed

+1128
-1158
lines changed

pages/public_cloud/public_cloud_databases/kafka_02_getting_started/guide.de-de.md

Lines changed: 75 additions & 77 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
title: Kafka - Getting started
3-
excerpt: Find out how to set up and manage your Public Cloud Databases for Kafka
4-
updated: 2022-01-05
3+
excerpt: Find out how to set up and manage your Kafka service
4+
updated: 2025-08-04
55
---
66

77
## Objectives
@@ -12,7 +12,7 @@ Apache Kafka is an open-source and highly resilient event streaming platform bas
1212
- store streams of events;
1313
- process streams of events.
1414

15-
You can get more information on Kafka from the [official Kafka website](https://kafka.apache.org/intro){.external).
15+
You can get more information on Kafka from the [official Kafka website](https://kafka.apache.org/intro){.external}.
1616

1717
This guide explains how to successfully configure Public Cloud Databases for Kafka via the OVHcloud Control Panel.
1818

@@ -25,132 +25,137 @@ This guide explains how to successfully configure Public Cloud Databases for Kaf
2525

2626
### Subscribe to the service
2727

28-
Log in to your [OVHcloud Control Panel](/links/manager) and switch to `Public Cloud`{.action} in the top navigation bar. After selecting your Public Cloud project, click on `Databases`{.action} in the left-hand navigation bar under **Storage**.
28+
Log in to your [OVHcloud Control Panel](/links/manager) and switch to `Public Cloud`{.action} in the top navigation bar. After selecting your Public Cloud project, click on `Data Streaming`{.action} in the left-hand navigation bar under **Databases & Analytics**.
2929

30-
Click the `Create a database instance`{.action} button. (`Create a service`{.action} if your project already contains databases.)
30+
Click the `Create a service`{.action} button.
3131

32-
#### Step 1: Select your database type
32+
#### Select your analytics service
3333

34-
Click on the type of database you want to use and then select the version to install from the respective drop-down menu. Click `Next`{.action} to continue.
34+
Click on the type of analytics service you want to use and its version.
35+
A random name is generated for your service that can change in this step or later.
3536

36-
![Choose database](images/kafka_db_type.png){.thumbnail}
37+
![Choose data streaming service](images/kafka_db_type.v2.png){.thumbnail}
3738

38-
#### Step 2: Select a solution
39+
#### Select a datacentre
3940

40-
In this step, choose an appropriate service plan. If needed, you will be able to upgrade the plan after creation.
41+
Choose the geographical region of the datacentre where your service will be hosted and the deployment mode (1-AZ vs 3-AZ).
4142

42-
![Choose plan](images/kafka_solution_business.png){.thumbnail}
43+
![Choose a datacentre](images/kafka_region.v2.png){.thumbnail}
4344

44-
Please visit the [capabilities page](/products/public-cloud-databases) of your selected database type for detailed information on each plan's properties.
45+
#### Select a plan
4546

46-
Click `Next`{.action} to continue.
47+
In this step, choose an appropriate service plan. If needed, you will be able to upgrade or downgrade the plan after creation.
4748

48-
#### Step 3: Select a location
49+
![Choose plan](images/kafka_solution_business.v2.png){.thumbnail}
4950

50-
Choose the geographical region of the datacenter where your service will be hosted.
51+
Please visit the [capabilities page](/products/public-cloud-data-analytics) of your selected analytics service for detailed information on each plan's properties.
5152

52-
![Choose region](images/kafka_region.png){.thumbnail}
53+
#### Select the instance
5354

54-
Click `Next`{.action} to continue.
55+
Choose the instance type for the nodes of your service, you will be able to change it afterward. The number of nodes depends on the plan previously chosen.
5556

56-
#### Step 4: Size the database nodes
57+
![Choose instance](images/kafka_features.v2.png){.thumbnail}
5758

58-
You can increase the number of nodes and choose the node template in this step. The minimum and maximum amount of nodes depends on the solution chosen in step 2.
59+
#### Select the storage
5960

60-
![Order nodes](images/kafka_features.png){.thumbnail}
61+
Storage could be scaled up to 3 time the base storage.
6162

62-
Please visit the [capabilities page](/products/public-cloud-databases) of your selected database type for detailed information on hardware resources and other properties of the database installation.
63+
![Choose storage](images/kafka_storage.v2.png){.thumbnail}
6364

64-
Take note of the pricing information and click `Next`{.action} to continue.
65+
#### Configure your options
6566

66-
#### Step 5: Configure your options
67+
Choose the network options for your service and whitelist the IP addresses that will access the service.
6768

68-
You can name your database in this step and decide to attach a public or private network.
69-
Please note that attaching a private network is a feature not yet available at this time.
69+
![Configure options](images/kafka_options.v2.png){.thumbnail}
7070

71-
![Configure options](images/kafka_options.png){.thumbnail}
71+
#### Review and confirm
7272

73-
#### Step 6: Review and confirm
73+
A summary of your order is display to help you review your service configuration.
7474

75-
The final section will display a summary of your order as well as the API equivalent of creating this database instance with the [OVHcloud API](/pages/manage_and_operate/api/first-steps).
75+
![Review order](images/kafka_configuration.1.v2.png){.thumbnail}
7676

77-
![Confirm order](images/kafka_configuration.png){.thumbnail}
77+
The components of the price is also summarized with a monthly estimation.
7878

79-
In a matter of minutes, your new Apache Kafka service will be deployed. Messages in the OVHcloud Control Panel will inform you when the streaming tool is ready to use.
79+
![Review pricing](images/kafka_configuration.2.v2.png){.thumbnail}
80+
81+
Click the `API and Terraform equivalent`{.action} button to open the following window:
82+
83+
![API and Terraform equivalent](images/kafka_configuration.3.v2.png){.thumbnail}
84+
85+
The informations displayed in this window could help you automate your service creation with the [OVHcloud API](/pages/manage_and_operate/api/first-steps) or the OVHcloud Terraform Provider.
86+
87+
When you are ready click the `Order`{.action} button to create your service.
88+
In a matter of minutes, your new Apache Kafka service will be deployed.
89+
Messages in the OVHcloud Control Panel will inform you when the streaming tool is ready to use.
8090

8191
### Configure the Apache Kafka service
8292

83-
Once the Public Cloud Databases for Kafka service is up and running, you will have to define at least one user and one authorised IP in order to fully connect to the service (as producer or consumer).
93+
Once the Public Cloud Databases for Kafka service is up and running, you will have to define at least one user and one authorised IP (if not already provided during the order) in order to fully connect to the service (as producer or consumer).
8494

85-
![Users](images/kafka_concept.png){.thumbnail}
95+
![Kafka Concept](images/kafka_concept.png){.thumbnail}
8696

87-
The `General information`{.action} tab should inform you to create users and authorized IPs.
97+
The `Dashboard`{.action} tab automatically updates when your service is ready.
8898

89-
![Kafka General information](images/kafka_cluster_ready_to_configure.png){.thumbnail}
99+
![Kafka General information](images/kafka_cluster_ready_to_configure.v2.png){.thumbnail}
90100

91-
#### Step 1 (mandatory): Set up a user
101+
#### Mandatory: Set up a user
92102

93-
Switch to the `Users`{.action} tab. An admin user is preconfigured during the service installation. You can add more users by clicking the `Add user`{.action} button.
103+
Switch to the `Users`{.action} tab. An admin user name `avnadmin` is preconfigured during the service installation.
94104

95-
![Users](images/kafka_add_user.png){.thumbnail}
105+
![Users](images/kafka_users.v2.png){.thumbnail}
96106

97-
Enter a username, then click `Create User`{.action}.
107+
You can add more users by clicking the `Add user`{.action} button.
98108

99-
Once the user is created, the password is generated. Please keep it securely as it will not be shown again.
109+
![Add a user](images/kafka_add_user.v2.png){.thumbnail}
100110

101-
Passwords can be reset for the admin user or changed afterwards for other users in the `Users`{.action} tab.
111+
Enter a username, then click `Create User`{.action}.
112+
Passwords need to be reset from the `Users`{.action} tab.
102113

103-
![Password reset](images/kafka_user_password_reset1.png){.thumbnail}
114+
![Password reset](images/kafka_user_password_reset1.v2.png){.thumbnail}
104115

105-
#### Step 2 (mandatory): Configure authorised IPs
116+
#### Mandatory: Configure authorised IPs
106117

107118
> [!warning]
108119
> For security reasons the default network configuration doesn't allow any incoming connections. It is thus critical to authorize the suitable IP addresses in order to successfully access your Kafka cluster.
109120
110-
Switch to the `Authorized IPs`{.action} tab. At least one IP address must be authorised here before you can connect to your database.
111-
It can be your laptop IP for example.
112-
113-
![Authorised IP](images/kafka_authorized_ip.png){.thumbnail}
114-
115-
Clicking on `Add an IP address or IP address block (CIDR)`{.action} opens a new window in which you can add single IP addresses or blocks to allow access to the database.
121+
If you did not define the authorised IPs during the order you could do it in the `Authorized IPs`{.action} tab. At least one IP address must be authorised here before you can connect to your database.
116122

117-
![Add IP](images/kafka_add_ip.png){.thumbnail}
123+
![Authorised IP](images/kafka_authorized_ip.v2.png){.thumbnail}
118124

119-
You can edit and remove database access via the `...`{.action} button in the IP table.
125+
Add the IP address of your computer by using the `Current IP`{.action} button.
126+
You will be able to remove IPs from the table afterward.
120127

121-
If you don't know how to get your IP, please visit a website like [www.WhatismyIP.com](https://www.whatismyip.com/){.external}.
122-
Copy the IP address shown on this website and keep it for later.
128+
![Add IP](images/kafka_add_ip.v2.png){.thumbnail}
123129

124130
Your Apache Kafka service is now fully accessible!
125-
126131
Optionally, you can configure access control lists (ACL) for granular permissions and create something called topics, as shown below.
127132

128133
#### Optional: Create Kafka topics
129134

130135
Topics can be seen as categories, allowing you to organize your Kafka records. Producers write to topics, and consumers read from topics.
131136

132-
To create Kafka topics, click on the `Add a topic`{.action} button:
137+
To create Kafka topics, first go to the `Topics`{.action} tab then click on the `Add a topic`{.action} button:
133138

134-
![Add a topic](images/kafka_topics.png){.thumbnail}
139+
![Add a topic](images/kafka_topics.v2.png){.thumbnail}
135140

136141
In advanced configuration you can change the default value for the following parameters:
137142

138-
- Replication (3 brokers by default)
143+
- Minimum in-sync replica (2 by default)
139144
- Partitions (1 partition by default)
145+
- Replication (3 brokers by default)
140146
- Retention size in bytes (-1: no limitation by default)
141147
- Retention time in hours (-1: no limitation by default)
142-
- Minimum in-sync replica (2 by default)
143148
- Deletion policy
144149

145-
![Create a topic](images/kafka_create_topic.png){.thumbnail}
150+
![Create a topic](images/kafka_create_topic.v2.png){.thumbnail}
146151

147152
#### Optional: Configure ACLs on topics
148153

149-
Public Cloud Databases for Kafka supports access control lists (ACLs) to manage permissions on topics. This approach allows you to limit the operations that are available to specific connections and to restrict access to certain data sets, which improves the security of your data.
154+
Kafka supports access control lists (ACLs) to manage permissions on topics. This approach allows you to limit the operations that are available to specific connections and to restrict access to certain data sets, which improves the security of your data.
150155

151-
By default the admin user has access to all topics with admin privileges. You can define some additional ACLs for all users / topics, click on `Add a new entry`{.action} button:
156+
By default the admin user has access to all topics with admin privileges. You can define some additional ACLs for all users / topics, by clicking on the `Add an ACL`{.action} button from the `ACL`{.action} tab:
152157

153-
![Enable ACLs](images/kafka_acl.png){.thumbnail}
158+
![Enable ACLs](images/kafka_acl.v2.png){.thumbnail}
154159

155160
For a particular user, and one topic (or all with '*'), define the ACL with the following permissions:
156161

@@ -159,13 +164,13 @@ For a particular user, and one topic (or all with '*'), define the ACL with the
159164
- **write**: allow updating, adding, and deleting data from a topic
160165
- **readwrite**: full access to the topic
161166

162-
![Define ACLs](images/kafka_add_entry1.png){.thumbnail}
167+
![Define ACLs](images/kafka_add_entry1.v2.png){.thumbnail}
163168

164169
*Note*: Write permission allows the service user to create new indexes that match the pattern, but it does not allow deletion of those indexes.
165170

166171
When multiple rules match, they are applied in the order listed above. If no rules match, access is denied.
167172

168-
### First CLI connection to your Kafka service
173+
### First CLI connection
169174

170175
> [!warning]
171176
> Verify that the IP address visible from your browser application is part of the "Authorised IPs" defined for this Kafka service.
@@ -176,30 +181,23 @@ When multiple rules match, they are applied in the order listed above. If no rul
176181

177182
In order to connect to the Apache Kafka service, it is required to use server and user certificates.
178183

179-
##### **1 - Server certificate**
180-
181-
The server CA (*Certificate Authority*) certificate can be downloaded from the **General information** tab:
182-
183-
![Kafka server certificate](images/kafka_get_sercer_certificate.png){.thumbnail}
184-
185-
##### **2 - User certificate**
184+
##### Server certificate
186185

187-
The user certificate can be downloaded from the **Users** tab:
186+
The server CA (*Certificate Authority*) certificate can be downloaded from the `Dashboard`{.action} tab:
188187

189-
![User informations](images/kafka_user_access_key.png){.thumbnail}
190-
![User certificate](images/kafka_download_user_certificate.png){.thumbnail}
188+
![Kafka server certificate](images/kafka_get_server_certificate.v2.png){.thumbnail}
191189

192-
##### **3 - User access key**
190+
##### User certificate and access key
193191

194-
Also download the user access key.
192+
The user certificate and the user access key can be downloaded from the `Users`{.action} tab:
195193

196-
![User access key](images/kafka_dowload_access_key.png){.thumbnail}
194+
![User informations](images/kafka_user_certificate_and_access_key.v2.png){.thumbnail}
197195

198196
#### Install an Apache Kafka CLI
199197

200198
As part of the Apache Kafka official installation, you will get different scripts that will also allow you to connect to Kafka in a Java 8+ environment: [Apache Kafka Official Quickstart](https://kafka.apache.org/quickstart){.external}.
201199

202-
We propose to use a generic producer and consumer client instead: Kcat (formerly known as kafkacat). Kcat is more lightweight since it does not require a JVM.
200+
We propose to use a generic and more lightweight (does not require a JVM) producer and consumer client instead: `Kcat` (formerly known as `kafkacat`).
203201

204202
##### **Install Kcat**
205203

0 commit comments

Comments
 (0)