You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Starlight suite of extensions are a collection of Apache Pulsar protocol handlers that extend an existing Pulsar cluster. The goal of all the extensions are to create a native, seamless interaction with a Pulsar cluster using existing tooling and clients.
7
+
The Starlight suite of extensions is a collection of Apache Pulsar protocol handlers that extend an existing Pulsar cluster.
8
+
The goal of all the extensions is to create a native, seamless interaction with a Pulsar cluster using existing tooling and clients.
Copy file name to clipboardExpand all lines: modules/use-cases-architectures/pages/starlight/kafka/index.adoc
+23-17Lines changed: 23 additions & 17 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,15 +16,18 @@ image:s4k-architecture.png[Starlight for Kafka Architecture]
16
16
17
17
== Establishing the Kafka protocol handler
18
18
19
-
Before you can use a Kafka client can interact with your Pulsar cluster, you need the Starlight for Kafka protocol handler installed in the cluster. Installation looks a bit different depending on where your Pulsar cluster is running. Choose the option that best fits your needs.
19
+
Before a Kafka client can interact with your Pulsar cluster, you need the Starlight for Kafka protocol handler installed in the cluster.
20
+
Installation looks a bit different depending on where your Pulsar cluster is running.
21
+
Choose the option that best fits your needs.
20
22
21
23
[tabs]
22
24
====
23
25
Astra Streaming::
24
26
+
25
27
--
26
28
27
-
If you want a working Kafka extension as quickly as possible, this is your best bet. This is also a good option for those that already have a streaming tenant and are looking to extend it.
29
+
If you want a working Kafka extension as quickly as possible, this is your best bet.
30
+
This is also a good option for those that already have a streaming tenant and are looking to extend it.
28
31
29
32
. Sign in to your Astra account and navigate to your streaming tenant.
. Click the "Enable Kafka" button to confirm your understanding.
47
+
. Select the "Enable Kafka" button to confirm your understanding.
45
48
46
49
Your Astra Streaming tenant is ready for prime time! Continue to the next section of the guide to see it in action.
47
50
--
@@ -53,21 +56,24 @@ The Starlight for Kafka extension is included in the `luna-streaming-all` image
53
56
Self Managed::
54
57
+
55
58
--
56
-
Already got your own Pulsar Cluster? Or maybe your using a standalone cluster? Starlight for Kafka can easily be a part of that cluster! Follow the "xref:starlight-for-kafka:installation:starlight-kafka-quickstart.adoc[]" guide.
59
+
Already have your own Pulsar cluster? Or maybe you're using a standalone cluster? Starlight for Kafka can easily be a part of that cluster! Follow the "xref:starlight-for-kafka:installation:starlight-kafka-quickstart.adoc[]" guide.
57
60
--
58
61
====
59
62
60
63
== Messaging with Starlight for Kafka
61
64
62
-
Starlight for Kafka supports quite a few different use cases. With a Pulsar cluster between producers and consumers you can interchange the type of producer and consumer to fit your needs. *The below examples are using an Astra Streaming tenant as the Kafka bootstrap server.* If you are using Luna or self-managed, switch the bootstrap server URL for your own.
65
+
Starlight for Kafka supports quite a few different use cases. With a Pulsar cluster between producers and consumers you can interchange the type of producer and consumer to fit your needs.
66
+
67
+
*The below examples are using an Astra Streaming tenant as the Kafka bootstrap server.* If you are using Luna Streaming or a self-managed tenant, switch the bootstrap server URL for your own.
63
68
64
69
=== Retrieve Kafka connection properties in Astra Streaming
65
70
66
-
While on the "Connect" tab in the Astra Streaming portal, the "kafka" area will provide important connection information. You will need that to create a working Kafka client or using the CLI.
71
+
In the Astra Streaming portal "Connect" tab, the "kafka" area provides important connection information.
72
+
You will need this connection information to create a working Kafka client or use the CLI.
TIP: While reviewing the Kafka connection settings in the Astra portal, if you click the clipboard icon you will get those values as well as a working token to paste in code.
76
+
TIP: Click the clipboard icon to copy the Kafka connection values, as well as a working token to paste in code.
71
77
72
78
=== Produce and consume a message
73
79
@@ -76,7 +82,8 @@ TIP: While reviewing the Kafka connection settings in the Astra portal, if you c
76
82
Kafka CLI::
77
83
+
78
84
--
79
-
Download the latest Kafka dist https://www.apache.org/dyn/closer.cgi?path=/kafka/3.3.1/kafka_2.13-3.3.1.tgz[here^]{external-link-icon}. With the tar ball extracted, the producer and consumer cli's are in the 'bin' folder.
85
+
Download the latest Kafka distribution https://www.apache.org/dyn/closer.cgi?path=/kafka/3.3.1/kafka_2.13-3.3.1.tgz[here^]{external-link-icon}.
86
+
With the tarball extracted, the producer and consumer CLIs are in the 'bin' folder.
80
87
81
88
. To get started, let's set a few variables. If you've completed our "xref:astra-streaming:getting-started:index.adoc[Getting started with Astra Streaming]" guide, the below values will be a perfect fit for your existing tenant.
0 commit comments