You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/event-hubs/event-hubs-exchange-events-different-protocols.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -338,10 +338,10 @@ String myStringProperty = new String(rawbytes, StandardCharsets.UTF_8);
338
338
```
339
339
340
340
## Next steps
341
-
Inthisarticle, youlearnedhowtostreamintoKafka-enabledEventHubswithoutchangingyourprotocolclientsorrunningyourownclusters. TolearnmoreaboutEventHubsandEventHubsfor Kafka, see the following articles:
341
+
Inthisarticle, youlearnedhowtostreamintoEventHubswithoutchangingyourprotocolclientsorrunningyourownclusters. TolearnmoreaboutEventHubsandEventHubsfor Kafka, see the following articles:
342
342
343
343
* [Learn about Event Hubs](event-hubs-what-is-event-hubs.md)
*Use [MirrorMaker](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27846330) to [stream events from Kafka on premises to Kafka enabled Event Hubs on cloud.](event-hubs-kafka-mirror-maker-tutorial.md)
347
-
*LearnhowtostreamintoKafkaenabledEventHubsusing [nativeKafkaapplications](event-hubs-quickstart-kafka-enabled-event-hubs.md), [ApacheFlink](event-hubs-kafka-flink-tutorial.md), or [AkkaStreams](event-hubs-kafka-akka-streams-tutorial.md)
346
+
*Use [MirrorMaker](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27846330) to [stream events from Kafka on premises to Event Hubs on cloud.](event-hubs-kafka-mirror-maker-tutorial.md)
347
+
*LearnhowtostreamintoEventHubsusing [nativeKafkaapplications](event-hubs-quickstart-kafka-enabled-event-hubs.md), [ApacheFlink](event-hubs-kafka-flink-tutorial.md), or [AkkaStreams](event-hubs-kafka-akka-streams-tutorial.md)
Copy file name to clipboardExpand all lines: articles/event-hubs/event-hubs-faq.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -106,7 +106,7 @@ If you use the zone redundancy for your namespace, you need to do a few addition
106
106
Event Hubs provides a Kafka endpoint that can be used by your existing Apache Kafka based applications. A configuration change is all that is required to have the PaaS Kafka experience. It provides an alternative to running your own Kafka cluster. Event Hubs supports Apache Kafka 1.0 and newer client versions and works with your existing Kafka applications, tools, and frameworks. For more information, see [Event Hubs for Kafka repo](https://github.com/Azure/azure-event-hubs-for-kafka).
107
107
108
108
### What configuration changes need to be done for my existing application to talk to Event Hubs?
109
-
To connect to a Kafka-enabled Event Hub, you'll need to update the Kafka client configs. It's done by creating an Event Hubs namespace and obtaining the [connection string](event-hubs-get-connection-string.md). Change the bootstrap.servers to point the Event Hubs FQDN and the port to 9093. Update the sasl.jaas.config to direct the Kafka client to your Kafka-enabled Event Hubs endpoint (which is the connection string you've obtained), with correct authentication as shown below:
109
+
To connect to an event hub, you'll need to update the Kafka client configs. It's done by creating an Event Hubs namespace and obtaining the [connection string](event-hubs-get-connection-string.md). Change the bootstrap.servers to point the Event Hubs FQDN and the port to 9093. Update the sasl.jaas.config to direct the Kafka client to your Event Hubs endpoint (which is the connection string you've obtained), with correct authentication as shown below:
Note: If sasl.jaas.config isn't a supported configuration in your framework, find the configurations that are used to set the SASL username and password and use those instead. Set the username to $ConnectionString and the password to your Event Hubs connection string.
126
126
127
-
### What is the message/event size for Kafka-enabled Event Hubs?
128
-
The maximum message size allowed for Kafka-enabled Event Hubs is 1 MB.
127
+
### What is the message/event size for Event Hubs?
128
+
The maximum message size allowed for Event Hubs is 1 MB.
For a **tutorial** with step-by-step instructions to create a Kafka enabled event hub and access it using SAS or OAuth, see [Quickstart: Data streaming with Event Hubs using the Kafka protocol](event-hubs-quickstart-kafka-enabled-event-hubs.md).
71
+
For a **tutorial** with step-by-step instructions to create an event hub and access it using SAS or OAuth, see [Quickstart: Data streaming with Event Hubs using the Kafka protocol](event-hubs-quickstart-kafka-enabled-event-hubs.md).
72
72
73
73
For more **samples** that show how to use OAuth with Event Hubs for Kafka, see [samples on GitHub](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/oauth).
74
74
@@ -93,13 +93,13 @@ Here is the list of Kafka features that are not yet supported:
93
93
94
94
This article provided an introduction to Event Hubs for Kafka. To learn more, see the following links:
95
95
96
-
-[How to create Kafka enabled Event Hubs](event-hubs-create-kafka-enabled.md)
96
+
-[How to create an event hub](event-hubs-create.md)
97
97
-[Stream into Event Hubs from your Kafka applications](event-hubs-quickstart-kafka-enabled-event-hubs.md)
98
-
-[Mirror a Kafka broker in a Kafka-enabled event hub](event-hubs-kafka-mirror-maker-tutorial.md)
99
-
-[Connect Apache Spark to a Kafka-enabled event hub](event-hubs-kafka-spark-tutorial.md)
100
-
-[Connect Apache Flink to a Kafka-enabled event hub](event-hubs-kafka-flink-tutorial.md)
101
-
-[Integrate Kafka Connect with a Kafka-enabled event hub](event-hubs-kafka-connect-tutorial.md)
102
-
-[Connect Akka Streams to a Kafka-enabled event hub](event-hubs-kafka-akka-streams-tutorial.md)
98
+
-[Mirror a Kafka broker in an event hub](event-hubs-kafka-mirror-maker-tutorial.md)
99
+
-[Connect Apache Spark to an event hub](event-hubs-kafka-spark-tutorial.md)
100
+
-[Connect Apache Flink to an event hub](event-hubs-kafka-flink-tutorial.md)
101
+
-[Integrate Kafka Connect with an event hub](event-hubs-kafka-connect-tutorial.md)
102
+
-[Connect Akka Streams to an event hub](event-hubs-kafka-akka-streams-tutorial.md)
103
103
-[Explore samples on our GitHub](https://github.com/Azure/azure-event-hubs-for-kafka)
Copy file name to clipboardExpand all lines: articles/event-hubs/event-hubs-kafka-akka-streams-tutorial.md
+12-12Lines changed: 12 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,7 +18,7 @@ ms.author: shvija
18
18
---
19
19
20
20
# Using Akka Streams with Event Hubs for Apache Kafka
21
-
This tutorial shows you how to connect Akka Streams to Kafka-enabled event hubs without changing your protocol clients or running your own clusters. Azure Event Hubs for the Kafka supports [Apache Kafka version 1.0.](https://kafka.apache.org/10/documentation.html)
21
+
This tutorial shows you how to connect Akka Streams to an event hub without changing your protocol clients or running your own clusters. Azure Event Hubs for the Kafka supports [Apache Kafka version 1.0.](https://kafka.apache.org/10/documentation.html)
22
22
23
23
In this tutorial, you learn how to:
24
24
> [!div class="checklist"]
@@ -46,11 +46,11 @@ To complete this tutorial, make sure you have the following prerequisites:
46
46
47
47
## Create an Event Hubs namespace
48
48
49
-
An Event Hubs namespace is required to send or receive from any Event Hubs service. See [Create Kafka Enabled Event Hubs](event-hubs-create-kafka-enabled.md) for information about getting an Event Hubs Kafka endpoint. Make sure to copy the Event Hubs connection string for later use.
49
+
An Event Hubs namespace is required to send or receive from any Event Hubs service. See [Create Kafka Enabled Event Hubs](event-hubs-create.md) for information about getting an Event Hubs Kafka endpoint. Make sure to copy the Event Hubs connection string for later use.
50
50
51
51
## Clone the example project
52
52
53
-
Now that you have a Kafka-enabled Event Hubs connection string, clone the Azure Event Hubs for Kafka repository and navigate to the `akka` subfolder:
53
+
Now that you have a Event Hubs connection string, clone the Azure Event Hubs for Kafka repository and navigate to the `akka` subfolder:
The producer begins sending events to the Kafka-enabled event hub at topic `test`, and prints the events to stdout.
95
+
The producer begins sending events to the event hub at topic `test`, and prints the events to stdout.
96
96
97
97
## Run Akka Streams consumer
98
98
99
-
Using the provided consumer example, receive messages from the Kafka-enabled event hubs.
99
+
Using the provided consumer example, receive messages from the event hub.
100
100
101
101
### Provide an Event Hubs Kafka endpoint
102
102
@@ -132,12 +132,12 @@ mvn clean package
132
132
mvn exec:java -Dexec.mainClass="AkkaTestConsumer"
133
133
```
134
134
135
-
If the Kafka-enabled event hub has events (for instance, if your producer is also running), then the consumer begins receiving events from topic `test`.
135
+
If the event hub has events (for instance, if your producer is also running), then the consumer begins receiving events from topic `test`.
136
136
137
137
Check out the [Akka Streams Kafka Guide](https://doc.akka.io/docs/akka-stream-kafka/current/home.html) for more detailed information about Akka Streams.
138
138
139
139
## Next steps
140
-
In this tutorial, you learned how to connect Akka Streams to Kafka-enabled event hubs without changing your protocol clients or running your own clusters. Azure Event Hubs for the Kafka supports [Apache Kafka version 1.0.](https://kafka.apache.org/10/documentation.html). You did the following actions as part of this tutorial:
140
+
In this tutorial, you learned how to connect Akka Streams to the event hub without changing your protocol clients or running your own clusters. Azure Event Hubs for the Kafka supports [Apache Kafka version 1.0.](https://kafka.apache.org/10/documentation.html). You did the following actions as part of this tutorial:
141
141
142
142
> [!div class="checklist"]
143
143
> * Create an Event Hubs namespace
@@ -149,10 +149,10 @@ To learn more about Event Hubs and Event Hubs for Kafka, see the following topic
149
149
150
150
-[Learn about Event Hubs](event-hubs-what-is-event-hubs.md)
151
151
-[Event Hubs for Apache Kafka](event-hubs-for-kafka-ecosystem-overview.md)
152
-
-[How to create Kafka enabled Event Hubs](event-hubs-create-kafka-enabled.md)
152
+
-[How to create an event hub](event-hubs-create.md)
153
153
-[Stream into Event Hubs from your Kafka applications](event-hubs-quickstart-kafka-enabled-event-hubs.md)
154
-
-[Mirror a Kafka broker in a Kafka-enabled event hub](event-hubs-kafka-mirror-maker-tutorial.md)
155
-
-[Connect Apache Spark to a Kafka-enabled event hub](event-hubs-kafka-spark-tutorial.md)
156
-
-[Connect Apache Flink to a Kafka-enabled event hub](event-hubs-kafka-flink-tutorial.md)
157
-
-[Integrate Kafka Connect with a Kafka-enabled event hub](event-hubs-kafka-connect-tutorial.md)
154
+
-[Mirror a Kafka broker in an event hub](event-hubs-kafka-mirror-maker-tutorial.md)
155
+
-[Connect Apache Spark to an event hub](event-hubs-kafka-spark-tutorial.md)
156
+
-[Connect Apache Flink to an event hub](event-hubs-kafka-flink-tutorial.md)
157
+
-[Integrate Kafka Connect with an event hub](event-hubs-kafka-connect-tutorial.md)
158
158
-[Explore samples on our GitHub](https://github.com/Azure/azure-event-hubs-for-kafka)
Copy file name to clipboardExpand all lines: articles/event-hubs/event-hubs-kafka-connect-tutorial.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,9 +14,9 @@ ms.author: shvija
14
14
---
15
15
16
16
# Integrate Apache Kafka Connect support on Azure Event Hubs (Preview)
17
-
As ingestion for business needs increases, so does the requirement to ingest for various external sources and sinks. [Apache Kafka Connect](https://kafka.apache.org/documentation/#connect) provides such framework to connect and import/export data from/to any external system such as MySQL, HDFS, and file system through a Kafka cluster. This tutorial walks you through using Kafka Connect framework with Kafka-enabled Event Hubs.
17
+
As ingestion for business needs increases, so does the requirement to ingest for various external sources and sinks. [Apache Kafka Connect](https://kafka.apache.org/documentation/#connect) provides such framework to connect and import/export data from/to any external system such as MySQL, HDFS, and file system through a Kafka cluster. This tutorial walks you through using Kafka Connect framework with Event Hubs.
18
18
19
-
This tutorial walks you through integrating Kafka Connect with a Kafka-enabled Azure event hub and deploying basic FileStreamSource and FileStreamSink connectors. This feature is currently in preview. While these connectors are not meant for production use, they demonstrate an end-to-end Kafka Connect scenario where Azure Event Hubs acts as a Kafka broker.
19
+
This tutorial walks you through integrating Kafka Connect with an event hub and deploying basic FileStreamSource and FileStreamSink connectors. This feature is currently in preview. While these connectors are not meant for production use, they demonstrate an end-to-end Kafka Connect scenario where Azure Event Hubs acts as a Kafka broker.
20
20
21
21
> [!NOTE]
22
22
> This sample is available on [GitHub](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/connect).
@@ -159,10 +159,10 @@ To learn more about Event Hubs and Event Hubs for Kafka, see the following topic
159
159
160
160
- [Learn about Event Hubs](event-hubs-what-is-event-hubs.md)
161
161
- [Event Hubs for Apache Kafka](event-hubs-for-kafka-ecosystem-overview.md)
162
-
- [How to create Kafka enabled Event Hubs](event-hubs-create-kafka-enabled.md)
162
+
- [How to create an event hub](event-hubs-create.md)
163
163
- [Stream into Event Hubs from your Kafka applications](event-hubs-quickstart-kafka-enabled-event-hubs.md)
164
-
- [Mirror a Kafka broker ina Kafka-enabled event hub](event-hubs-kafka-mirror-maker-tutorial.md)
165
-
- [Connect Apache Spark to a Kafka-enabled event hub](event-hubs-kafka-spark-tutorial.md)
166
-
- [Connect Apache Flink to a Kafka-enabled event hub](event-hubs-kafka-flink-tutorial.md)
167
-
- [Connect Akka Streams to a Kafka-enabled event hub](event-hubs-kafka-akka-streams-tutorial.md)
164
+
- [Mirror a Kafka broker inan event hub](event-hubs-kafka-mirror-maker-tutorial.md)
165
+
- [Connect Apache Spark to an event hub](event-hubs-kafka-spark-tutorial.md)
166
+
- [Connect Apache Flink to an event hub](event-hubs-kafka-flink-tutorial.md)
167
+
- [Connect Akka Streams to an event hub](event-hubs-kafka-akka-streams-tutorial.md)
168
168
- [Explore samples on our GitHub](https://github.com/Azure/azure-event-hubs-for-kafka)
Copy file name to clipboardExpand all lines: articles/event-hubs/event-hubs-kafka-flink-tutorial.md
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,9 +15,9 @@ ms.author: shvija
15
15
---
16
16
17
17
# Use Apache Flink with Azure Event Hubs for Apache Kafka
18
-
This tutorial shows you how to connect Apache Flink to Kafka-enabled event hubs without changing your protocol clients or running your own clusters. Azure Event Hubs supports [Apache Kafka version 1.0.](https://kafka.apache.org/10/documentation.html).
18
+
This tutorial shows you how to connect Apache Flink to an event hub without changing your protocol clients or running your own clusters. Azure Event Hubs supports [Apache Kafka version 1.0.](https://kafka.apache.org/10/documentation.html).
19
19
20
-
One of the key benefits of using Apache Kafka is the ecosystem of frameworks it can connect to. Kafka enabled Event Hubs combines the flexibility of Kafka with the scalability, consistency, and support of the Azure ecosystem.
20
+
One of the key benefits of using Apache Kafka is the ecosystem of frameworks it can connect to. Event Hubs combines the flexibility of Kafka with the scalability, consistency, and support of the Azure ecosystem.
21
21
22
22
In this tutorial, you learn how to:
23
23
> [!div class="checklist"]
@@ -45,11 +45,11 @@ To complete this tutorial, make sure you have the following prerequisites:
45
45
46
46
## Create an Event Hubs namespace
47
47
48
-
An Event Hubs namespace is required to send or receive from any Event Hubs service. See [Create Kafka Enabled Event Hubs](event-hubs-create-kafka-enabled.md) for information about getting an Event Hubs Kafka endpoint. Make sure to copy the Event Hubs connection string for later use.
48
+
An Event Hubs namespace is required to send or receive from any Event Hubs service. See [Create Kafka Enabled Event Hubs](event-hubs-create.md) for information about getting an Event Hubs Kafka endpoint. Make sure to copy the Event Hubs connection string for later use.
49
49
50
50
## Clone the example project
51
51
52
-
Now that you have a Kafka-enabled Event Hubs connection string, clone the Azure Event Hubs for Kafka repository and navigate to the `flink` subfolder:
52
+
Now that you have tne Event Hubs connection string, clone the Azure Event Hubs for Kafka repository and navigate to the `flink` subfolder:
If the Kafka-enabled event hub has events (for example, if your producer is also running), then the consumer now begins receiving events from the topic `test`.
119
+
If the event hub has events (for example, if your producer is also running), then the consumer now begins receiving events from the topic `test`.
120
120
121
121
Check out [Flink's Kafka Connector Guide](https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/kafka.html) for more detailed information about connecting Flink to Kafka.
122
122
123
123
## Next steps
124
-
In this tutorial, your learned how to connect Apache Flink to Kafka-enabled event hubs without changing your protocol clients or running your own clusters. You performed the following steps as part of this tutorial:
124
+
In this tutorial, your learned how to connect Apache Flink to Event Hubs without changing your protocol clients or running your own clusters. You performed the following steps as part of this tutorial:
125
125
126
126
> [!div class="checklist"]
127
127
> * Create an Event Hubs namespace
@@ -133,10 +133,10 @@ To learn more about Event Hubs and Event Hubs for Kafka, see the following topic
133
133
134
134
-[Learn about Event Hubs](event-hubs-what-is-event-hubs.md)
135
135
-[Event Hubs for Apache Kafka](event-hubs-for-kafka-ecosystem-overview.md)
136
-
-[How to create Kafka enabled Event Hubs](event-hubs-create-kafka-enabled.md)
136
+
-[How to create Kafka enabled Event Hubs](event-hubs-create.md)
137
137
-[Stream into Event Hubs from your Kafka applications](event-hubs-quickstart-kafka-enabled-event-hubs.md)
138
-
-[Mirror a Kafka broker in a Kafka-enabled event hub](event-hubs-kafka-mirror-maker-tutorial.md)
139
-
-[Connect Apache Spark to a Kafka-enabled event hub](event-hubs-kafka-spark-tutorial.md)
140
-
-[Integrate Kafka Connect with a Kafka-enabled event hub](event-hubs-kafka-connect-tutorial.md)
141
-
-[Connect Akka Streams to a Kafka-enabled event hub](event-hubs-kafka-akka-streams-tutorial.md)
138
+
-[Mirror a Kafka broker in an event hub](event-hubs-kafka-mirror-maker-tutorial.md)
139
+
-[Connect Apache Spark to an event hub](event-hubs-kafka-spark-tutorial.md)
140
+
-[Integrate Kafka Connect with an event hub](event-hubs-kafka-connect-tutorial.md)
141
+
-[Connect Akka Streams to an event hub](event-hubs-kafka-akka-streams-tutorial.md)
142
142
-[Explore samples on our GitHub](https://github.com/Azure/azure-event-hubs-for-kafka)
0 commit comments