|
| 1 | +--- |
| 2 | +title: Apache Kafka developer guide for Event Hubs |
| 3 | +description: This article provides links to articles that describe how to integrate your Kafka applications with Azure Event Hubs. |
| 4 | +services: event-hubs |
| 5 | +author: spelluru |
| 6 | +manager: |
| 7 | +ms.author: spelluru |
| 8 | +ms.date: 03/31/2020 |
| 9 | +ms.topic: article |
| 10 | +ms.service: event-hubs |
| 11 | +--- |
| 12 | + |
| 13 | +# Apache Kafka developer guide for Azure Event Hubs |
| 14 | +This article provides links to articles that describe how to integrate your Apache Kafka applications with Azure Event Hubs. |
| 15 | + |
| 16 | +## Overview |
| 17 | +Event Hubs provides a Kafka endpoint that can be used by your existing Kafka based applications as an alternative to running your own Kafka cluster. Event Hubs supports Apache Kafka protocol 1.0 and later, and works with your existing Kafka applications, including MirrorMaker. For more information, see [Event Hubs for Apache Kafka](event-hubs-for-kafka-ecosystem-overview.md) |
| 18 | + |
| 19 | +## Quickstarts |
| 20 | +You can find quickstarts in GitHub and in this content set that helps you quickly ramp up on Event Hubs for Kafka. |
| 21 | + |
| 22 | +### Quickstarts in GitHub |
| 23 | +See the following quickstarts in the **azure-event-hubs-for-kafka** repo: |
| 24 | + |
| 25 | +| Client language/framework | Description | |
| 26 | +| ------------------------- | ----------- | |
| 27 | +| [.NET](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/dotnet) | <p>This quickstart will show how to create and connect to an Event Hubs Kafka endpoint using an example producer and consumer written in C# using .NET Core 2.0.</p><p>This sample is based on [Confluent's Apache Kafka .NET client](https://github.com/confluentinc/confluent-kafka-dotnet), modified for use with Event Hubs for Kafka.</p> | |
| 28 | +| [Java](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/java) | This quickstart will show how to create and connect to an Event Hubs Kafka endpoint using an example producer and consumer written in Java. | |
| 29 | +| [Node.js](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/node) | <p>This quickstart will show how to create and connect to an Event Hubs Kafka endpoint using an example producer and consumer written in Node.</p><p>This sample uses the [node-rdkafka](https://github.com/Blizzard/node-rdkafka) library. </p>| |
| 30 | +| [Python](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/python) | <p>This quickstart will show how to create and connect to an Event Hubs Kafka endpoint using an example producer and consumer written in python.</p><p>This sample is based on [Confluent's Apache Kafka Python client](https://github.com/confluentinc/confluent-kafka-python), modified for use with Event Hubs for Kafka.</p>| |
| 31 | +| [Go](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/go) | <p>This quickstart will show how to create and connect to an Event Hubs Kafka endpoint using an example producer and consumer written in Go.</p><p>This sample is based on [Confluent's Apache Kafka Golang client](https://github.com/confluentinc/confluent-kafka-go), modified for use with Event Hubs for Kafka.</p>| |
| 32 | +| [Sarama kafka Go](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/go-sarama-client) | This quickstart will show how to create and connect to an Event Hubs Kafka endpoint using an example producer and consumer written in Go using the [Sarama Kafka client](https://github.com/Shopify/sarama) library. | |
| 33 | +| [Kafka](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/kafka-cli) | This quickstart will show how to create and connect to an Event Hubs Kafka endpoint using the CLI that comes bundled with the Apache Kafka distribution.| |
| 34 | +| [Kafkacat](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/kafkacat) | kafkacat is a non-JVM command-line consumer and producer based on librdkafka, popular due to its speed and small footprint. This quickstart contains a sample configuration and several simple sample kafkacat commands. | |
| 35 | + |
| 36 | +### Quickstarts in DOCS |
| 37 | +See the quickstart: [Data streaming with Event Hubs using the Kafka protocol](event-hubs-quickstart-kafka-enabled-event-hubs.md) in this content set, which provides step-by-step instructions on how to stream into Event Hubs. You learn how to use your producers and consumers to talk to Event Hubs with just a configuration change in your applications. |
| 38 | + |
| 39 | + |
| 40 | +## Tutorials |
| 41 | + |
| 42 | +### Tutorials in GitHub |
| 43 | +See the following tutorials on GitHub: |
| 44 | + |
| 45 | +| Tutorial | Description | |
| 46 | +| ------------------------- | ----------- | |
| 47 | +| [Akka](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/akka/java) | This tutorial shows how to connect Akka Streams to Kafka-enabled Event Hubs without changing your protocol clients or running your own clusters. There are two separate tutorials using **Java** and **Scala** programming languages. | |
| 48 | +| [Connect](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/connect) | This document will walk you through integrating Kafka Connect with Azure Event Hubs and deploying basic FileStreamSource and FileStreamSink connectors. While these connectors are not meant for production use, they demonstrate an end-to-end Kafka Connect Scenario where Azure Event Hubs masquerades as a Kafka broker.| |
| 49 | +| [Filebeat](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/filebeat) | This document will walk you through integrating Filebeat and Event Hubs via Filebeat's Kafka output. | |
| 50 | +| [Flink](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/flink) | This tutorial will show how to connect Apache Flink to Kafka-enabled Event Hubs without changing your protocol clients or running your own clusters. | |
| 51 | +| [FluentD](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/fluentd) | This document will walk you through integrating Fluentd and Event Hubs using the `out_kafka` output plugin for Fluentd. | |
| 52 | +| [Interop](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/interop) | This tutorial shows you how to exchange events between consumers and producers using different protocols. | |
| 53 | +| [Logstash](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/logstash) | This tutorial will walk you through integrating Logstash with Kafka-enabled Event Hubs using Logstash Kafka input/output plugins. | |
| 54 | +| [MirrorMaker](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/mirror-maker) | This tutorial shows how an event hub and Kafka MirrorMaker can integrate an existing Kafka pipeline into Azure by mirroring the Kafka input stream in the Event Hubs service. | |
| 55 | +| [NiFi](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/nifi) | This tutorial will show how to connect Apache NiFi to an Event Hubs namespace. | |
| 56 | +| [OAuth](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/oauth) | Quickstarts show you how to create and connect to an Event Hubs Kafka endpoint using an example producer and consumer written in Go and Java programming languages. | |
| 57 | +| [Confluent's Schema Registry](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/schema-registry) | This tutorial will walk you through integrating Schema Registry and Event Hubs for Kafka. | |
| 58 | +| [Spark](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/tutorials/spark) | This tutorial will show how to connect your Spark application to an event hub without changing your protocol clients or running your own Kafka clusters. | |
| 59 | + |
| 60 | +### Tutorials in DOCS |
| 61 | +Also, see the tutorial: [Process Apache Kafka for Event Hubs events using Stream analytics](event-hubs-kafka-stream-analytics.md) in this content set, which shows how to stream data into Event Hubs and process it with Azure Stream Analytics. |
| 62 | + |
| 63 | +## How-to guides |
| 64 | +See the following How-to guides in our documentation: |
| 65 | + |
| 66 | +| Article | Description | |
| 67 | +| ------- | ----------- | |
| 68 | +| [Mirror a Kafka broker in an event hub](event-hubs-kafka-mirror-maker-tutorial.md) | Shows how to mirror a Kafka broker in an event hub using Kafka MirrorMaker. | |
| 69 | +| [Connect Apache Spark to an event hub](event-hubs-kafka-spark-tutorial.md) | Walks you through connecting your Spark application to Event Hubs for real-time streaming. | |
| 70 | +| [Connect Apache Flink to an event hub](event-hubs-kafka-flink-tutorial.md) | Shows you how to connect Apache Flink to an event hub without changing your protocol clients or running your own clusters. | |
| 71 | +| [Integrate Apache Kafka Connect with a event hub (Preview)](event-hubs-kafka-connect-tutorial.md) | Walks you through integrating Kafka Connect with an event hub and deploying basic FileStreamSource and FileStreamSink connectors. | |
| 72 | +| [Connect Akka Streams to an event hub](event-hubs-kafka-akka-streams-tutorial.md) | Shows you how to connect Akka Streams to an event hub without changing your protocol clients or running your own clusters. | |
| 73 | +| [Use the Spring Boot Starter for Apache Kafka with Azure Event Hubs](/azure/java/spring-framework/configure-spring-cloud-stream-binder-java-app-kafka-azure-event-hub) | Demonstrates how to configure a Java-based Spring Cloud Stream Binder created with the Spring Boot Initializer to use Apache Kafka with Azure Event Hubs. | |
| 74 | + |
| 75 | +## Next steps |
| 76 | +Review samples in the GitHub repo [azure-event-hubs-for-kafka](https://github.com/Azure/azure-event-hubs-for-kafka) under quickstart and tutorials folders. |
| 77 | + |
0 commit comments