Kafka

This is all about learning Kafka using practical examples. I used Kafka 4.0.0 installed view HomeBrew.

This project is based on Learn Apache Kafka for Beginners v3 by Stephane Maarek

This project reads the wikimedia stream "https://stream.wikimedia.org/v2/stream/recentchange" (Producer) and sends it to OpenSearch https://app.bonsai.io/ (Consumer).

Setup

OpenSearch

Set OpenSearch Url to kafka-consumer-opensearch/.env.

OPEN_SEARCH_URL=...

Links

• GitHub: kafka-beginners-course
• How To Set Up a Multi-Node Kafka Cluster using KRaft
• How to (actually) Configure a Kafka Cluster in KRaft Mode For Testing & Development