Docker Kafka MirrorMaker

Docker container that runs Kafka's MirrorMaker.

Kafka Version: 0.10.1.0

Usage

The MirrorMaker documentation says:

Setting up a mirror is easy - simply start up the mirror-maker processes after bringing up the target cluster. At minimum, the mirror maker takes one or more consumer configurations, a producer configuration and either a whitelist or a blacklist. You need to point the consumer to the source cluster's ZooKeeper, and the producer to the mirror cluster's ZooKeeper (or use the broker.list parameter).

The container expects the following environment variables to be passed in:

• CONSUMER_ZK_CONNECT - Zookeeper connection string for source, including port and chroot.
• WHITE_LIST - (optional) White list of topics, if used, do not use black list
• CONSUMER_GROUP_ID - (optional) Defaults to 1
• STREAM_COUNT - (optional) Defaults to 1
• DOWNSTREAM_bootstrap - Brokers to receive mirrored messages
• CONSUMER_OFFSET_RESET - largest or smallest

Command

docker-comupse up -d

Building

docker build -t sheeley/docker-kafka-mirrormaker .

Limitations

• Currently only supports a single consumer
• Does not support message handlers
• Does not support rebalancers

MirrorMaker Documentation

https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27846330