Alpine Linux based Kafka Docker Image
REPOSITORY TAG SIZE
blacktop/kafka latest 241.2 MB
blacktop/kafka 0.10 247.4 MB
blacktop/kafka 0.9 241.2 MB
blacktop/kafka 0.8 230.1 MBNOTE: I am assuming use of docker-machine with these examples. (
KAFKA_ADVERTISED_HOST_NAME=192.168.99.100)
docker run -d \
-p 9092:9092 \
-e KAFKA_ADVERTISED_HOST_NAME=192.168.99.100 \
-e KAFKA_CREATE_TOPICS="test-topic:1:1" \
blacktop/kafka
This will create a single-node kafka broker (listening on 192.168.99.100:9092), a local zookeeper instance and create the topic test-topic with 1 replication-factor and 1 partition.
You can now test your new single-node kafka broker using the binaries in the test folder in this repo.
$ wget https://github.com/blacktop/docker-kafka-alpine/raw/master/test/darwin/kafka-test
$ chmod +x kafka-test
$ ./kafka-test `docker-machine ip`Container: /small_leavitt
Ports: [{0.0.0.0 9092 9092 tcp} {0.0.0.0 2181 2181 tcp}]
Kafka Hosts: [192.168.99.100:9092]
Subscribed to topic: test-topic
Type something and hit [enter]...
1
2016/08/05 13:02:14 message 0: 1
2
2016/08/05 13:02:15 message 1: 2
3
42016/08/05 13:02:15 message 2: 3$ docker run -d -p 2181:2181 blacktop/kafka zookeeper-server-start.sh config/zookeeper.properties# Start zookeeper
$ docker run -d \
-p 2181:2181 \
--name zookeeper \
blacktop/kafka zookeeper-server-start.sh config/zookeeper.properties
# Start 3 kafka nodes
$ docker run -d \
-v /var/run/docker.sock:/var/run/docker.sock \
-e KAFKA_ADVERTISED_HOST_NAME=192.168.99.100 \
--link zookeeper \
-p 9092:9092 \
--name kafka-1 \
blacktop/kafka
$ docker run -d \
-v /var/run/docker.sock:/var/run/docker.sock \
-e KAFKA_ADVERTISED_HOST_NAME=192.168.99.100 \
--link zookeeper \
-p 9093:9092 \
--name kafka-2 \
blacktop/kafka
$ docker run -d \
-v /var/run/docker.sock:/var/run/docker.sock \
-e KAFKA_ADVERTISED_HOST_NAME=192.168.99.100 \
--link zookeeper \
-p 9094:9092 \
--name kafka-3 \
blacktop/kafka
# Create test-topic (replicated across kafka nodes)
$ docker run --rm \
--link zookeeper \
blacktop/kafka kafka-topics.sh --create --zookeeper zookeeper:2181 --replication-factor 3 --partition 1 --topic test-topic Or you can use docker-compose to make a single node cluster:
$ curl -sL https://raw.githubusercontent.com/blacktop/docker-kafka-alpine/master/docker-compose.yml > docker-compose.yml
# Change KAFKA_ADVERTISED_HOST_NAME in docker-compose.yml to `docker-machine ip` or IP of your VM.
# OR supply a HOSTNAME_COMMAND function.
$ docker-compose up -d
$ docker-compose scale kafka=3
# Create test-topic (replicated across kafka nodes)
$ docker run --rm \
--link zookeeper \
blacktop/kafka kafka-topics.sh --create --zookeeper zookeeper:2181 --replication-factor 3 --partition 1 --topic test-topic Linux
$ ifconfig docker0 | grep 'inet addr:' | cut -d: -f2 | awk '{ print $1}'Docker Machine
$ docker-machine ip <machine_name>Docker for Mac
# It defaults to `localhost`For some reason I can't get the docker-compose example to work with Docker for Mac. It does, however, work great with docker-machine on OSX.
Find a bug? Want more features? Find something missing in the documentation? Let me know! Please don't hesitate to file an issue
Heavily (if not entirely) influenced by https://github.com/wurstmeister/kafka-docker
- Add ability to run a single node kafka broker when you don't supply a zookeeper link.
See CHANGELOG.md
See all contributors on GitHub.
Please update the CHANGELOG.md and submit a Pull Request on GitHub.
MIT Copyright (c) 2016 blacktop