8000 GitHub - andrewrjones/kafka-beam-example
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
This repository was archived by the owner on Sep 8, 2020. It is now read-only.

andrewrjones/kafka-beam-example

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Investigating using Apache Beam with Apache Kafka

  • Start Kafka and Zookeeper
    • make up
  • Create the Kafka topic
    • make topic
  • Ensure it has been created
    • make describe
  • Use Beam to write to topic
    • make producer
  • Check messages in topic
    • make offset
  • Dump messages from topic
    • make dump
  • Consume messages and run wordcount with Beam
    • make consumer
  • Check output
    • cat wordcount*
  • Stop Kafka and Zookeeper
    • make down
  • Clean up
    • make clean

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published
0