8000 GitHub - masfworld/cdc_deltaLake: Docker compose and Google Colab demo to build a CDC with Delta Lake
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

masfworld/cdc_deltaLake

BranchesTags

Repository files navigation

PostgreSQL (Debezium) - Kafka - Spark Delta Lake

Description

This project is a demo for testing a CDC (Change Data Capture). All infrastructure is built using docker.

alt text

Features

  • PostgreSql as Legacy database
  • Debezium as Change Data Capture
  • Kafka to ingest data from Debezium
  • KSQLDB to transform Avro messages into JSON
  • Spark Delta Lake to manage events from legacy database

About

Docker compose and Google Colab demo to build a CDC with Delta Lake

Resources

Readme
Activity

Stars

15 stars

Watchers

1 watching

Forks

20 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages
0