Pinned Loading

1. kstream-analytics-pipeline-elasticsearch kstream-analytics-pipeline-elasticsearch Public

   This project implements a real-time analytics pipeline that processes and enriches sales events using Kafka Streams. Incoming transaction data is streamed, transformed, and routed to multiple syste…

   Java

2. flinkCDC-streaming-ELT-MySQL-Kafka flinkCDC-streaming-ELT-MySQL-Kafka Public

   This project demonstrates how to build a real-time streaming ELT pipeline that captures MySQL binlog events and streams them into Apache Kafka using Flink CDC.

   Makefile

3. flinkcdc-elasticsearch-streaming-etl flinkcdc-elasticsearch-streaming-etl Public

   This project demonstrates a real-time streaming ETL architecture that captures database changes from MySQL and PostgreSQL using CDC connectors, enriches the streams with Apache Flink SQL, and index…

   Dockerfile

4. kstream-cassandra-pipeline kstream-cassandra-pipeline Public

   A real-time streaming pipeline that processes transaction events using Kafka Streams, aggregates data in 1-minute tumbling windows, and persists results into Apache Cassandra via Kafka Connect. Thi…

   Java

5. change-data-capture-mysql-postgres change-data-capture-mysql-postgres Public

   This project demonstrates a real-time Change Data Capture pipeline. It captures data changes (Inserts, Updates, Deletes) from a MySQL source and streams them into PostgreSQL using Apache Kafka, Deb…

   Python

6. spotify-data-pipeline spotify-data-pipeline Public

   This project is a python-based data pipeline that integrates with the spotify web API to extract and analyze artist-related data. It provides functionality to search for artists by name, retrieve t…

   Python