C# and F# language binding and extensions to Apache Spark
A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.
Build a Kafka streaming app using IBM Streams
Stream real time Tweets of current affairs like covid-19 using Kafka 2.0.0 high throughput producer & consumer into Elasticsearch using safe, idempotent and compression configurations. Aggregate the data and use it for further analytics.
This project implements an end-to-end pipeline for batch to stream processing using Kafka on Docker images. Besides that, there are exercises for a full course in Kafka.
A pipeline that consumes twitter data to extract meaningful insights about a variety of topics using the following technologies: twitter API, Kafka, MongoDB, and Tableau.
Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features, store them in MongoDB, and process the data with Apache Spark. A web interface is also included.
Data streaming project with Apache Druid & Grafana: Real-time data processing, alerts, integration with AWS. It uses a combination of technologies and services, including Confluent-Kafka, Apache Druid, AWS SNS, EC2, Athena, S3, Glue and EventBridge, StepFunctions. Contribute to this powerful solution!
Kafka streaming performance tests.
The purpose of this project is to learn, develop and explore microservices using spring boot, spring cloud, event streaming
Base project for kafka-streams development and testing
The objectives of this project are to get experience of coding with: Spark, Spark SQL, Spark Streaming, Kafka, Scala and functional programming
This repository contains the code to read the streaming kafka data and perform various streaming operations
Tests with Spark local, kafka streaming and socket streaming
Using kafka streaming to implement the streaming ETL job, append data onto GCP Big Query after formatting.
An interactive dashboard simulating live sales and warehouse data for the company.
Add a description, image, and links to the kafka-streaming topic page so that developers can more easily learn about it.
To associate your repository with the kafka-streaming topic, visit your repo's landing page and select "manage topics."