Kafka-based Job Queue for Python
-
Updated
Feb 4, 2022 - Python
Kafka-based Job Queue for Python
Data Engineering Project with Hadoop HDFS and Kafka
The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.
Stream processing using kafka-python to track people (user input images of target) in the wild over multiple video streams.
Real Time Sources for Apache Kafka, Azure Event Hubs, and Fabric Event Streams
Distributed Streaming with Apache Kafka and Python OpenCV
A Saga Pattern implementation with Kafka, MongoDb and Python.
A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.
Video processing (webcam) in real time using Kafka and Spark.
An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka
Kafka PoC using FastAPI
Efficient Pandas and Ray Kafka Producer for python using actor model.
A structured streaming was applied to the robot data from ROS-Gazebo simulation environment using Apache Spark. Data is collected in Kafka, analyzed by Apache Spark and stored in Cassandra.
Implementation of an ETL process for real-time sentiment analysis of tweets with Docker, Apache Kafka, Spark Streaming, MongoDB and Delta Lake
Python script demonstrating spark streaming and Kafka implementation using an e-commerce website like product recommendation engine based on item-based collaborative filtering. 🐍. 💥
The Apache Kafka Connector connects to the IE Databus and Apache Kafka.
Generative AI & Recommendation Engine --- Firat University / Faculty of Technology / Software Engineering / Final Project
✔️ Twitter Realtime Processing about Covid-19 + Docker + Docker Compose + Apache Kafka + Elastic Stack (Elasticsearch + Kibana)
Automated performance benchmarking for Apache Kafka with comprehensive Excel reporting, 30+ charts, and optimization recommendations. Features 5 test scenarios, Docker Compose local dev, Ansible orchestration, and offline/air-gapped installation support.
Python Kafka Messaging
To associate your repository with the kafka-producer topic, visit your repo's landing page and select "manage topics."