Skip to content

CallumWalterWhite/distrubuted-kafka-simulation

Repository files navigation

Kafka in python

Apache Kafka is a distributed publish-subscribe messaging system and a robust queue that can handle a high volume of data and enables you to pass messages from one end-point to another. Kafka is suitable for both offline and online message consumption. Kafka messages are persisted on the disk and replicated within the cluster to prevent data loss.

This repo demostrates the simulation of kafka built in python.

IDE Used -

Visual Studio Code

How to start -

Change your directory to the folders that include the start files.

Run "pip install -r .\requirements.txt"

Warden

To start the warden, run start_warden.py

Broker

To start a broker, run start_broker.py

Consumer

To start a consumer, run start_consumer.py

Publisher

To start a publisher, run start_publisher.py

Test app

To start the test app, run start_test_app.py

About

A Kafka simulation using Python with socketio

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages