Skip to content
/ kafka_pysubg Public

A distributed subgroup discovery framework using Apache Kafka and Zookeeper. Implements the paraDis methodology with a master-worker architecture for scalable and efficient subgroup discovery using the pysubgroup\ library

License

MIT license
0 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

J-Chandra-py/kafka_pysubg

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
ParaDis_pysubg
ParaDis_pysubg
 
 
LICENSE
LICENSE
 
 
docker-compose.yaml
docker-compose.yaml
 
 
master.py
master.py
 
 
readme.md
readme.md
 
 
worker.py
worker.py
 
 

Repository files navigation

  1. Start Kafka and Zookeeper: Run the kafka cluster with only n brokers
docker-compose up
  1. Run the Master Node: Launch the master node script in one terminal:
python master.py
  1. Run Worker Nodes: Launch multiple instances of the worker node script: syntax: python worker.py worker_id server:port
syntax: python worker.py worker_id server:port
python worker.py worker1 9091
python worker.py worker2 9092
python worker.py worker3 9093

About

A distributed subgroup discovery framework using Apache Kafka and Zookeeper. Implements the paraDis methodology with a master-worker architecture for scalable and efficient subgroup discovery using the pysubgroup\ library

Topics

python data-mining parallel-computing distributed-computing apache-kafka zookeper subgroup-discovery pysubgroup

Resources

Readme

License

MIT license
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages