Skip to content

Docker compose file to build Spark Cluster + Kafka Cluster. It has configuration for different databases

Notifications You must be signed in to change notification settings

rafael-ariascalles/kafka-spark-setup

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 

Repository files navigation

kafka-PySpark-setup

Docker compose files to build kafka stream pipeline with Spark Cluster.

  1. Build docker images
  2. Deploy kafka and Spark Cluster
  3. Configure connect to function with MSSQL or Mongo
  4. Develop and deploy with Jupyterlab

About

Docker compose file to build Spark Cluster + Kafka Cluster. It has configuration for different databases

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published