Skip to content

aparo/kafka-integration-patterns

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This is a little demo project to show how a combination of a akka-streams, Reactive Kafka, Kafka and ElasticSearch can be used as the ingestion part of a fast data system.

#Setup Docker configuration: add in share:

/opt/data
/opt/dockerdata
<your source dir>

Download the geoname sample:

./fetch_geoname.sh

Setup Prometheus/Grafana and family:

cd docker/dockprom
docker-compose up -d

Setup ElasticSearch/Kibana/kafka:

cd docker/kafka_elk/
docker-compose up -d

Build the apps:

sbt
project csvToKafka
docker:publishLocal
project kafkaToES
docker:publishLocal

Add the new deployed apps:

docker-compose up -d

Enjoy: