Skip to content

Spark 2.3. End to End Avro Continous Structured Streaming Kafka demo using Twitter´s bijection in Java.

License

Notifications You must be signed in to change notification settings

Neuw84/spark-continuous-streaming

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Continous Structured Streaming Avro demo

Spark 2.3. End to End Avro Continous Structured Streaming Kafka demo using Twitter´s bijection in Java.

Requirements

  • Kafka: 1.0.0
  • Java 8
  • Maven

Architecture

Architecture

Usage

Configure kafka hosts and execute both the ProducerConsumerDemo and the StructuredDemo classes.

Latency measures can be seen on ProducerConsumerDemo's output.

About

Spark 2.3. End to End Avro Continous Structured Streaming Kafka demo using Twitter´s bijection in Java.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages