Stream target language #202
Description
As stream processing engines differ and none of them seem to suit all of our needs, we need to define a target language. We can plug in backends (Flink, Storm, Samza etc.), as all of them are close to our needed set of features. However, this should be as lightweight as possible, as it is not the main concern of the current research.
Needed features:
- Building dataflow DAG of operators
- Separate event handlers for separate inputs of an operator
- Setting number of parallel operator instances
- Custom partitioning
- Custom configuration passing
- Managed operator state