Data as a Service (DaaS) is an architecture pattern that leverages microservice, message broker, and database components to replace the traditional ETL process (batched provisioning for predefined DDLs) with an event driven plugin model to provides horizontal scaling, "real-time" reporting, and MVP deliverables.
[Overview Presentation](doc/Data as a Service.pptx)
[Example Presentation](doc/Data as a Service - Example.pptx)
- Adding a Component
- Creating a Subjob
- Creating a Sourcing REST Service
- Creating a Provisioning Service
- Creating a Consuming REST Service
- Download and Install Talend Studio for ESB
- Add the Talend Big Data Components plugin directory (e.g.: org.talend.designer.components.bigdata_6.1.2.20160912_1228) to your installed Talend Studio for ESB. This can be found from the Talend Big Data Product and should be placed in {TALEND_HOME}/Studio/plugins directory
- Download and import the DAAS_EXAMPLE project
- Update your properties files accordingly (CouchDB and Kafka settings) located in the Talend Project workspace (e.g.: {TALEND_HOME}/Studio/workspace/DAAS_EXAMPLE)
- sourcing.properties
- provisioning.properties
- consuming.properties