Skip to content

Latest commit

 

History

History

data-detective-airflow

Data Detective Airflow

Data Detective Airflow is a framework whose main idea is to add the concepts of work and result to Apache Airflow. It supports tasks testing over Apache Airflow. Data Detective Airflow allows developers to create workflows in the form of directed acyclic graphs (DAGs) of tasks. The easy-to-use Data Detective Airflow scheduler makes it possible to run tasks and save results into works. Work storage support for s3, ftp, local disk and database is also included.

More information about Data Detective Airflow

Installation

Install from PyPi

pip install data-detective-airflow

See example DAG-s in dags/dags folder.