We should support the use case where there are special CI only DAGs (e.g. those that run large scale integration tests) or prod only DAGs (e.g. one to destroy / create the CI environmetn)
we can support this by having separate ci_running_dags.txt and prod_running_dags.txt