Description

It would be cool if we could have a test that actually runs a provider ingestion DAG from start to finish. The provider script itself could be completely mocked out, but all of the downstream ingestion tasks would be run and the database would be checked to ensure that the records had made it there. We have a number of tests for the individual steps, but tests for the whole pipeline would be rad!

Alternatives

Additional context

Implementation

• 🙋 I would be interested in implementing this feature.