Closed
Description
Dave Syer opened BATCH-1538 and commented
Allow dependent steps to start concurrently: step1 can be producing data that are needed in step2, e.g. staging records, and step2 can start to process those as soon as they are available without waiting. All that is needed is a protocol for the steps to agree on whether a dependency is finished or in flight. (In the staging case step1 is hardly ever a limiting factor in terms of execution time, but it might still help.)
1 votes, 3 watchers