This would really help teams that have very large test suites.

I am not sure exactly how other test frameworks accomplish this, but I can think of a few strategies.

@craigtaub if you're looking for something to do, researching various strategies and proposing a way forward would be helpful.

When we do implement, we can assume that the computation of the "affected module hierarchy" will save time over just running everything (as we currently do), so we can probably avoid worrying too much about caching in an MVP.