GH-1578 TerraDataRepoSource filters old rows before reducing

[okotsopoulos]

Purpose

• https://broadinstitute.atlassian.net/browse/GH-1578

Addresses an edge case bug when TerraDataRepoSource polls for new rows to snapshot.

The desired behavior: if a snapshot creation job fails, we should automatically reconsider its rows for snapshotting until they are snapshotted successfully or they age out of our 2 hour check window.

Bug: if a workload's first snapshot creation job fails, we did not reconsider its rows for snapshotting.

Fix: filter old snapshot creation job rows by status prior to reducing to a single object with all old row IDs. This filtration previously took place within the reduction, but If you pass a singleton sequence to reduce it is returned as it's passed in. https://clojuredocs.org/clojure.core/reduce

[okotsopoulos]

System tests pass:

wm111-e35:wfl okotsopo$ make TARGET=system
export CPCACHE=/Users/okotsopo/wfl/api/.cpcache;            \
	export WFL_WFL_URL=http://localhost:3000; \
	clojure  -M:parallel-test wfl.system.v1-endpoint-test | \
	tee /Users/okotsopo/wfl/derived/api/system.log
WARNING: Specified path is external to project: ../derived/api/src
WARNING: Specified path is external to project: ../derived/api/resources

Ran 32 tests containing 367 assertions.
0 failures, 0 errors.