Cache not behaving, getting many 'Too Many Requests' on identical URLs

[wjdp]

Too Many Requests --- ... --> https://github.com/newtheatre/history-project/

Should only hit URL once, and use cache after that

[wjdp]

Only happens when concurrency is turned on (TestFilesConcurrently: true)

[ssbarnea]

Any updates?

[wjdp]

@ssbarnea Concurrent mode has not seen any development of late. Beyond running multiple external requests simultaneously (at a reduced rate to prevent this issue) I don't foresee much performance improvement over what we get today. (Mostly somewhat informed speculation, would be happy to be proven wrong!)

As external link checking results are cached this really is a "nice to have" so unless someone else wants to look into this I doubt there will be much movement any time soon. Sorry!