Track number of throttled attempts in retry loop

[coryan]

Oh wait, nothing is tracking the # of throttles per client call. Hmm... Should that be an argument to on_throttle?

Originally posted by @dbolduc in #2456 (comment)