Handle push requests from the last mini-batch

[wynot12]

Since push requests are done asynchronous, we cannot know when these requests are completed.
This can be a problem when we wanna delete/checkpoint a table after the push requests completes.