Switch mongoItemReader to use a cursor instead of paging#3824
Switch mongoItemReader to use a cursor instead of paging#3824jbotuck wants to merge 1 commit intospring-projects:mainfrom
Conversation
Paging in mongo runs in On^2 time since each skip needs to count all the records it is skipping
b36633c to
602afb7
Compare
|
Thank you for this PR! We can't change the I suggest to create a new cursor-based mongo item reader named The current Please update the PR accordingly and we can continue from there. |
|
We have a PR for the cursor-based implementation here: #4323 , which seems similar to what we have here. Please do not hesitate to review it if you want. As mentioned previously, the current Thank you for your contribution anyway. |
|
Makes sense to me. Reworking this pr has been on the bottom of my to do list for a while. |
Paging in mongo runs in On^2 time since each skip needs to count all the records it is skipping