- 
                Notifications
    You must be signed in to change notification settings 
- Fork 8
Open
Description
There can be problems importing paginated resources if some of them are deleted while paginating.
Storing all of them on memory could be also expensive.
Imagine you have 101 repos.
GETthe first page, and start processing one by one their issues and PRs.
Meanwhile a repo gets deleted, and the total number of repos is 100.
After a while we finish processing all the repos in the first page, and weGETpage 2. But now github will say that there is no page 2, and we missed the processing of 1 repo.
[...] we still get error anyway if something got deleted during import.
[...] this may impact on memory consumption, [...] it would be better to avoid storing the repos in an array and just call s.doRepo for each repo for each page.
Metadata
Metadata
Assignees
Labels
No labels