Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

constrain of numbers #15

Closed
wangrx33 opened this issue Nov 26, 2019 · 2 comments
Closed

constrain of numbers #15

wangrx33 opened this issue Nov 26, 2019 · 2 comments

Comments

@wangrx33
Copy link

hi, thanks for sharing.
And how to constrain the number of images to download, like I only want to 100 images.
thanks for help

@YoongiKim
Copy link
Owner

YoongiKim commented Dec 16, 2019

Hi.
This problem is little bit hard...
As this program is based on multi treading, I can't share count variables among threads.
And sometimes download fails so we cannot divide task exactly.

So there is only one solution:

if len(glob.glob("download/*", recursive=True) >= MAX_COUNT:
    # STOP CRAWLING THE KEYWORD

I will add this feature later but if you want to use it you can just implement it.
Thank you.

YoongiKim added a commit that referenced this issue Jan 4, 2020
add code to resolve issue #15

Oh, I'm sorry for checking late.
Thank you for your contribution!
@YoongiKim
Copy link
Owner

Hi.

junho-one solved this issue.

Thank you.

YoongiKim added a commit that referenced this issue Jan 4, 2020
YoongiKim added a commit that referenced this issue Jan 4, 2020
Revert "add code to resolve issue #15"
cbwces pushed a commit to cbwces/AutoCrawler that referenced this issue Dec 30, 2021
cbwces pushed a commit to cbwces/AutoCrawler that referenced this issue Dec 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants