Skip to content

Commit

Permalink
chromedriver update v2.44 to v2.46
Browse files Browse the repository at this point in the history
  • Loading branch information
Yoongi Kim committed Feb 17, 2019
1 parent ce7d5a4 commit 3d2ff92
Show file tree
Hide file tree
Showing 10 changed files with 8 additions and 4 deletions.
7 changes: 6 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# AutoCrawler
Google, Naver multiprocess image crawler

![](img/animation.gif)
![](animation.gif)

# How to use

Expand Down Expand Up @@ -46,3 +46,8 @@ sudo apt-get install screen <- This will allow you to close SSH terminal while r
Xvfb :99 -ac

DISPLAY=:99 python3 main.py


# Customize

You can make your own crawler by changing collect_links.py
File renamed without changes
Binary file modified chromedriver/chromedriver_linux
Binary file not shown.
Binary file removed chromedriver/chromedriver_linux64_v2.44.zip
Binary file not shown.
Binary file modified chromedriver/chromedriver_mac
Binary file not shown.
Binary file removed chromedriver/chromedriver_mac64_v2.44.zip
Binary file not shown.
1 change: 1 addition & 0 deletions chromedriver/chromedriver_v2.46.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
http://chromedriver.chromium.org/downloads
Binary file modified chromedriver/chromedriver_win.exe
Binary file not shown.
Binary file removed chromedriver/chromedriver_win32_v2.44.zip
Binary file not shown.
4 changes: 1 addition & 3 deletions main.py
Original file line number Diff line number Diff line change
Expand Up @@ -49,9 +49,7 @@ def __init__(self, skip_already_exist=True, n_threads=4, do_google=True, do_nave
self.do_naver = do_naver
self.download_path = download_path

# If download_path doesn't exist -> make one
if not os.path.exists('./{}'.format(self.download_path)):
os.mkdir('./{}'.format(self.download_path))
os.makedirs('./{}'.format(self.download_path), exist_ok=True)

@staticmethod
def all_dirs(path):
Expand Down

0 comments on commit 3d2ff92

Please sign in to comment.