Skip to content

Commit

Permalink
Merge pull request YoongiKim#62 from YoongiKim/YoongiKim-patch-1
Browse files Browse the repository at this point in the history
Update README.md
  • Loading branch information
YoongiKim authored Oct 24, 2023
2 parents 6175e94 + 1667af7 commit b54e46e
Showing 1 changed file with 14 additions and 2 deletions.
16 changes: 14 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,18 @@ Xvfb :99 -ac & DISPLAY=:99 python3 main.py

You can make your own crawler by changing collect_links.py

# Issues
# How to fix issues

As google site consistently changes, you may need to fix ```collect_links.py```

1. Go to google image. [https://www.google.com/search?q=dog&source=lnms&tbm=isch](https://www.google.com/search?q=dog&source=lnms&tbm=isch)
2. Open devloper tools on Chrome. (CTRL+SHIFT+I, CMD+OPTION+I)
3. Designate an image to capture.
![CleanShot 2023-10-24 at 17 59 57@2x](https://github.com/YoongiKim/AutoCrawler/assets/38288705/6488d6df-1f01-4dfd-8691-6c0ac142fc04)
4. Checkout collect_links.py
![CleanShot 2023-10-24 at 18 02 35@2x](https://github.com/YoongiKim/AutoCrawler/assets/38288705/097c6c03-dd43-45d4-939e-2f677f595362)
5. Docs for XPATH usage: [https://www.w3schools.com/xml/xpath_syntax.asp](https://www.w3schools.com/xml/xpath_syntax.asp)
6. You can test XPATH using CTRL+F on your chrome developer tools.
![CleanShot 2023-10-24 at 18 05 14@2x](https://github.com/YoongiKim/AutoCrawler/assets/38288705/7ce2601f-9d53-48ff-a1cf-1a2befcc510f)
7. You need to find logic to crawling to work.

As google site consistently changes, please make issues if it doesn't work.

0 comments on commit b54e46e

Please sign in to comment.