Implementing Multithreading for Concurrent Searches with Gmaps.places #140
Ranzaaroor
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi everyone,
I'm looking to improve my scraper's efficiency (using the pro version), which uses
Gmaps.places
. Currently, I have a logic that creates 5 search points out of 1 user input processes five search points from a single query sequentially, but I'm interested in running these searches in parallel to save time.Example (Hard coded arguments):
For input: "Restaurants in Atlanta"
Run 2 queries at once with Gmaps.places:
And so 2 chrome tabs will open and run the scraper in parallel to output more than 120 place in less time than usual.
I'd appreciate any insights or experiences with multithreading in similar scenarios, especially regarding handling IP detections and ensuring data consistency.
Has anyone tackled something similar or have any tips on the best way to approach this?
Thanks for your help!
Beta Was this translation helpful? Give feedback.
All reactions