LinkedIn SERP Scraper

LinkedIn SERP scraper fetches results of LinkedIn public profiles from Bing search engine result page and returns result in JSON format

Setup

1. Clone this project
2. Install dependencies mentioned inside requirements.txt

How to use?

In the project directory:

To scrap single linkedin profile:

$ python3 script.py --linkedin_url < url > --use_browser < browser_name >
Argument:

linkedin_url is the linkedin profile URL. For example, if user wants to scrap this URL https://in.linkedin.com/in/koushik-majumder-6172b412a , the command line argument will look like
python3 script.py --linkedin_url https://in.linkedin.com/in/koushik-majumder-6172b412a

--use_browser is an optional argument, if not passed firefox will be used by default, other option available is Google Chrome.

---

To scrap multiple linkedin profile:

$ python3 script.py --filename < filepath >
Argument:

filename is the path of the CSV file which contains all profile URLs separated by newline. For example: file.csv is located at /usr/documents/file.csv

then the command line argument will look like

--use_browser is an optional argument, if not passed firefox will be used by default, other option available is Google Chrome.

python3 script.py --filename /usr/documents/file.csv --use_browser firefox
Above code will use firefox by default and will scrap all linkedin profiles inside file.csv

---

Help:

$ python3 script.py -h

---

Tech

Selenium

Python

Privacy

This scraper only scrapes public data available to unauthenticated user and does not holds the capability to scrap anything private.

LICENSE

MIT