Skip to content

Web scraper built in Python to analyze keyword frequency for any given Indeed query

Notifications You must be signed in to change notification settings

noappleonhead/job-keyword-analysis-python

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 

Repository files navigation

job-keyword-analysis-python

Web scraper built in Python(requests, BeautifulSoup4, pandas) to analyze keyword frequency for any given Indeed.ca query. The script collects URLs from an indeed.ca search query, visits each URL to scrape its text, and then stores job info in a pandas dataframe for analysis. Two resulting plots are created: percent of jobs with certain keywords and most frequent two word bigrams.

Usage: Edit 'scrape_indeed.py' to change desired keywords and desired query and then run 'scrape_indeed.py'.

Example Query: Developer jobs in Toronto, resulting in 1000 jobs

Percent of Jobs with Certain Keyword skills_plot

Most Frequent Two Word Bigrams bigram

About

Web scraper built in Python to analyze keyword frequency for any given Indeed query

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%