Skip to content

justjoin.it website scraper. Scrape website for chosen technology, and displays the most wanted skills.

Notifications You must be signed in to change notification settings

wloszynski/statsjustjoinit-scraper

Repository files navigation

skills-requirements-justjoinit-spider

This app counts the number of skills requirements from employees using justjoin.it website.

To use this program you must install geckodriver for Firefox. (search: how to install geckodriver for Firefox )

Open terminal/cmd and type 'pip install selenium' and 'pip install termtable'. Now you can use skill_spider!

Go to terminal and type: python3 skill_spider.py.

It will ask you to choose category and number of skills, then it will open your browser, scrape data, close browser, and show you the results.

EXAMPLE:

Categories: ['javascript', 'html', 'php', 'ruby', 'python', 'java', 'net', 'scala', 'c', 'mobile', 'testing', 'devops', 'ux', 'pm', 'game', 'analytics', 'security', 'data', 'go', 'sap', 'support', 'other']

Type the category name or press enter to display data for all available jobs: python

Type number of skills to display: 7

AND NOW IT WILL DISPLAY YOU DATA IN THE TABLE

About

justjoin.it website scraper. Scrape website for chosen technology, and displays the most wanted skills.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages