Ruby Job Scraper 🕷️

A simple Ruby-based web scraper designed to help developers filter through job postings on the HackerNews job board, specifically targeting Ruby and Rails jobs.

For a walkthrough of the code, check out the medium post.

Table of Contents

• Ruby Job Scraper 🕷️
  • Table of Contents
  • Getting Started
    • Prerequisites
    • Installation
  • Usage
  • Contributing
  • License
  • Acknowledgements

Getting Started

To get a local copy up and running, follow these simple steps.

Prerequisites

• Ruby (tested on version 2.7.0 or later)
• Bundler

Installation

1. Clone the repo - git clone https://github.com/Benmuiruri/ruby-web-scraper.git

2. Install required gems - bundle install

Usage

1. Open job_scraper.rb and customize the constants URL, KEYWORDS, and OUTPUT_FILE. get the HackerNews jobs board url for the current month
2. Run the script - ruby job_scraper.rb
3. Check the output file (job_postings.txt by default) for the filtered job postings.

Contributing

1. Fork the project
2. Create your feature branch (git checkout -b feature/YourFeature)
3. Commit your changes (git commit -m 'Add YourFeature')
4. Push to the branch (git push origin feature/YourFeature)
5. Open a pull request

License

Distributed under the MIT License.

Acknowledgements

• Nokogiri
• Selenium
• open-uri