Skip to content

This is an educational project that requires the construction of a scraper and for that, I chose the website Indeed webpage to get the information: Job's name, Company's name, and the date that was posted when It is available and I also add tests to check the methods created in the file scraper.rb.

Notifications You must be signed in to change notification settings

brugobi/my_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

My Scraper

this is an educational project required by Microverse as part of the curriculum that requires the construction of a simple scraper and for that I chose the website (https://ca.indeed.com/jobs?q=developer&l=London%2C+ON) to get three informations: The Job's name, Company's name and the date that was posted when It is avaible and I also add tests to check the methods created in the file scraper.rb.

Assessment criteria

  • Create effective Ruby code, that solves the problem
  • Apply Ruby coding best practices.
  • Create unit test for Ruby code
  • Implement basic OOP principles (encapsulation, inheritance) in Ruby
  • Have a organized project structure: modules, files and folders
  • Use common Ruby patterns
  • Chooses a simple solution over a more complex answer wherever possible.
  • Ability to multitask and effectively manage time and prioritization.
  • Ability to translate business requirements into software solutions.
  • Ability to perform tasks and complete projects with minimal supervision.

The original Web site

screenshot

My scraper Output

screenshot

Built With

  • Ruby,
  • Gems used: nokogiri,
  • VSCode

Getting Started

Cloning a Git repository:

  • From the repository, click + in the global sidebar and select Clone this repository under Get to work.
  • Copy the clone command (either the SSH format or the HTTPS). ...
  • From a terminal window, change to the local directory where you want to clone your repository.

To start My_Scraper:

  • You need to have ruby installed on your machine
  • run command git clone git@github.com:brugobi/my_scraper.git to clone the repository
  • run command bundle install
  • go into the folder containing the project by typing cd my_scraper
  • go into the folder containing the project by typing cd bin
  • type in your terminal the command ruby main.rb

Run tests

  • Unit test (Rspec)

screenshot

To see the test results run the following command

rspec --format documentation

Author

👤 Bruna Gobi

🤝 Contributing

Contributions, issues and feature requests are welcome!

Feel free to check the issues page.

Show your support

Give a ⭐️ if you like this project!

Acknowledgments

  • Microverse
  • Hat tip to anyone whose code was used
  • Inspiration
  • etc

📝 License

This project is MIT licensed.

About

This is an educational project that requires the construction of a scraper and for that, I chose the website Indeed webpage to get the information: Job's name, Company's name, and the date that was posted when It is available and I also add tests to check the methods created in the file scraper.rb.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages