Website Crawler

A website crawler, also known as a spider or bot, is a tool that automatically scans a website and follows links to discover all of its pages.

Can edit on terminal via nano main.rb or vim main.rb Run the file with ruby main.rb command