Skip to content

JahanU/bargain-web-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Bargain Web Scraper

Try it out:

🕊 https://t.me/JD_sales_bot
👕 https://bargain-scraper.netlify.app/

Overview 🤔

  • Full-stack application to find discounted clothing items, with subsequent optimised HTTP calls to check whether they are truly in stock and get their sizes, display them to a clean minimal React Web App
  • Developed Telegram API Bot that handles user sign up, FAQ queries and sends live updates of when new items are found
  • Express, Node.js, Firebase, React.js

Features 🚀

Frontend

  • React Web App
  • Redux
  • Tailwind CSS
  • Filtering, Sorting, Search, Toggling
  • React Router (Search Params)

Backend

  • Firebase/Firestore (Store Users)
  • Performed Typescript migration
  • Telegram API Bot (User Sign-up, FAQ queries, Live Updates)
  • Software design patterns followed (MVC, DRY, High Cohesion, Low Coupling etc)
  • Web Scraping via Cheerio library
  • Asynchronous Programming (Promises, Promise.all)
  • Regex

Tech 💻

  • Frontend hosted on Netlify
  • Backend hosted on Heroku with New Relic APM (Application Performance Monitoring) addon
  • CI/CD (Quick automatic deployments from master branch)
  • Google Analytics

Design

Basic

Web-Scraper-System-Design drawio

intermediate

web-scraper-syste-design-intermediate drawio

Example

Telegram

Telegram Bot example

Installation

cd frontend
npm install
npm start

cd backend
npm install
npm start
  • (Need your own Telegram & Firebase API Key; Or comment those files out from the index.ts as they are not required for solo development)

About

Find highly discounted clothing items and be notified via a Telegram Bot and view via a React Web App.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published