Document contain all the detailed steps which I took for this assignment. So let's go according to the instructions.
For this I have used Azure Virtual Machine but not from AWS, this doesn't mean I don't know AWS. I started my cloud journey with AWS but because my free tier is over I don't want to incur anymore charges.
- Analyze Given Python Code
- Containerize the Python script
- Setup A Selenium Grid Environment
- Scale The Scraper Using Docker And AWS & Setting up Atlas DB
- IaC Using Terraform
This Screenshot is taken when Python Script was configured to launch 5 concurrent web-driver requests to selenium-hub and there are 5 selenium-chrome-nodes are running.
BEFORE
AFTER
