It scrape data from magicbricks.com using BeautifulSoup and selenium WebDriver and store it in JSON format. Selenium web-driver package take the control of the browser and mimic the given actions to trigger desired events. BeautifulSoup is used to extract the particular element from the response.
- Name and ID
- Description
- URL
- Price
- Location Details ( City Name, Address, Latitude, Longitude)
- Flat Details (Number of Rooms, Furnishing Status, Floor No.)
- Agent Details(Agent Name, Masked Mobile Number)