-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
fed3378
commit 495e71e
Showing
1 changed file
with
32 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,2 +1,32 @@ | ||
# Animal-Crossing-Data-Project | ||
Updates spreadsheet of Animal Crossing villager information with updated popularity each month scraped from a website. | ||
# Database of Villager Attributesfrom video game *Animal Crossing* | ||
This project automatically updates a MySQL database of villager data from the video game *Animal Crossing: New Horizons*. Villager popularity data is scraped using Beautiful Soup on Animal Crossing Portal's Popularity Tier List. Villager attributes are obtained from a Kaggle dataset. Both sources are joined and appended to MySQL table automatically every two weeks using Airflow via WSL on a Windows computer. | ||
|
||
## Methods Used | ||
* ETL | ||
* Web Scraping | ||
* Data Cleansing | ||
|
||
## Technologies Used | ||
* Python | ||
* Airflow | ||
* Linux (WSL) | ||
|
||
## Packages Used | ||
* Airflow | ||
* Selenium | ||
* bs4 | ||
* Pandas | ||
* Kaggle | ||
* sqlalchemy | ||
* mysql-connector-python | ||
|
||
# Featured Notebooks, Scripts, Analysis, or Deliverables | ||
* [```acnh_dag.py```](https://github.com/ErikaJacobs/Animal-Crossing-Popularity-Data/blob/master/acnh_dag.py) - | ||
* [```acnh_pop.py```](https://github.com/ErikaJacobs/Animal-Crossing-Popularity-Data/blob/master/acnh_pop.py) - | ||
|
||
# Other Repository Contents | ||
* [```chromedriver.exe```](https://github.com/ErikaJacobs/Animal-Crossing-Popularity-Data/blob/master/chromedriver.exe) - | ||
* [```villagers.csv```](https://github.com/ErikaJacobs/Animal-Crossing-Popularity-Data/blob/master/villagers.csv) - | ||
|
||
# Sources | ||
* [Animal Crossing Villager Popularity Tier List](https://www.animalcrossingportal.com/games/new-horizons/guides/villager-popularity-list.php#/) |