This is a very simple python script that is used to scrape the KONAMI website to acquire a complete list of all yugioh cards (and their respective card information) into csv files. This can serve as a great tool for developers interested in the yugioh domain.
This script was programmed using Python 3.8.10, be sure to use the same version. You can run the setup.bat file to create your virtual environment (on windows) and install all dependencies. If not, the repository comes with a requirements.txt file that can be used to install all dependencies with your own virtual environment solution on any platform. Installation can be done using the following command.
pip install -r requirements.txt
Running the script is as simple as launching the entry point main.py specifying the language option (no arguments will default to english). An output folder will be created with a CSV file for each pack. If a connection is lost, or internet is lost, you can re=run the script and it will continue from where it left off. A picture can be seen below of the output.
A snippet of a single file in excel (delimited using the $ character - this can be modified in the script as needed)
You can skip additional information (card_supports, card_anti_supports, card_actions, effect_types, status) by enabling the Fast option. This information is retrieved on a secondary website (yugioh wiki) and can make the scraping significantly longer.
python main.py -f
language support is an experimental feature that has been added to specify language of output. Languages include English, French, Deutsch, Italian, Spanish, Portuguese, and can be specified as follows:
python main.py --language fr # Accepts the following {en,fr,de,it,es,pt,ko,ja}
As always, if you find bugs don't hesitate to contact me and I'll do my best to support. Thanks!