Duolingo Vocabulary Scraper for Anki

A multilingual vocabulary scraper that extracts words from Duolingo via duome.eu and creates Anki flashcard decks with audio pronunciations and contextual example sentences.

Features

• 🌍 Multilingual Support: Scrape vocabulary for 14+ languages
• 🔊 Audio Pronunciations: Automatic TTS audio generation using Google Text-to-Speech
• 📝 Example Sentences: AI-generated contextual sentences with audio for better learning
• 📚 Dual-sided Flashcards: Target Language ↔ English with pronunciation guides and examples
• 🚀 Easy Setup: One-command installation with detailed setup instructions
• 📊 Progress Logging: Real-time feedback on audio downloads and processing
• 🔄 Incremental Updates: Skip existing audio and sentences for faster re-runs
• 🤖 AI Translation & Sentences: Use Claude API to translate words and generate example sentences

Quick Start

# Clone the repository
git clone https://github.com/mstampfer/anki-duolingo-scraper.git
cd anki-duolingo-scraper

# Set up environment (see setup.md for detailed instructions)
pip install -r requirements.txt

# Run scraper (defaults to Russian)
python scraper.py

# Or specify a different language
python scraper.py -l es  # Spanish
python scraper.py -l fr  # French
python scraper.py -l de  # German

# With Claude API for translations and example sentences (recommended)
python scraper.py -l es --api-key your_anthropic_api_key

Supported Languages

Code	Language	Code	Language	Code	Language
ru	Russian	es	Spanish	fr	French
de	German	it	Italian	pt	Portuguese
nl	Dutch	pl	Polish	tr	Turkish
ja	Japanese	ko	Korean	zh	Chinese
ar	Arabic	hi	Hindi

Usage

# Show help
python scraper.py --help

# Default (Russian)
python scraper.py

# Specify language with ISO 639-1 code
python scraper.py -l <language_code>

# Examples
python scraper.py -l es  # Spanish
python scraper.py -l ja  # Japanese
python scraper.py -l de  # German

# With Claude API for translations and example sentences
python scraper.py -l ja --api-key your_anthropic_api_key

Output

• Anki Deck: duolingo_{language_code}_vocabulary.apkg
• Word Audio Files: audio_{language_code}/*.mp3
• Sentence Audio Files: audio_{language_code}_sentences/*.mp3

Import the .apkg file into Anki using File → Import.

Requirements

• Python 3.7+
• Internet connection (for scraping and TTS)
• See requirements.txt for package dependencies
• Optional: Anthropic API key for translations and example sentences

Installation

Option 1: Using pip/venv

python -m venv duolingo_scraper_env
source duolingo_scraper_env/bin/activate  # Linux/macOS
pip install -r requirements.txt

Option 2: Using conda/mamba

mamba create -n duolingo_scraper python=3.9
mamba activate duolingo_scraper
pip install -r requirements.txt

For detailed setup instructions, see setup.md.

How It Works

1. Scrapes vocabulary from duome.eu/vocabulary/en/{language}/skills
2. Extracts target language words, pronunciations, and English translations
3. Translates missing words using Claude API (if API key provided)
4. Generates example sentences with Claude API for contextual learning
5. Creates audio files for words and sentences using Google Text-to-Speech
6. Builds Anki deck with enhanced flashcards and embedded audio

Example Output

Starting to scrape Duolingo Spanish vocabulary...
✓ Loaded 847 existing translations and 0 sentence examples
Fetching vocabulary from https://duome.eu/vocabulary/en/es/skills...
Parsing vocabulary entries...
📖 Using existing translation: hola → hello
🎯 Claude sentence: ¡Hola! ¿Cómo estás? → Hello! How are you?
🔊 Sentence audio downloaded: ¡Hola! ¿Cómo estás?
• Audio exists: hola
📖 Using existing translation: gracias → thank you
📝 Using existing sentence: gracias
🔄 Sentence changed, regenerating audio: Muchas gracias por...
🔊 Sentence audio downloaded: Muchas gracias por tu ayuda
• Audio exists: gracias
Found 847 vocabulary entries.
Creating Anki deck...
Successfully created Anki deck with 847 vocabulary cards.
Output file: duolingo_es_vocabulary.apkg

Flashcard Format

Each vocabulary word creates two flashcards with enhanced content:

Target Language → English

Front:

• Target word with audio pronunciation
• Example sentence in target language with audio

Back:

• Word pronunciation guide
• English translation
• English translation of example sentence

English → Target Language

Front:

• English word
• English example sentence

Back:

• Target language word with audio
• Pronunciation guide
• Target language example sentence with audio

Error Handling

• Rate Limiting: Gracefully handles Google TTS 429 errors
• Network Issues: Robust error handling for connectivity problems
• Missing Data: Validates vocabulary extraction and reports issues
• File Management: Incremental audio generation and cleanup
• Audio-Sentence Sync: Automatically validates and regenerates sentence audio if content changes

Contributing

1. Fork the repository
2. Create a feature branch (git checkout -b feature/amazing-feature)
3. Commit your changes (git commit -m 'Add amazing feature')
4. Push to the branch (git push origin feature/amazing-feature)
5. Open a Pull Request

Troubleshooting

• SSL Errors: Upgrade pip with pip install --upgrade pip
• Audio Issues: Ensure internet connection for Google TTS
• Import Errors: Check that all dependencies are installed
• Website Changes: duome.eu structure changes may require updates

License

This project is open source and available under the MIT License.

Acknowledgments

• duome.eu for providing Duolingo vocabulary data
• genanki for Anki deck generation
• gTTS for Google Text-to-Speech integration

Support

If you encounter issues or have questions:

1. Check the troubleshooting section
2. Review setup.md for detailed installation help
3. Open an issue on GitHub with detailed error information

---

⭐ Star this repository if you find it helpful for your language learning journey!