GD-Downloader

A powerful and flexible Google Drive downloader with pause/resume support, view-only file handling, and extensive testing infrastructure.

🌟 Features

✅ Multiple Download Modes: Standard downloads, view-only file extraction, video downloads
✅ Pause/Resume System: Robust checkpoint system for large downloads
✅ View-Only Support: Download view-only PDFs and documents with advanced browser automation
✅ Video Downloads: Extract streaming videos from Google Drive
✅ OCR Support: Make PDFs searchable with Tesseract OCR (optional)
✅ Parallel Processing: Multi-threaded downloads for better performance
✅ Internationalization: Multi-language support (i18n)
✅ Comprehensive Testing: 90%+ test coverage with robust testing infrastructure
✅ Rich CLI Interface: Beautiful command-line interface with progress tracking

🚀 Quick Start

Prerequisites

Python 3.8 or higher
Google Drive API credentials (credentials.json)
FFmpeg (for video downloads)
Tesseract OCR (optional, for searchable PDFs)
Playwright browsers (for view-only downloads)

Installation

Option 1: Install from Source (Recommended)

# Clone the repository
git clone https://github.com/yourusername/gd-downloader.git
cd gd-downloader

# Install with test dependencies
pip install -e .[test]

# Install optional dependencies
pip install ocrmypdf  # For OCR support
pip install playwright  # For view-only downloads
playwright install chromium  # Install browser

Option 2: Install Basic Version

pip install gd-downloader

Configuration

Google Drive API Setup:
- Create Google Cloud Project
- Enable Google Drive API
- Create OAuth 2.0 credentials
- Download credentials.json to project root

FFmpeg Setup (for videos):

# Windows
choco install ffmpeg

# macOS
brew install ffmpeg

# Linux
sudo apt-get install ffmpeg

Tesseract Setup (optional, for OCR):

# Windows
choco install tesseract

# macOS
brew install tesseract

# Linux
sudo apt-get install tesseract-ocr

📖 Usage

Basic Download

# Download a single folder
python main.py "https://drive.google.com/drive/folders/YOUR_FOLDER_ID"

# Download to specific directory
python main.py "https://drive.google.com/drive/folders/YOUR_FOLDER_ID" --output "/path/to/downloads"

# Download with progress tracking
python main.py "https://drive.google.com/drive/folders/YOUR_FOLDER_ID" --progress

Advanced Options

# Download only documents (skip videos)
python main.py "URL" --only-docs

# Download with OCR support
python main.py "URL" --ocr --ocr-lang "por+eng"

# Download with parallel processing
python main.py "URL" --workers 10

# Download view-only PDFs
python main.py "URL" --view-only

# Download with pause/resume support
python main.py "URL" --checkpoint-interval 10

View-Only Downloads

# Download view-only PDFs with browser automation
python main.py "URL" --view-only --scroll-speed 50

# Download view-only with OCR
python main.py "URL" --view-only --ocr

# Download with custom browser settings
python main.py "URL" --view-only --user-agent "custom-agent-string"

Video Downloads

# Download videos from Google Drive
python main.py "URL" --only-videos

# Download with GPU acceleration
python main.py "URL" --only-videos --gpu nvidia

# Download with custom quality
python main.py "URL" --only-videos --quality high

🧪 Testing

The project includes a comprehensive testing infrastructure designed to ensure reliability and maintainability. For complete testing instructions, see docs/TESTING_GUIDE.md.

Quick Tests

# Run quick validation (recommended for development)
python scripts/quick_test.py

# Run all unit tests
python -m pytest tests/unit/ -v

# Run tests with coverage
python -m pytest tests/unit/ --cov=. --cov-report=html

# Run critical tests only (fast)
python -m pytest tests/unit/ -m "critical" -v

Test Scripts

# Quick validation script
python scripts/quick_test.py

# Comprehensive functionality test
python scripts/test_functionality.py

# Full test suite with all categories
python run_tests.py --all --coverage

# Run specific test categories
python run_tests.py --unit --integration
python run_tests.py --e2e --performance

Test Categories

Unit Tests: Individual component testing (tests/unit/)
Integration Tests: Multi-component interaction testing (tests/integration/)
End-to-End Tests: Full workflow testing (tests/e2e/)
Performance Tests: Load and stress testing

Coverage Reports

HTML report: htmlcov/index.html
Terminal report: Use --cov-report=term-missing
Minimum coverage: 85% for unit tests

📁 Project Structure

gd-downloader/
├── main.py                 # Main application entry point
├── auth_drive.py           # Google Drive authentication
├── downloader.py           # Download logic and orchestration
├── config.py               # Configuration constants and utilities
├── validators.py           # Input validation functions
├── errors.py               # Custom exception classes
├── checkpoint.py           # Pause/resume system
├── i18n.py                 # Internationalization system
├── ui.py                   # Rich CLI interface
├── logger.py               # Advanced logging system
├── requirements.txt         # Production dependencies
├── pyproject.toml          # Project configuration
├── pytest.ini              # Test configuration
├── .gitignore              # Git ignore file
├── README.md               # This file
├── LICENSE                 # MIT License
├── 
├── src/                    # Source code
├── docs/                   # Documentation
│   ├── TESTING_GUIDE.md
│   ├── API_REFERENCE.md
│   └── EXAMPLES.md
├── scripts/                # Utility scripts
│   ├── quick_test.py       # Quick validation script
│   ├── test_functionality.py # Comprehensive functionality test
│   └── cleanup.py          # Cleanup utilities
├── tests/                  # Complete test suite
│   ├── conftest.py         # Global test configuration and fixtures
│   ├── unit/               # Unit tests for individual modules
│   │   ├── test_basic_validation.py
│   │   ├── test_checkpoint.py
│   │   ├── test_config.py
│   │   ├── test_errors.py
│   │   ├── test_i18n.py
│   │   ├── test_ui.py
│   │   └── test_validators.py
│   ├── integration/        # Integration tests for module interactions
│   ├── e2e/                # End-to-end tests for complete workflows
│   ├── fixtures/           # Test data and mock factories
│   │   └── mock_data.py
│   └── utils/              # Test utilities and helpers
│       └── test_helpers.py
└── temp/                   # Temporary files

🔧 Configuration

Environment Variables

# Google Drive API
export GOOGLE_CLIENT_ID="your_client_id"
export GOOGLE_CLIENT_SECRET="your_client_secret"

# Download settings
export DEFAULT_WORKERS=5
export MAX_RETRY_ATTEMPTS=5
export DOWNLOAD_TIMEOUT=300

# OCR settings
export OCR_DEFAULT_LANG="por+eng"
export OCR_TESSERACT_PATH="/usr/bin/tesseract"

Configuration File

Create config_local.py for custom settings:

# Custom configuration
DEFAULT_WORKERS = 10
MAX_DOWNLOAD_SIZE = 5 * 1024 * 1024 * 1024  # 5GB
ENABLE_OCR = True
OCR_LANGUAGES = ["por", "eng", "spa"]

🌍 Internationalization

The project supports multiple languages. Current language files are in the lang/ directory.

Adding New Languages

Create language file: lang/your_code.lang
Add translations following the JSON format
Update i18n.py to include the new language

Supported Languages

English (en) - Default
Portuguese (por)
Spanish (spa)
French (fra) - Coming soon
German (deu) - Coming soon

🤝 Contributing

Contributions are welcome! Please read CONTRIBUTING.md for guidelines.

Development Setup

# Clone the repository
git clone https://github.com/yourusername/gd-downloader.git
cd gd-downloader

# Create virtual environment
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install development dependencies
pip install -e .[test,dev]

# Install pre-commit hooks
pre-commit install

# Run tests
python scripts/quick_test.py
python -m pytest tests/unit/ -v

Submitting Changes

Fork the repository
Create a feature branch
Make your changes
Add tests for new functionality
Ensure all tests pass
Submit a pull request

📚 Documentation

Testing Guide - Comprehensive testing instructions
API Reference - API documentation
Examples - Usage examples
Troubleshooting - Common issues and solutions

🐛 Troubleshooting

Common Issues

1. Authentication Errors

Error: Invalid credentials.json format
Solution: Ensure credentials.json is properly formatted JSON

2. Download Failures

Error: Permission denied
Solution: Check file permissions and disk space

3. View-Only Issues

Error: Browser automation failed
Solution: Install Playwright: pip install playwright && playwright install

4. OCR Issues

Error: Tesseract not found
Solution: Install Tesseract OCR: choco install tesseract (Windows)

Getting Help

Check the Troubleshooting Guide
Search Issues
Read the FAQ

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🤝 Credits

Google Drive API for file access
Playwright for browser automation
Rich for CLI interface
PyAutoGUI for scroll simulation
OCRmyPDF for searchable PDFs

📈 Roadmap

Web interface (Flask/FastAPI)
REST API for remote access
Desktop application (Electron/Tkinter)
Cloud storage integration (Dropbox, OneDrive)
Torrent client integration
Machine learning for file categorization

📞 Support

For support and questions:

Create an Issue
Check the Documentation
Join our Discord community

Made with ❤️ for the Google Drive community

Name		Name	Last commit message	Last commit date
Latest commit History 46 Commits
docs		docs
lang		lang
scripts		scripts
tests		tests
.gitignore		.gitignore
README.md		README.md
auth_drive.py		auth_drive.py
checkpoint.py		checkpoint.py
chromedriver.exe		chromedriver.exe
cleanup.py		cleanup.py
config.py		config.py
downloader.py		downloader.py
errors.py		errors.py
i18n.py		i18n.py
logger.py		logger.py
main.py		main.py
pyproject.toml		pyproject.toml
pytest.ini		pytest.ini
requirements.txt		requirements.txt
run_tests.py		run_tests.py
ui.py		ui.py
validators.py		validators.py

Folders and files

Latest commit

History

Repository files navigation

GD-Downloader

🌟 Features

🚀 Quick Start

Prerequisites

Installation

Option 1: Install from Source (Recommended)

Option 2: Install Basic Version

Configuration

📖 Usage

Basic Download

Advanced Options

View-Only Downloads

Video Downloads

🧪 Testing

Quick Tests

Test Scripts

Test Categories

Coverage Reports

📁 Project Structure

🔧 Configuration

Environment Variables

Configuration File

🌍 Internationalization

Adding New Languages

Supported Languages

🤝 Contributing

Development Setup

Submitting Changes

📚 Documentation

🐛 Troubleshooting

Common Issues

1. Authentication Errors

2. Download Failures

3. View-Only Issues

4. OCR Issues

Getting Help

📄 License

🤝 Credits

📈 Roadmap

📞 Support

About

Resources

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

Packages