Offshore Wind Turbine UAV-Arm Cooperative Inspection System

An open-source UAV + robotic arm cooperative system for offshore wind turbine inspection. Built with DJI Tello, Arduino, and Python.

Overview

This project proposes an intelligent inspection solution combining a UAV with a 3-DOF lightweight robotic arm. Using a DJI Tello drone, it achieves autonomous flight, stable hovering, and defect identification on wind turbine towers through:

• Disturbance Observer (12-state EKF) — estimates and compensates for wind disturbances
• Feedforward PID Controller — disturbance-aware position control
• RRT* Path Planning — 3D obstacle-aware trajectory generation
• YOLOv8-Nano Defect Detection — real-time crack/corrosion/damage detection

Tech Stack

Component	Details
UAV Platform	DJI Tello (via DJITelloPy)
Robotic Arm	3-DOF SG90 servos + 3D-printed structure
MCU	Arduino Nano (CH340) + PCA9685 servo driver
Algorithms	12D-EKF, PID+Feedforward, RRT*, YOLOv8-Nano
Simulation	Pygame + Three.js 3D visualization
Frontend	Tkinter dashboard (monitor-only) + Web 3D (main demo)
Language	Python 3.10+

Quick Start

1. Environment Setup

# Windows
scripts\setup_env.bat

# Linux/macOS
bash scripts/setup_env.sh

2. Run Simulation

# Pygame desktop simulation
python -m backend.simulation.simulation

# Web 3D simulation (main demo)
python backend/simulation/http_bridge.py
# Then open: http://localhost:8800

3. Flash Arduino Firmware

python scripts/flash_firmware.py

4. Run Tests

# Run all test suites (134 tests in 20 files)
bash scripts/run_tests.sh      # Linux/macOS
scripts\run_tests.bat          # Windows

# Or run individually
python tests/test_ekf.py
python tests/test_integration.py
python tests/test_e2e_simulation.py  # End-to-end simulation

Project Structure

offshore-wind-uav-arm/
|-- backend/
|   |-- core/              # Algorithms (EKF / PID+FF / RRT* / Filters)
|   |-- drone/             # Tello interface + RCManager
|   |-- arm/               # Robotic arm kinematics + controller
|   |-- vision/            # YOLO defect detection + training
|   |-- simulation/        # Pygame sim + HTTP bridge + models
|   |-- runtime/           # SimRuntime single control loop    [Phase 3]
|   |-- hal/               # Hardware abstraction layer        [Phase 4]
|   |-- mission/           # Mission states + FailsafeMonitor
|   |-- utils/             # Bus(pub-sub) / Config / Units / Logger
|   +-- main.py            # MissionController (8-state FSM)
|-- frontend/              # Tkinter dashboard (monitor)
|-- firmware/              # Arduino servo controller
|-- config/                # YAML configuration files
|-- data/                  # Flight logs + datasets
|-- tests/                 # Pytest suite (134 tests, 20 files)
|-- scripts/               # Setup / flash / verification tools
|-- docs/                  # Documentation + attic
+-- seabreeze-3d-sim/      # Web 3D sim (Three.js, main demo)