Amplitude - AI-Powered Baritone Ukulele Learning System

A sophisticated learning apparatus for baritone ukulele that combines computer vision, audio processing, and AI to provide real-time feedback and instruction.

Architecture

Frontend (/frontend)

• Vue 3 with Composition API
• Vite for build tooling and development
• Tailwind CSS for styling
• TypeScript for type safety
• MediaPipe for computer vision
• Web Audio API for real-time audio processing

Backend (/backend)

• Fastify with TypeScript
• SQLite for local data storage
• GPT OSS for AI-powered song analysis
• WebSocket for real-time communication
• Modular architecture with proper separation of concerns

Features

• Instrument Detection: Computer vision-based baritone ukulele recognition
• Real-time Tuning: High-accuracy tuner for D-G-B-E tuning
• Song Processing: Convert guitar tabs to baritone ukulele format
• Chord Progression Analysis: AI-powered pattern recognition
• Live Feedback: Real-time fret highlighting and finger guidance
• Offline-First: All processing happens locally

Development

# Install dependencies
npm install

# Start development servers
npm run dev

# Build for production
npm run build

# Run linting
npm run lint

# Type checking
npm run type-check

Project Structure

amplitude/
├── frontend/          # Vue 3 + Vite + Tailwind
├── backend/           # Fastify + TypeScript
├── shared/            # Shared types and utilities
└── docs/              # Documentation

Requirements

• Node.js >= 18.0.0
• npm >= 9.0.0
• Modern web browser with WebRTC support
• Camera and microphone access for full functionality