An end-to-end AI-powered animated video generation system that converts a single prompt into a complete short film using modular LLM agents.
This project implements a multi-phase agentic pipeline:
- Story & Script Generation — Prompt → structured story, scenes, characters
- Audio Generation — Dialogue + character voices + background music
- Video Composition — Scene visuals + animation + A/V sync → final video
- Web Interface — UI to run pipeline, track progress, and preview output
- Edit Agent — Natural language edits with versioning and undo support
| Layer | Tools |
|---|---|
| Backend | FastAPI |
| Frontend | Next.js / React |
| Agents | LangGraph / LLM APIs |
| Audio | ElevenLabs / Coqui / Bark (TTS) |
| Video | FFmpeg / MoviePy |
| Image Generation | Stable Diffusion / APIs |
| State Management | JSON + version snapshots |
pip install -r requirements.txt
python -m backend.appcd frontend
npm install
npm run dev- Prompt → full animated video pipeline
- Scene-wise generation (modular phases)
- Real-time progress tracking (Phase 4)
- Phase-level re-run support
- Edit agent with:
- Natural language edits
- Targeted regeneration (audio / video / script)
- Version history (v1, v2, v3…)
- Undo / revert system
agents/ # Phase-wise agents (story, audio, video, edit)
backend/ # API + orchestration layer
frontend/ # Web UI
mcp/ # Tooling layer (LLM, audio, video, etc.)
state_manager/ # Versioning + snapshots
data/ # Outputs and assets
shared/ # Schemas and utilities
- All phases communicate via a shared JSON state schema
- Each phase is modular and independently testable
- Every run/edit creates a new version snapshot