An open-source, public domain audio format that natively supports multi-stem architecture, neural compression, smart metadata, spatial audio, P2P streaming, and non-destructive editing.
One file to rule them all β production, distribution, playback, and archival.
Specification β’ Getting Started β’ Architecture β’ Roadmap β’ Contributing
Current audio formats were designed in the 1990s for a simpler world. They store flat, single-stream audio with basic metadata. NEO reimagines audio from the ground up:
| Capability | MP3/AAC | FLAC/WAV | NI Stems | NEO |
|---|---|---|---|---|
| Multi-stem (vocals, drums, bass...) | β | β | β (4 fixed) | β (1-8 dynamic) |
| AI neural compression (90x ratio) | β | β | β | β |
| Bit-perfect lossless mode | β | β | β | β (hybrid) |
| 3D spatial audio (object-based) | β | β | β | β |
| Provenance / anti-deepfake (C2PA) | β | β | β | β |
| Smart metadata (JSON-LD) | ID3 tags | Vorbis | MP4 | β (linked data) |
| Temporal lyrics + chords + BPM | β | β | β | β |
| Web3 royalties / direct payment | β | β | β | β |
| P2P / IPFS native streaming | β | β | β | β |
| Non-destructive edit history | β | β | β | β (git-like) |
| Progressive loading (instant play) | β | β | β | β |
| Open source / patent-free | Expired | β | β | β (Unlicense) |
Every .neo file can contain up to 8 separate audio stems (vocals, drums, bass, melody, etc.). Mute the vocals for instant karaoke. Isolate the drums for sampling. Or listen to the full mix β all from one file.
Powered by the Descript Audio Codec, NEO achieves ~90x compression at perceptual transparency. Combined with a FLAC residual layer, you get lossy streaming AND lossless archival in the same file.
Audio stems are positioned in 3D space as objects. Your player automatically renders them for headphones (binaural/HRTF), surround systems (5.1/7.1.4), or stereo β no re-mastering needed.
Cryptographic signatures prove whether a track is human-made, AI-generated, or a hybrid. Fight deepfakes and verify authenticity at the format level.
Start playing instantly with the embedded ultra-light preview. Higher-quality layers download in the background. Zero buffering, even on 4G.
Cut the intro? Boost the bass? Your edits are stored as metadata β the original audio is never touched. Revert to any version, like git for audio.
NEO Project
βββ crates/ # Rust workspace (core implementation)
β βββ neo-format/ # Container format read/write
β βββ neo-codec/ # Audio codecs (DAC, FLAC, Opus)
β βββ neo-metadata/ # JSON-LD, C2PA, Web3, temporal
β βββ neo-spatial/ # 3D audio, Ambisonics, HRTF
β βββ neo-stream/ # Merkle trees, P2P, progressive loading
β βββ neo-edit/ # Non-destructive editing engine
β βββ neo-cli/ # Command-line tool (`neo`)
β βββ neo-ffi/ # C bindings for cross-language interop
βββ neural/ # Python ML components
β βββ neo_neural/ # DAC fork, ONNX export, source separation
βββ spec/ # Format specification documents
βββ tests/ # Unit, integration, and e2e tests
| Component | Technology |
|---|---|
| Core language | Rust (memory-safe, WASM-compilable) |
| Neural codec | DAC (Descript Audio Codec) fork, ONNX inference |
| Lossless layer | FLAC |
| Preview layer | Opus |
| Metadata | JSON-LD (schema.org) |
| Provenance | C2PA (c2pa-rs) |
| Hashing | BLAKE3 |
| Content addressing | Multihash / CID (IPFS-compatible) |
| Spatial rendering | Ambisonics + HRTF |
| ML framework | PyTorch β ONNX β ort (Rust) |
- Rust 1.75+
- Python 3.10+ (for neural codec components)
# Clone the repository
git clone https://github.com/CICCADA-CORP/NEO.git
cd neo-codec
# Build the Rust workspace
cd crates
cargo build --release
# The CLI tool is at target/release/neo
./target/release/neo --help# Encode a WAV file with 2 stems
neo encode vocals.wav instrumental.wav -o track.neo --stems vocals,instrumental
# Decode back to WAV
neo decode track.neo -o output/ --all-stems
# Inspect file info
neo info track.neo
# Play with stem control
neo play track.neo --mute vocals # Instant karaoke!
neo play track.neo --solo drums # Isolate drums
# Tag with metadata
neo tag track.neo --title "My Song" --artist "My Band" --bpm 120 --key Cm
# Download AI models
neo model download 44khzThis project is released into the public domain under the Unlicense.
You are free to use, modify, distribute, and build upon this work for any purpose, without any restrictions. No attribution required.
We welcome contributions of all kinds! Please read our Contributing Guide to get started.
- Format specification review β Help refine the binary format
- Rust implementation β Core container, codecs, and CLI
- Neural codec optimization β DAC fine-tuning for stems
- Testing β Audio quality metrics, edge cases, fuzzing
- Documentation β Tutorials, API docs, examples
NEO is not just a format β it's the PDF of audio.
Universal. Editable. Interactive. Secure.