🧠+🎧 Build your music algorithms and AI models with the next-gen DAW 🔥

Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.

OpenMusic: SOTA Text-to-music (TTM) Generation

List of academic resources on Multimodal ML for Music

Local windowed attention multi-instrumental music transformer for supervised music generation

Tegridy MIDI Dataset for precise and effective Music AI models creation.

Official implementation of "Contrastive Audio-Language Learning for Music" (ISMIR 2022)

SOTA Google's Perceiver-AR Music Transformer Implementation and Model

[SOTA] [92% acc] 786M-8k-44L-32H multi-instrumental music transformer with true full MIDI instruments range, efficient encoding, octo-velocity and outro tokens

SOTA kilo-scale MIDI dataset for MIR and Music AI purposes

GPT3-based Multi-Instrumental MIDI Music AI Implementation

A Bach music generator with Artificial Intelligence. This model is made by a VQ-VAE + Transformer (decoder-only). Sequences of midi 1 quarter length are compressed into 16 codebooks via VQ-VAE and a transformer learns how to generate the codebooks sequence to obtain a midi score.

Full-attention multi-instrumental music transformer featuring asymmetrical encoding with octo-velocity, and chords counters tokens, optimized for speed and performance

[DEPRECIATED] [PyTorch 2.0] [638M] [85.33% acc] Full-attention multi-instrumental music transformer for supervised music generation, optimized for speed, efficiency, and performance

Official implementation of "Equivariant Self-Supervision for Musical Tempo Estimation (ISMIR 2022)"

SOTA Piano Transformer model trained on 4.2GB of Solo Piano MIDI music

Music AI implementation and model to split mixed Piano compositions into separate parts for each hand

[DEPRECEATED] Multi-Instrumental Music Transformer trained on 12GB/400k MIDIs

[DEPRECIATED] Symbolic MIDI Music AI implementation

[DEPRECEATED] A miniature replica of OpenAI's MuseNet