Image2Music

Article: "Zero-Effort Image-to-Music Generation: An Interpretable RAG-based VLM Approach" (under review)

1. Worflow

2. Dataset

amaai-lab/MidiCaps · Datasets at Hugging Face

Please rename the train.json as meta.txt.

The data process part is based on the code of jwdj/EasyABC: EasyABC (github.com).

3. Run the Model

python main.py

4. Citation

5. Links

Some websites provide the service for abc2midi and midi2abc:

midi2abc (marmooo.github.io)

ABC notation converter - Nota ABC (notabc.app)