MidiCaps: A large-scale MIDI dataset with text captions

Understand

Generative models guided by text prompts are increasingly becoming more popular.

• However, no text-to-MIDI models currently exist due to the lack of a captioned MIDI dataset.
• This work aims to enable research that combines LLMs with symbolic music by presenting, the first openly available large-scale MIDI dataset with text captions.
• MIDI (Musical Instrument Digital Interface) files are widely used for encoding musical information and can capture the nuances of musical composition.