Neural Melody Composition from Lyrics

Understand

In this paper, we study a novel task that learns to compose music from natural language.

• Given the lyrics as input, we propose a melody composition model that generates lyrics-conditional melody as well as the exact alignment between the generated melody and the given lyrics simultaneously.
• More specifically, we develop the melody composition model based on the sequence-to-sequence framework.
• It consists of two neural encoders to encode the current lyrics and the context melody respectively, and a hierarchical decoder to jointly produce musical notes and the corresponding alignment.