A Systematic Exploration of Joint-training for Singing Voice Synthesis

Understand

There has been a growing interest in using end-to-end acoustic models for singing voice synthesis (SVS).

• Typically, these models require an additional vocoder to transform the generated acoustic features into the final waveform.
• However, since the acoustic model and the vocoder are not jointly optimized, a gap can exist between the two models, leading to suboptimal performance.
• Although a similar problem has been addressed in the TTS systems by joint-training or by replacing acoustic features with a latent representation, adopting corresponding approaches to SVS is not an easy task.