NANSY++: Unified Voice Synthesis with Neural Analysis and Synthesis

Understand

Various applications of voice synthesis have been developed independently despite the fact that they generate "voice" as output in common.

• In addition, most of the voice synthesis models still require a large number of audio data paired with annotated labels (e.g., text transcription and music score) for training.
• To this end, we propose a unified framework of synthesizing and manipulating voice signals from analysis features, dubbed NANSY++.
• The backbone network of NANSY++ is trained in a self-supervised manner that does not require any annotations paired with audio.