Generative Expressive Conversational Speech Synthesis

Understand

Conversational Speech Synthesis (CSS) aims to express a target utterance with the proper speaking style in a user-agent conversation setting.

• Existing CSS methods employ effective multi-modal context modeling techniques to achieve empathy understanding and expression.
• However, they often need to design complex network architectures and meticulously optimize the modules within them.
• In addition, due to the limitations of small-scale datasets containing scripted recording styles, they often fail to simulate real natural conversational styles.