ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Conformer: Convolution-augmented transformer for speech recognition

Original

Anmol Gulati, James Qin, Chung-Cheng Chiu, Niki Parmar, Yu Zhang, Jiahui Yu, Wei Han, Shibo Wang, Zhengdong Zhang, Yonghui Wu, et al. 2020 · 2005

Earlier work this paper cites.

Deep mixture density networks for acoustic modeling in statistical parametric speech synthesis

Heiga Zen and Andrew Senior. 2014 · 2014

Earlier work this paper cites.

Montreal forced aligner: Trainable text-speech alignment using kaldi

Michael McAuliffe, Michaela Socolof, Sarah Mihuc, Michael Wagner, and Morgan Sonderegger. 2017 · 2017

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Original

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018

Earlier work this paper cites.

tonyduan/mdn

Tony Duan. 2019 · 2019

Earlier work this paper cites.

Denoising diffusion probabilistic models

Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020 · 2020

Earlier work this paper cites.

Improving lpcnet-based text-to-speech with linear prediction-structured mixture density network

Min-Jae Hwang, Eunwoo Song, Ryuichi Yamamoto, Frank Soong, and Hong-Goo Kang. 2020 · 2020

Earlier work this paper cites.

Libri-light: A benchmark for asr with limited or no supervision

Jacob Kahn, Morgane Rivière, Weiyi Zheng, Evgeny Kharitonov, Qiantong Xu, Pierre-Emmanuel Mazaré, Julien Karadayi, Vitaliy Liptchinsky, Ronan Collobert, Christian Fuegen, et al. 2020 · 2020

Earlier work this paper cites.

Glow-tts: A generative flow for text-to-speech via monotonic alignment search

Jaehyeon Kim, Sungwon Kim, Jungil Kong, and Sungroh Yoon. 2020 · 2020

Earlier work this paper cites.

Fastspeech 2: Fast and high-quality end-to-end text to speech

Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, and Tie-Yan Liu. 2020 · 2020

Earlier work this paper cites.

Adaspeech: Adaptive text to speech for custom voice

Original

Mingjian Chen, Xu Tan, Bohan Li, Yanqing Liu, Tao Qin, Sheng Zhao, and Tie-Yan Liu. 2021 · 2021

Earlier work this paper cites.

Phone-level prosody modelling with gmm-based mdn for diverse and controllable speech synthesis

Chenpeng Du and Kai Yu. 2021 · 2021

Earlier work this paper cites.

Conditional variational autoencoder with adversarial learning for end-to-end text-to-speech

Jaehyeon Kim, Jungil Kong, and Juhee Son. 2021 · 2021

Earlier work this paper cites.

Soundstream: An end-to-end neural audio codec

Neil Zeghidour, Alejandro Luebs, Ahmed Omran, Jan Skoglund, and Marco Tagliasacchi. 2021 · 2021

Earlier work this paper cites.

Maskgit: Masked generative image transformer

Huiwen Chang, Han Zhang, Lu Jiang, Ce Liu, and William T Freeman. 2022 · 2022

Earlier work this paper cites.

Wavlm: Large-scale self-supervised pre-training for full stack speech processing

Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, et al. 2022 · 2022

Cited alongside, same era.

High fidelity neural audio compression

Original

Alexandre Défossez, Jade Copet, Gabriel Synnaeve, and Yossi Adi. 2022 · 2022

Cited alongside, same era.

Bigvgan: A universal neural vocoder with large-scale training

Original

Sang-gil Lee, Wei Ping, Boris Ginsburg, Bryan Catanzaro, and Sungroh Yoon. 2022 · 2022

Cited alongside, same era.

Phenaki: Variable length video generation from open domain textual description

Original

Ruben Villegas, Mohammad Babaeizadeh, Pieter-Jan Kindermans, Hernan Moraldo, Han Zhang, Mohammad Taghi Saffar, Santiago Castro, Julius Kunze, and Dumitru Erhan. 2022 · 2022

Cited alongside, same era.

Soundstorm: Efficient parallel audio generation

Llama: Open and efficient foundation language models

Original

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023 · 2023

Later among the works it cites.

Audiobox: Unified audio generation with natural language prompts

Original

Apoorv Vyas, Bowen Shi, Matthew Le, Andros Tjandra, Yi-Chiao Wu, Baishan Guo, Jiemin Zhang, Xinyue Zhang, Robert Adkins, William Ngan, et al. 2023 · 2023

Later among the works it cites.

Neural codec language models are zero-shot text to speech synthesizers

Original

Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, et al. 2023 · 2023

Later among the works it cites.

Audiodec: An open-source streaming high-fidelity neural audio codec

Yi-Chiao Wu, Israel D Gebru, Dejan Marković, and Alexander Richard. 2023 · 2023

Later among the works it cites.