Fetching the paper…
Reading the bibliography…
Recent progress in large-scale zero-shot speech synthesis has been significantly advanced by language models and diffusion models.
Deterministic edge-preserving regularization in computed imaging
Pierre Charbonnier, Laure Blanc-Féraud, Gilles Aubert, and Michel Barlaud. 1997 · 1997
Earlier work this paper cites.
The jensen-shannon divergence
ML Menéndez, JA Pardo, L Pardo, and MC Pardo. 1997 · 1997
Earlier work this paper cites.
Librispeech: an asr corpus based on public domain audio books. In Proc. IEEE Intl. Conf. Acoustics, Speech, Signal Process. (ICASSP) . IEEE
Vassil Panayotov, Guoguo Chen, Daniel Povey, and Sanjeev Khudanpur. 2015 · 2015
Earlier work this paper cites.
Wavenet: A generative model for raw audio
Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. 2016 · 2016
Earlier work this paper cites.
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks
Tim Salimans and Diederik P. Kingma. 2016 · 2016
Earlier work this paper cites.
The LJ Speech Dataset
Keith Ito and Linda Johnson. 2017 · 2017
Earlier work this paper cites.
Tacotron: Towards End-to-End Speech Synthesis. In Proc. Interspeech
Yuxuan Wang, RJ Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Zhifeng Chen, Samy Bengio, et al · 2017
Earlier work this paper cites.
cGANs with Projection Discriminator. In Proc. Intl. Conf. Learning Representations (ICLR)
Takeru Miyato and Masanori Koyama. 2018 · 2018
Earlier work this paper cites.
Neural speech synthesis with transformer network. In Proc. AAAI Conf. Artif. Intell. (AAAI)
Naihan Li, Shujie Liu, Yanqing Liu, Sheng Zhao, and Ming Liu. 2019 · 2019
Earlier work this paper cites.
Fastspeech: Fast, robust and controllable text to speech
Yi Ren, Yangjun Ruan, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, and Tie-Yan Liu. 2019 · 2019
Earlier work this paper cites.
Token-level ensemble distillation for grapheme-to-phoneme conversion. In Proc. Interspeech
Hao Sun, Xu Tan, Jun-Wei Gan, Hongzhi Liu, Sheng Zhao, Tao Qin, and Tie-Yan Liu. 2019 · 2019
Earlier work this paper cites.
CSTR VCTK Corpus: English Multi-speaker Corpus for CSTR Voice Cloning Toolkit (version 0.92)
Junichi Yamagishi, Christophe Veaux, and Kirsten MacDonald. 2019 · 2019
Earlier work this paper cites.
wav2vec 2.0: A framework for self-supervised learning of speech representations. In Proc. Conf. Neural Information Processing Systems (NeurIPS)
Alexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, and Michael Auli. 2020 · 2020
Earlier work this paper cites.
Mls: A large-scale multilingual dataset for speech research
Vineel Pratap, Qiantong Xu, Anuroop Sriram, Gabriel Synnaeve, and Ronan Collobert. 2020 · 2020
Earlier work this paper cites.
FastSpeech 2: Fast and High-Quality End-to-End Text to Speech. In Proc. Intl. Conf. Learning Representations (ICLR)
Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, and Tie-Yan Liu. 2020 · 2020
Earlier work this paper cites.
Generating synthetic audio data for attention-based speech recognition systems. In Proc. IEEE Intl. Conf. Acoustics, Speech, Signal Process. (ICASSP)
Nick Rossenbach, Albert Zeyer, Ralf Schlüter, and Hermann Ney. 2020 · 2020
Earlier work this paper cites.
Score-Based Generative Modeling through Stochastic Differential Equations. In Proc. Intl. Conf. Learning Representations (ICLR)
Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. 2020 · 2020
Earlier work this paper cites.
Gigaspeech: An evolving, multi-domain asr corpus with 10,000 hours of transcribed audio
Guoguo Chen, Shuzhou Chai, Guanbo Wang, Jiayu Du, Wei-Qiang Zhang, Chao Weng, Dan Su, Daniel Povey, Jan Trmal, Junbo Zhang, et al · 2021
Earlier work this paper cites.
Taming transformers for high-resolution image synthesis. In Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn (CVPR)
Patrick Esser, Robin Rombach, and Bjorn Ommer. 2021 · 2021
Earlier work this paper cites.
Hubert: Self-supervised speech representation learning by masked prediction of hidden units
Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, and Abdelrahman Mohamed. 2021 · 2021
Earlier work this paper cites.
Diff-tts: A denoising diffusion model for text-to-speech
Myeonghun Jeong, Hyeongju Kim, Sung Jun Cheon, Byoung Jin Choi, and Nam Soo Kim. 2021 · 2021
Earlier work this paper cites.
A survey on neural speech synthesis
Xu Tan, Tao Qin, Frank Soong, and Tie-Yan Liu. 2021 · 2021
Cited alongside, same era.
Yourtts: Towards zero-shot multi-speaker tts and zero-shot voice conversion for everyone. In Proc. Intl. Conf. Machine Learning (ICML)
Edresson Casanova, Julian Weber, Christopher D Shulby, Arnaldo Candido Junior, Eren Gölge, and Moacir A Ponti. 2022 · 2022
Cited alongside, same era.
Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions
Sitan Chen, Sinho Chewi, Jerry Li, Yuanzhi Li, Adil Salim, and Anru R Zhang. 2022a · 2022
Cited alongside, same era.
Wavlm: Large-scale self-supervised pre-training for full stack speech processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, et al · 2022
Cited alongside, same era.
Cm-gan: Stabilizing gan training with consistency models. In ICML 2023 Workshop on Structured Probabilistic Inference and Generative Modeling
Haoye Lu, Yiwei Lu, Dihong Jiang, Spencer Ryan Szabados, Sun Sun, and Yaoliang Yu. 2023 · 2023
Later among the works it cites.
Latent consistency models: Synthesizing high-resolution images with few-step inference
Simian Luo, Yiqin Tan, Longbo Huang, Jian Li, and Hang Zhao. 2023 · 2023
Later among the works it cites.
A comprehensive survey on knowledge distillation of diffusion models
Weijian Luo. 2023 · 2023
Later among the works it cites.
Adversarial diffusion distillation
Axel Sauer, Dominik Lorenz, Andreas Blattmann, and Robin Rombach. 2023 · 2023
Later among the works it cites.
Improved Techniques for Training Consistency Models. In Proc. Intl. Conf. Learning Representations (ICLR)
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Alexandre Défossez, Jade Copet, Gabriel Synnaeve, and Yossi Adi. 2022 · 2022
Cited alongside, same era.
Elucidating the design space of diffusion-based generative models. In Proc. Conf. Neural Information Processing Systems (NeurIPS)
Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. 2022 · 2022
Cited alongside, same era.
Flow Matching for Generative Modeling. In Proc. Intl. Conf. Learning Representations (ICLR)
Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matthew Le. 2022 · 2022
Cited alongside, same era.
Diffusion autoencoders: Toward a meaningful and decodable representation. In Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn (CVPR)
Konpat Preechakul, Nattanat Chatthee, Suttisak Wizadwongsa, and Supasorn Suwajanakorn. 2022 · 2022
Cited alongside, same era.
Revisiting Over-Smoothness in Text to Speech. In Proc. Assoc. for Computational Linguistics (ACL
Yi Ren, Xu Tan, Tao Qin, Zhou Zhao, and Tie-Yan Liu. 2022 · 2022
Cited alongside, same era.
High-resolution image synthesis with latent diffusion models. In Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn (CVPR)
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022 · 2022
Cited alongside, same era.
Utmos: Utokyo-sarulab system for voicemos challenge 2022
Takaaki Saeki, Detai Xin, Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, and Hiroshi Saruwatari. 2022 · 2022
Cited alongside, same era.
Wenetspeech: A 10000+ hours multi-domain mandarin corpus for speech recognition. In Proc. IEEE Intl. Conf. Acoustics, Speech, Signal Process. (ICASSP)
Binbin Zhang, Hang Lv, Pengcheng Guo, Qijie Shao, Chao Yang, Lei Xie, Xin Xu, Hui Bu, Xiaoyu Chen, Chenchen Zeng, et al · 2022
Cited alongside, same era.
Yang Song and Prafulla Dhariwal. 2023 · 2023
Later among the works it cites.
Consistency models. In Proc. Intl. Conf. Machine Learning (ICML)
Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever. 2023 · 2023
Later among the works it cites.
Audiobox: Unified audio generation with natural language prompts
Apoorv Vyas, Bowen Shi, Matthew Le, Andros Tjandra, Yi-Chiao Wu, Baishan Guo, Jiemin Zhang, Xinyue Zhang, Robert Adkins, William Ngan, et al · 2023
Later among the works it cites.
Neural codec language models are zero-shot text to speech synthesizers
Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, et al · 2023
Later among the works it cites.
Lm-vc: Zero-shot voice conversion via speech generation based on language models
Zhichao Wang, Yuanzhe Chen, Lei Xie, Qiao Tian, and Yuping Wang. 2023b · 2023
Later among the works it cites.
Uniaudio: An audio foundation model toward universal audio generation
Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, et al · 2023
Later among the works it cites.
CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model. In Proc. ACM Multimedia (ACM MM)
Zhen Ye, Wei Xue, Xu Tan, Jie Chen, Qifeng Liu, and Yike Guo. 2023 · 2023
Later among the works it cites.
Speak foreign languages with your own voice: Cross-lingual neural codec language modeling
Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, et al · 2023
Later among the works it cites.
A survey of large language models
Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al · 2023
Later among the works it cites.
Dddm-vc: Decoupled denoising diffusion models with disentangled representation and prior mixup for verified robust voice conversion. In Proc. AAAI Conf. Artif. Intell. (AAAI)
Ha-Yeong Choi, Sang-Hoon Lee, and Seong-Whan Lee. 2024 · 2024
Closest in time.
MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech
Shengpeng Ji, Ziyue Jiang, Hanting Wang, Jialong Zuo, and Zhou Zhao. 2024 · 2024
Closest in time.
CLaM-TTS: Improving Neural Codec Language Model for Zero-Shot Text-to-Speech. In Proc. Intl. Conf. Learning Representations (ICLR)
Jaehyeon Kim, Keon Lee, Seungjun Chung, and Jaewoong Cho. 2024 · 2024
Closest in time.
CoMoSVC: Consistency Model-based Singing Voice Conversion
Yiwen Lu, Zhen Ye, Wei Xue, Xu Tan, Qifeng Liu, and Yike Guo. 2024 · 2024
Closest in time.
Sampling is as easy as keeping the consistency: convergence guarantee for Consistency Models
Junlong Lyu, Zhitang Chen, and Shoubo Feng. 2024 · 2024
Closest in time.
VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild
Puyuan Peng, Po-Yao Huang, Daniel Li, Abdelrahman Mohamed, and David Harwath. 2024 · 2024
Closest in time.
NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers. In Proc. Intl. Conf. Learning Representations (ICLR)
Kai Shen, Zeqian Ju, Xu Tan, Eric Liu, Yichong Leng, Lei He, Tao Qin, sheng zhao, and Jiang Bian. 2024 · 2024
Closest in time.