F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching

Libritts: A corpus derived from librispeech for text-to-speech

Original

Heiga Zen, Viet Dang, Rob Clark, Yu Zhang, Ron J Weiss, Ye Jia, Zhifeng Chen, and Yonghui Wu. 2019 · 1904

Earlier work this paper cites.

Common voice: A massively-multilingual speech corpus

Original

Rosana Ardila, Megan Branson, Kelly Davis, Michael Henretty, Michael Kohler, Josh Meyer, Reuben Morais, Lindsay Saunders, Francis M Tyers, and Gregor Weber. 2019 · 1912

Earlier work this paper cites.

Logistic-normal distributions: Some properties and uses

Jhon Atchison and Sheng M Shen. 1980 · 1980

Earlier work this paper cites.

Fastspeech 2: Fast and high-quality end-to-end text to speech

Original

Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, and Tie-Yan Liu. 2020 · 2006

Earlier work this paper cites.

Score-based generative modeling through stochastic differential equations

Original

Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. 2020 · 2011

Earlier work this paper cites.

U-net: Convolutional networks for biomedical image segmentation

Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015 · 2015

Earlier work this paper cites.

The LJ speech dataset

Keith Ito and Linda Johnson. 2017 · 2017

Earlier work this paper cites.

Decoupled weight decay regularization

Original

I Loshchilov. 2017 · 2017

Earlier work this paper cites.

torchdiffeq

Ricky T. Q. Chen. 2018 · 2018

Earlier work this paper cites.

Natural TTS synthesis by conditioning wavenet on mel spectrogram predictions

Jonathan Shen, Ruoming Pang, Ron J Weiss, Mike Schuster, et al. 2018 · 2018

Earlier work this paper cites.

Neural speech synthesis with transformer network

Naihan Li, Shujie Liu, Yanqing Liu, Sheng Zhao, and Ming Liu. 2019 · 2019

Earlier work this paper cites.

Denoising diffusion probabilistic models

Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020 · 2020

Earlier work this paper cites.

Libri-light: A benchmark for ASR with limited or no supervision

Jacob Kahn, Morgane Riviere, Weiyi Zheng, Evgeny Kharitonov, et al. 2020 · 2020

Earlier work this paper cites.

Glow-TTS: A generative flow for text-to-speech via monotonic alignment search

Jaehyeon Kim, Sungwon Kim, Jungil Kong, and Sungroh Yoon. 2020 · 2020

Earlier work this paper cites.

Diffusion models beat gans on image synthesis

Prafulla Dhariwal and Alexander Nichol. 2021 · 2021

Earlier work this paper cites.

Didispeech: A large scale Mandarin speech corpus

Tingwei Guo, Cheng Wen, Dongwei Jiang, Ne Luo, et al. 2021 · 2021

Earlier work this paper cites.

Hubert: Self-supervised speech representation learning by masked prediction of hidden units

Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, and Abdelrahman Mohamed. 2021 · 2021

Earlier work this paper cites.

Conditional variational autoencoder with adversarial learning for end-to-end text-to-speech

Jaehyeon Kim, Jungil Kong, and Juhee Son. 2021 · 2021

Earlier work this paper cites.

Grad-tts: A diffusion probabilistic model for text-to-speech

Vadim Popov, Ivan Vovk, Vladimir Gogoryan, Tasnima Sadekova, and Mikhail Kudinov. 2021 · 2021

Earlier work this paper cites.

Train short, test long: Attention with linear biases enables input length extrapolation

Original

Ofir Press, Noah A Smith, and Mike Lewis. 2021 · 2021

Earlier work this paper cites.

Soundstream: An end-to-end neural audio codec

Neil Zeghidour, Alejandro Luebs, Ahmed Omran, Jan Skoglund, and Marco Tagliasacchi. 2021 · 2021

Earlier work this paper cites.

A3t: Alignment-aware acoustic and text pretraining for speech synthesis and editing

He Bai, Renjie Zheng, Junkun Chen, Mingbo Ma, Xintong Li, and Liang Huang. 2022 · 2022

Earlier work this paper cites.

Large-scale self-supervised speech representation learning for automatic speaker verification

Zhengyang Chen, Sanyuan Chen, Yu Wu, Yao Qian, Chengyi Wang, Shujie Liu, Yanmin Qian, and Michael Zeng. 2022 · 2022

Cited alongside, same era.

High fidelity neural audio compression

Original

Alexandre Défossez, Jade Copet, Gabriel Synnaeve, and Yossi Adi. 2022 · 2022

Cited alongside, same era.

Classifier-free diffusion guidance

Original

Jonathan Ho and Tim Salimans. 2022 · 2022

Cited alongside, same era.

Bigvgan: A universal neural vocoder with large-scale training

Original

Sang-gil Lee, Wei Ping, Boris Ginsburg, Bryan Catanzaro, and Sungroh Yoon. 2022 · 2022

Cited alongside, same era.

Flow matching for generative modeling

Original

VALL-E R: Robust and efficient zero-shot text-to-speech synthesis via monotonic alignment

Original

Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, and Furu Wei. 2024 · 2024

Closest in time.

Emilia: An extensive, multilingual, and diverse speech dataset for large-scale speech generation

Original

Haorui He, Zengqiang Shang, Chaoren Wang, Xuyuan Li, et al. 2024 · 2024

Closest in time.

Naturalspeech 3: Zero-shot speech synthesis with factorized codec and diffusion models

Original

Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, et al. 2024 · 2024

Closest in time.

Libriheavy: a 50,000 hours asr corpus with punctuation casing and context

Wei Kang, Xiaoyu Yang, Zengwei Yao, Fangjun Kuang, Yifan Yang, Liyong Guo, Long Lin, and Daniel Povey. 2024 · 2024

Closest in time.