TransFusion: Transcribing Speech with Multinomial Diffusion

Movellan, J.R., Mineiro, P.: A diffusion network approach to visual speech recognition. In: AVSP (1999)

1999

Earlier work this paper cites.

Graves, A., Fernández, S., Gomez, F., Schmidhuber, J.: Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural networks. In: ICML (2006)

2006

Earlier work this paper cites.

Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. In: ICLR (2015)

2015

Earlier work this paper cites.

Panayotov, V., Chen, G., Povey, D., Khudanpur, S.: Librispeech: an ASR corpus based on public domain audio books. In: ICASSP (2015)

2015

Earlier work this paper cites.

Sohl-Dickstein, J., Weiss, E., Maheswaranathan, N., Ganguli, S.: Deep unsupervised learning using nonequilibrium thermodynamics. In: ICML (2015)

2015

Earlier work this paper cites.

Ba, J.L., Kiros, J.R., Hinton, G.E.: Layer normalization. arXiv preprint arXiv:1607.06450 (2016)

Original

2016

Earlier work this paper cites.

Hannun, A.: Sequence modeling with CTC. Distill (2017). https://doi.org/10.23915/distill.00008, https://distill.pub/2017/ctc

2017

Earlier work this paper cites.

Ramachandran, P., Zoph, B., Le, Q.V.: Searching for activation functions. arXiv preprint arXiv:1710.05941 (2017)

Original

2017

Earlier work this paper cites.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L.u., Polosukhin, I.: Attention is all you need. In: NeurIPS (2017)

2017

Cited alongside, same era.

Baevski, A., Zhou, Y., Mohamed, A., Auli, M.: wav2vec 2.0: A framework for self-supervised learning of speech representations. In: NeurIPS (2020)

2020

Cited alongside, same era.

Kahn, J., Rivière, M., Zheng, W., Kharitonov, E., Xu, Q., et al.: Libri-Light: A benchmark for ASR with limited or no supervision. In: ICASSP (2020)

2020

Cited alongside, same era.

Kong, Z., Ping, W., Huang, J., Zhao, K., Catanzaro, B.: DiffWave: A versatile diffusion model for audio synthesis. arXiv preprint arXiv:2009.09761 (2020)

Original

2020

Cited alongside, same era.

Park, D.S., Zhang, Y., Jia, Y., Han, W., Chiu, C.C., Li, B., Wu, Y., Le, Q.V.: Improved Noisy Student Training for Automatic Speech Recognition. In: Interspeech (2020)

Hoogeboom, E., Nielsen, D., Jaini, P., Forré, P., Welling, M.: Argmax flows and multinomial diffusion: Learning categorical distributions. In: NeurIPS (2021)

2021

Later among the works it cites.

Hsu, W.N., Bolte, B., Tsai, Y.H.H., Lakhotia, K., Salakhutdinov, R., et al.: HuBERT: Self-supervised speech representation learning by masked prediction of hidden units. arXiv preprint arXiv:2106.07447 (2021)

Original

2021

Later among the works it cites.

Nichol, A.Q., Dhariwal, P.: Improved denoising diffusion probabilistic models. In: PMLR (2021)

2021

Later among the works it cites.

Chen, S., Wang, C., Chen, Z., Wu, Y., Liu, S., Chen, Z., Li, J., Kanda, N., Yoshioka, T., Xiao, X., et al.: WavLM: Large-scale self-supervised pre-training for full stack speech processing. IEEE Journal of Selected Topics in Signal Processing (2022)

2022

Closest in time.