WaBERT: A Low-resource End-to-end Model for Spoken Language Understanding and Speech-to-BERT Alignment

Schneider, S., Baevski, A., Collobert, R., Auli, M.: wav2vec: Unsupervised pre-training for speech recognition. CoRR abs/1904.05862

Original

1904

Earlier work this paper cites.

Dong, L., Xu, B.: CIF: continuous integrate-and-fire for end-to-end speech recognition. CoRR abs/1905.11235

Original

1905

Earlier work this paper cites.

Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., Stoyanov, V.: Roberta: A robustly optimized BERT pretraining approach. CoRR abs/1907.11692

Original

1907

Earlier work this paper cites.

Rabiner, L., Juang, B.: An introduction to hidden markov models. IEEE ASSP Magazine 3

1986

Earlier work this paper cites.

Baevski, A., Zhou, H., Mohamed, A., Auli, M.: wav2vec 2.0: A framework for self-supervised learning of speech representations. CoRR abs/2006.11477

Original

2006

Earlier work this paper cites.

He, P., Liu, X., Gao, J., Chen, W.: Deberta: Decoding-enhanced BERT with disentangled attention. CoRR abs/2006.03654

Original

2006

Earlier work this paper cites.

Gorman, K., Howell, J., Wagner, M.: Prosodylab-aligner: A tool for forced alignment of laboratory speech. vol. 39 (09 2011)

2011

Cited alongside, same era.

Mohammad, S.: A practical guide to sentiment annotation: Challenges and solutions. In: Proceedings of the 7th workshop on computational approaches to subjectivity, sentiment and social media analysis. pp. 174–179 (2016)

2016

Cited alongside, same era.

McAuliffe, M., Socolof, M., Mihuc, S., Wagner, M., Sonderegger, M.: Montreal forced aligner: Trainable text-speech alignment using kaldi. In: Interspeech. vol. 2017, pp. 498–502 (2017)

2017

Cited alongside, same era.

Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. CoRR abs/1810.04805

Original

2018

Cited alongside, same era.

Chen, S., Wang, C., Chen, Z., Wu, Y., Liu, S., Chen, Z., Li, J., Kanda, N., Yoshioka, T., Xiao, X., Wu, J., Zhou, L., Ren, S., Qian, Y., Qian, Y., Wu, J., Zeng, M., Wei, F.: Wavlm: Large-scale self-supervised pre-training for full stack speech processing. CoRR abs/2110.13900

Hsu, W., Bolte, B., Tsai, Y.H., Lakhotia, K., Salakhutdinov, R., Mohamed, A.: Hubert: Self-supervised speech representation learning by masked prediction of hidden units. CoRR abs/2106.07447

Original

2021

Later among the works it cites.

Shon, S., Pasad, A., Wu, F., Brusco, P., Artzi, Y., Livescu, K., Han, K.J.: SLUE: new benchmark tasks for spoken language understanding evaluation on natural speech. CoRR abs/2111.10367

Original

2021

Later among the works it cites.

Baevski, A., Hsu, W., Xu, Q., Babu, A., Gu, J., Auli, M.: data2vec: A general framework for self-supervised learning in speech, vision and language. CoRR abs/2202.03555

Original

2022

Closest in time.

Deng, K., Cao, S., Zhang, Y., Ma, L., Cheng, G., Xu, J., Zhang, P.: Improving ctc-based speech recognition via knowledge transferring from pre-trained language models (2022). https://doi.org/10.48550/ARXIV.2203.03582, https://arxiv.org/abs/2203.03582

Original

2022

Closest in time.