BESTOW: Efficient and Streamable Speech Language Model with the Best of Two Worlds in GPT and T5

A. Graves, “Sequence transduction with recurrent neural networks,” arXiv preprint arXiv:1211.3711 , 2012

Original

2012

Earlier work this paper cites.

V. Panayotov, G. Chen, D. Povey, and S. Khudanpur, “Librispeech: an asr corpus based on public domain audio books,” in ICASSP . IEEE, 2015, pp. 5206–5210

2015

Earlier work this paper cites.

P. Bajaj et al. , “Ms marco: A human generated machine reading comprehension dataset,” arXiv preprint arXiv:1611.09268 , 2016

Original

2016

Earlier work this paper cites.

W. Chan et al. , “Listen, attend and spell: A neural network for large vocabulary conversational speech recognition,” in ICASSP . IEEE, 2016, pp. 4960–4964

2016

Earlier work this paper cites.

A. Vaswani et al. , “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017

2017

Earlier work this paper cites.

O. Kuchaiev, J. Li, H. Nguyen et al. , “NeMo: a toolkit for building ai applications using neural modules,” arXiv:1909.09577 , 2019

Original

2019

Earlier work this paper cites.

T. Brown et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020

2020

Earlier work this paper cites.

A. Conneau et al. , “Unsupervised cross-lingual representation learning for speech recognition,” arXiv preprint arXiv:2006.13979 , 2020

Original

2020

Earlier work this paper cites.

A. Gulati, J. Qin, C.-C. Chiu, N. Parmar, Y. Zhang, J. Yu, W. Han, S. Wang, Z. Zhang, Y. Wu et al. , “Conformer: Convolution-augmented transformer for speech recognition,” in Interspeech , 2020

2020

Earlier work this paper cites.

C. Raffel et al. , “Exploring the limits of transfer learning with a unified text-to-text transformer,” Journal of Machine Learning Research , vol. 21, no. 140, pp. 1–67, 2020. [Online]. Available: http://jmlr.org/papers/v21/20-074.html

2020

Earlier work this paper cites.

Q. Zhang et al. , “Transformer transducer: A streamable speech recognition model with transformer encoders and rnn-t loss,” in ICASSP . IEEE, 2020

2020

Earlier work this paper cites.

X. Ma, J. Pino, and P. Koehn, “Simulmt to simulst: Adapting simultaneous text translation to end-to-end simultaneous speech translation,” arXiv preprint arXiv:2011.02048 , 2020

Original

2020

Earlier work this paper cites.

C. Wang, A. Wu, and J. Pino, “Covost 2 and massively multilingual speech-to-text translation,” arXiv preprint arXiv:2007.10310 , 2020

Original

2020

Earlier work this paper cites.

J. Kahn et al. , “Libri-light: A benchmark for asr with limited or no supervision,” in ICASSP , 2020, pp. 7669–7673, https://github.com/facebookresearch/libri-light

2020

Earlier work this paper cites.

R. Ardila et al. , “Common voice: A massively-multilingual speech corpus,” in LREC , 2020

2020

Earlier work this paper cites.

E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “Lora: Low-rank adaptation of large language models,” arXiv preprint arXiv:2106.09685 , 2021

Original

2021

Earlier work this paper cites.

G. Chen et al. , “Gigaspeech: An evolving, multi-domain asr corpus with 10,000 hours of transcribed audio,” arXiv preprint arXiv:2106.06909 , 2021

Original

2021

Earlier work this paper cites.

J.-B. Alayrac et al. , “Flamingo: a visual language model for few-shot learning,” Advances in Neural Information Processing Systems , vol. 35, pp. 23 716–23 736, 2022

2022

Earlier work this paper cites.

A. Radford, J. W. Kim, T. Xu, G. Brockman, C. McLeavey, and I. Sutskever, “Robust speech recognition via large-scale weak supervision,” 2022

2022

Earlier work this paper cites.

A. Conneau et al. , “Xtreme-s: Evaluating cross-lingual speech representations,” arXiv preprint arXiv:2203.10752 , 2022

Original

2022

Cited alongside, same era.

S. Zhang and Y. Feng, “Information-transport-based policy for simultaneous translation,” arXiv preprint arXiv:2210.12357 , 2022

Original

2022

Cited alongside, same era.

S. Papi, M. Gaido, M. Negri, and M. Turchi, “Over-generation cannot be rewarded: Length-adaptive average lagging for simultaneous speech translation,” arXiv preprint arXiv:2206.05807 , 2022

Original

2022

Cited alongside, same era.

G. Team, “Gemini: a family of highly capable multimodal models,” arXiv preprint arXiv:2312.11805 , 2023

Original

2023

Cited alongside, same era.

D. Zhang et al. , “Speechgpt: Empowering large language models with intrinsic cross-modal conversational abilities,” arXiv preprint arXiv:2305.11000 , 2023

A. S. Hussain, S. Liu, C. Sun, and Y. Shan, “ m 2 m^{2} ugen: Multi-modal music understanding and generation with the power of large language models,” arXiv preprint arXiv:2311.11255 , 2023

Original

2023

Later among the works it cites.

V. Noroozi, S. Majumdar, A. Kumar, J. Balam, and B. Ginsburg, “Stateful fastconformer with cache-based inference for streaming automatic speech recognition,” arXiv preprint arXiv:2312.17279 , 2023

Original

2023

Later among the works it cites.

X. Ma, A. Sun, S. Ouyang, H. Inaguma, and P. Tomasello, “Efficient monotonic multihead attention,” arXiv preprint arXiv:2312.04515 , 2023

Original

2023

Later among the works it cites.

V. Agostinelli, M. Wild, M. Raffel, K. A. Fuad, and L. Chen, “Simul-llm: A framework for exploring high-quality simultaneous translation with large language models,” arXiv preprint arXiv:2312.04691 , 2023

Original

2023

Later among the works it cites.