Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models

M. Post, “A call for clarity in reporting BLEU scores,” in Proceedings of the Third Conference on Machine Translation: Research Papers . Belgium, Brussels: Association for Computational Linguistics, Oct. 2018, pp. 186–191. [Online]. Available: https://www.aclweb.org/anthology/W18-6319

2018

Earlier work this paper cites.

C. Wang, A. Wu, and J. Pino, “Covost 2 and massively multilingual speech-to-text translation,” 2020

2020

Earlier work this paper cites.

X. Ma, J. Pino, and P. Koehn, “Simulmt to simulst: Adapting simultaneous text translation to end-to-end simultaneous speech translation,” arXiv preprint arXiv:2011.02048 , 2020

Original

2020

Earlier work this paper cites.

Y. Jia, M. T. Ramanovich, T. Remez, and R. Pomerantz, “Translatotron 2: High-quality direct speech-to-speech translation with voice preservation,” in International Conference on Machine Learning . PMLR, 2022, pp. 10 120–10 134

2022

Cited alongside, same era.

A. Lee, H. Gong, P.-A. Duquenne, H. Schwenk, P.-J. Chen, C. Wang, S. Popuri, Y. Adi, J. Pino, J. Gu, and W.-N. Hsu, “Textless speech-to-speech translation on real data,” 2022

2022

Cited alongside, same era.

H. Inaguma, S. Popuri, I. Kulikov, P.-J. Chen, C. Wang, Y.-A. Chung, Y. Tang, A. Lee, S. Watanabe, and J. Pino, “Unity: Two-pass direct speech-to-speech translation with discrete units,” 2022

2022

Cited alongside, same era.

S. Papi, M. Gaido, M. Negri, and M. Turchi, “Does simultaneous speech translation need simultaneous models?” arXiv preprint arXiv:2204.03783 , 2022

Original

2022

Later among the works it cites.

A. Radford, J. W. Kim, T. Xu, G. Brockman, C. McLeavey, and I. Sutskever, “Robust speech recognition via large-scale weak supervision,” 2022

2022

Later among the works it cites.

ElevenLabs, “Elevenlabs API,” https://api.elevenlabs.io/docs, 2023, accessed: 2023-04-10

2023

Closest in time.