Fetching the paper…
Reading the bibliography…
Transformer-based models have been achieving state-of-the-art results in several fields of Natural Language Processing.
Speech translation: coupling of recognition and translation
H. Ney. 1999 · 1999
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
Length of phonemes in a context of their positions in polish sentences
Magdalena Igras, Bartosz Ziółko, and Mariusz Ziółko. 2013 · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
An unsupervised probability model for speech-to-translation alignment of low-resource languages
Antonios Anastasopoulos, David Chiang, and Long Duong. 2016 · 2016
Earlier work this paper cites.
An attentional model for speech translation without transcription
Long Duong, Antonios Anastasopoulos, David Chiang, Steven Bird, and Trevor Cohn. 2016 · 2016
Earlier work this paper cites.
Rethinking the inception architecture for computer vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. 2016 · 2016
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Sequence-to-sequence models can directly translate foreign speech
Ron J Weiss, Jan Chorowski, Navdeep Jaitly, Yonghui Wu, and Zhifeng Chen. 2017 · 2017
Earlier work this paper cites.
End-to-end automatic speech translation of audiobooks
Alexandre Bérard, Laurent Besacier, Ali Can Kocabiyikoglu, and Olivier Pietquin. 2018 · 2018
Earlier work this paper cites.
Speech-transformer: A no-recurrence sequence-to-sequence model for speech recognition
Linhao Dong, Shuang Xu, and Bo Xu. 2018 · 2018
Earlier work this paper cites.
Image transformer
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, and Dustin Tran. 2018 · 2018
Cited alongside, same era.
Adapting transformer to end-to-end spoken language translation
Mattia A Di Gangi, Matteo Negri, and Marco Turchi. 2019a · 2019
Cited alongside, same era.
Similarity of neural network representations revisited
Simon Kornblith, Mohammad Norouzi, Honglak Lee, and Geoffrey Hinton. 2019 · 2019
Cited alongside, same era.
Are sixteen heads really better than one?
Paul Michel, Omer Levy, and Graham Neubig. 2019 · 2019
Cited alongside, same era.
Exploring phoneme-level speech representations for end-to-end speech translation
Elizabeth Salesky, Matthias Sperber, and Alan W Black. 2019 · 2019
Cited alongside, same era.
Analyzing multi-head self-attention: Specialized heads do the heavy lifting, the rest can be pruned
Elena Voita, David Talbot, Fedor Moiseev, Rico Sennrich, and Ivan Titov. 2019 · 2019
Efficient transformer for direct speech translation
Belen Alastruey, Gerard I. Gállego, and Marta R. Costa-jussà. 2021 · 2021
Later among the works it cites.
Cascade versus direct speech translation: Do the differences still make a difference?
Luisa Bentivogli, Mauro Cettolo, Marco Gaido, Alina Karakanta, Alberto Martinelli, Matteo Negri, and Marco Turchi. 2021 · 2021
Later among the works it cites.
On attention redundancy: A comprehensive study
Yuchen Bian, Jiaji Huang, Xingyu Cai, Jiahong Yuan, and Kenneth Church. 2021 · 2021
Later among the works it cites.
Must-c: A multilingual corpus for end-to-end speech translation
Roldano Cattoni, Mattia Antonino Di Gangi, Luisa Bentivogli, Matteo Negri, and Marco Turchi. 2021 · 2021
Later among the works it cites.
Rethinking attention with performers
Krzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamas Sarlos, Peter Hawkins, Jared Quincy Davis, Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J Colwell, and Adrian Weller. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Longformer: The long-document transformer
Iz Beltagy, Matthew E. Peters, and Arman Cohan. 2020 · 2020
Cited alongside, same era.
Analyzing redundancy in pretrained transformer models
Fahim Dalvi, Hassan Sajjad, Nadir Durrani, and Yonatan Belinkov. 2020 · 2020
Cited alongside, same era.
Attention is not only a weight: Analyzing transformers with vector norms
Goro Kobayashi, Tatsuki Kuribayashi, Sho Yokoi, and Kentaro Inui. 2020 · 2020
Cited alongside, same era.
Speech translation and the end-to-end promise: Taking stock of where we are
Matthias Sperber and Matthias Paulik. 2020 · 2020
Cited alongside, same era.
Adaptive feature selection for end-to-end speech translation
Biao Zhang, Ivan Titov, Barry Haddow, and Rico Sennrich. 2020 · 2020
Cited alongside, same era.
Enhancing transformer for end-to-end speech-to-text translation
Mattia Antonino Di Gangi, Matteo Negri, Roldano Cattoni, Roberto Dessi, and Marco Turchi. 2019b
Cited in the paper.
CTC-based compression for direct speech translation
Marco Gaido, Mauro Cettolo, Matteo Negri, and Marco Turchi. 2021 · 2021
Later among the works it cites.
Leveraging Phone Mask Training for Phonetic-Reduction-Robust E2E Uyghur Speech Recognition
Guodong Ma, Pengfei Hu, Jian Kang, Shen Huang, and Hao Huang. 2021 · 2021
Later among the works it cites.
Speechformer: Reducing information loss in direct speech translation
Sara Papi, Marco Gaido, Matteo Negri, and Marco Turchi. 2021 · 2021
Later among the works it cites.
Long range arena : A benchmark for efficient transformers
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, and Donald Metzler. 2021 · 2021
Later among the works it cites.
Enlivening redundant heads in multi-head self-attention for machine translation
Tianfu Zhang, Heyan Huang, Chong Feng, and Longbing Cao. 2021 · 2021
Later among the works it cites.