Fetching the paper…
Reading the bibliography…
Despite recent successes with neural models for sign language translation (SLT), translation quality still lags behind spoken languages because of the data scarcity and modality gap between sign video and text.
Direct Speech-to-Speech Translation with a Sequence-to-Sequence Model
Ye Jia, Ron J. Weiss, Fadi Biadsy, Wolfgang Macherey, Melvin Johnson, Zhifeng Chen, and Yonghui Wu · 1951
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu · 2002
Earlier work this paper cites.
ROUGE: A package for automatic evaluation of summaries
Chin-Yew Lin · 2004
Earlier work this paper cites.
Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural networks
Alex Graves, Santiago Fernández, and Faustino Gomez · 2006
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio · 2015
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
chrF: character n-gram F-score for automatic MT evaluation
Maja Popović · 2015
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
Neural machine translation of rare words with subword units
Rico Sennrich, Barry Haddow, and Alexandra Birch · 2016
Earlier work this paper cites.
Recurrent convolutional neural networks for continuous sign language recognition by staged optimization
Runpeng Cui, Hu Liu, and Changshui Zhang · 2017
Earlier work this paper cites.
Google’s multilingual neural machine translation system: Enabling zero-shot translation
Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, and Jeffrey Dean · 2017
Earlier work this paper cites.
One model to learn them all, 2017
Lukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani, Niki Parmar, Llion Jones, and Jakob Uszkoreit · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Neural sign language translation
Necati Cihan Camgoz, Simon Hadfield, Oscar Koller, Hermann Ney, and Richard Bowden · 2018
Earlier work this paper cites.
A call for clarity in reporting BLEU scores
Matt Post · 2018
Earlier work this paper cites.
Massively multilingual neural machine translation
Roee Aharoni, Melvin Johnson, and Orhan Firat · 2019
Earlier work this paper cites.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Earlier work this paper cites.
MuST-C: a Multilingual Speech Translation Corpus
Mattia A. Di Gangi, Roldano Cattoni, Luisa Bentivogli, Matteo Negri, and Marco Turchi · 2019
Earlier work this paper cites.
Multilingual end-to-end speech translation
Hirofumi Inaguma, Kevin Duh, Tatsuya Kawahara, and Shinji Watanabe · 2019
Earlier work this paper cites.
Weakly supervised learning with multi-stream cnn-lstm-hmms to discover sequential parallelism in sign language videos
Oscar Koller, Necati Cihan Camgoz, Hermann Ney, and Richard Bowden · 2019
Cited alongside, same era.
Characterizing and avoiding negative transfer
Zirui Wang, Zihang Dai, Barnabás Póczos, and Jaime Carbonell · 2019
Cited alongside, same era.
Multi-channel transformers for multi-articulatory sign language translation
Necati Cihan Camgoz, Oscar Koller, Simon Hadfield, and Richard Bowden · 2020
Cited alongside, same era.
Extending the Public DGS Corpus in size and depth
Thomas Hanke, Marc Schulder, Reiner Konrad, and Elena Jahn · 2020
Cited alongside, same era.
Tspnet: Hierarchical feature learning via temporal semantic pyramid for sign language translation
DongXu Li, Chenchen Xu, Xin Yu, Kaihao Zhang, Benjamin Swift, Hanna Suominen, and Hongdong Li · 2020
Cited alongside, same era.
Spatial-temporal multi-cue network for sign language recognition and translation
Hao Zhou, Wengang Zhou, Yun Zhou, and Houqiang Li · 2021
Later among the works it cites.
Using neural machine translation methods for sign language translation
Galina Angelova, Eleftherios Avramidis, and Sebastian Möller · 2022
Later among the works it cites.
data2vec: A general framework for self-supervised learning in speech, vision and language, 2022
Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, and Michael Auli · 2022
Later among the works it cites.
Vl-beit: Generative vision-language pretraining
Hangbo Bao, Wenhui Wang, Li Dong, and Furu Wei · 2022
Later among the works it cites.
mslam: Massively multilingual joint pre-training for speech and text, 2022
Ankur Bapna, Colin Cherry, Yu Zhang, Ye Jia, Melvin Johnson, Yong Cheng, Simran Khanuja, Jason Riesa, and Alexis Conneau · 2022
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ivan Provilkov, Dmitrii Emelianenko, and Elena Voita · 2020
Cited alongside, same era.
Boosting continuous sign language recognition via cross modality augmentation
Junfu Pu, Wengang Zhou, Hezhen Hu, and Houqiang Li · 2020
Cited alongside, same era.
Better sign language translation with STMC-transformer
Kayo Yin and Jesse Read · 2020
Cited alongside, same era.
Improving massively multilingual neural machine translation and zero-shot translation
Biao Zhang, Philip Williams, Ivan Titov, and Rico Sennrich · 2020
Cited alongside, same era.
Frozen pretrained transformers for neural sign language translation
Mathieu De Coster, Karel D’Oosterlinck, Marija Pizurica, Paloma Rabaey, Severine Verlinden, Mieke Van Herreweghe, and Joni Dambre · 2021
Cited alongside, same era.
Self-mutual distillation learning for continuous sign language recognition
Aiming Hao, Yuecong Min, and Xilin Chen · 2021
Cited alongside, same era.
To ship or not to ship: An extensive evaluation of automatic metrics for machine translation
Tom Kocmi, Christian Federmann, Roman Grundkiewicz, Marcin Junczys-Dowmunt, Hitokazu Matsushita, and Arul Menezes · 2021
Cited alongside, same era.
Later among the works it cites.
Explore more guidance: A task-aware instruction network for sign language translation enhanced with data augmentation
Yong Cao, Wei Li, Xianzhi Li, Min Chen, Guangyong Chen, Long Hu, Zhengdao Li, and Kai Hwang · 2022
Later among the works it cites.
A simple multi-modality transfer learning baseline for sign language translation
Yutong Chen, Fangyun Wei, Xiao Sun, Zhirong Wu, and Stephen Lin · 2022
Later among the works it cites.
Conslt: A token-level contrastive framework for sign language translation
Biao Fu, Peigen Ye, Liang Zhang, Pei Yu, Cong Hu, Yidong Chen, and Xiaodong Shi · 2022
Later among the works it cites.
Perceiver IO: A general architecture for structured inputs & outputs
Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, Olivier J Henaff, Matthew Botvinick, Andrew Zisserman, Oriol Vinyals, and Joao Carreira · 2022
Later among the works it cites.
Prior knowledge and memory enriched transformer for sign language translation
Tao Jin, Zhou Zhao, Meng Zhang, and Xingshan Zeng · 2022
Later among the works it cites.
Sign language translation with hierarchical spatio-temporal graph neural network
Jichao Kan, Kun Hu, Markus Hagenbuchner, Ah Chung Tsoi, Mohammed Bennamoun, and Zhiyong Wang · 2022
Later among the works it cites.
Highmmt: Towards modality and task generalization for high-modality representation learning
Paul Pu Liang, Yiwei Lyu, Xiang Fan, Shengtong Mo, Dani Yogatama, Louis-Philippe Morency, and Ruslan Salakhutdinov · 2022
Later among the works it cites.
Considerations for meaningful sign language machine translation based on glosses
Mathias Müller, Zifan Jiang, Amit Moryossef, Annette Rios, and Sarah Ebling · 2022
Later among the works it cites.
Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production
Ben Saunders, Necati Cihan Camgoz, and Richard Bowden · 2022
Later among the works it cites.
Unified speech-text pre-training for speech translation and recognition
Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, and Juan Pino · 2022
Later among the works it cites.
Towards efficient universal neural machine translation
Biao Zhang · 2022
Later among the works it cites.
Moses: Open source toolkit for statistical machine translation
Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondřej Bojar, Alexandra Constantin, and Evan Herbst · 2045
Closest in time.
Self-attention with relative position representations
Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani · 2074
Closest in time.