Better Sign Language Translation with STMC-Transformer

Understand

Sign Language Translation (SLT) first uses a Sign Language Recognition (SLR) system to extract sign language glosses from videos.

• Then, a translation system generates spoken language translations from the sign language glosses.
• This paper focuses on the translation system and introduces the STMC-Transformer which improves on the current state-of-the-art by over 5 and 7 BLEU respectively on gloss-to-text and video-to-text translation of the PHOENIX-Weather 2014T dataset.
• On the ASLG-PC12 corpus, we report an increase of over 16 BLEU.