Decision Attentive Regularization to Improve Simultaneous Speech Translation Systems

Understand

Simultaneous translation systems start producing the output while processing the partial source sentence in the incoming input stream.

• These systems need to decide when to read more input and when to write the output.
• These decisions depend on the structure of source/target language and the information contained in the partial input sequence.
• Hence, read/write decision policy remains the same across different input modalities, i.e., speech and text.