Incorporating Copying Mechanism in Sequence-to-Sequence Learning

Understand

We address an important problem in sequence-to-sequence (Seq2Seq) learning referred to as copying, in which certain segments in the input sequence are selectively replicated in the output sequence.

• A similar phenomenon is observable in human language communication.
• For example, humans tend to repeat entity names or even long phrases in conversation.
• The challenge with regard to copying in Seq2Seq is that new machinery is needed to decide when to perform the operation.