PAWS: Paraphrase Adversaries from Word Scrambling

Understand

Existing paraphrase identification datasets lack sentence pairs that have high lexical overlap without being paraphrases.

• Models trained on such data fail to distinguish pairs like flights from New York to Florida and flights from Florida to New York.
• This paper introduces PAWS (Paraphrase Adversaries from Word Scrambling), a new dataset with 108,463 well-formed paraphrase and non-paraphrase pairs with high lexical overlap.
• Challenging pairs are generated by controlled word swapping and back translation, followed by fluency and paraphrase judgments by human raters.