What If We Simply Swap the Two Text Fragments? A Straightforward yet Effective Way to Test the Robustness of Methods to Confounding Signals in Nature Language Inference Tasks

Understand

Nature language inference (NLI) task is a predictive task of determining the inference relationship of a pair of natural language sentences.

• With the increasing popularity of NLI, many state-of-the-art predictive models have been proposed with impressive performances.
• However, several works have noticed the statistical irregularities in the collected NLI data set that may result in an over-estimated performance of these models and proposed remedies.
• In this paper, we further investigate the statistical irregularities, what we refer as confounding factors, of the NLI data sets.