Stress Test Evaluation for Natural Language Inference

Understand

Natural language inference (NLI) is the task of determining if a natural language hypothesis can be inferred from a given premise in a justifiable manner.

• NLI was proposed as a benchmark task for natural language understanding.
• Existing models perform well at standard datasets for NLI, achieving impressive results across different genres of text.
• However, the extent to which these models understand the semantic content of sentences is unclear.