"John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibility

Understand

In current NLP research, large-scale language models and their abilities are widely being discussed.

• Some recent works have also found notable failures of these models.
• Often these failure examples involve complex reasoning abilities.
• This work focuses on a simple commonsense ability, reasoning about when an action (or its effect) is feasible.