Human-Like Intuitive Behavior and Reasoning Biases Emerged in Language Models -- and Disappeared in GPT-4

Understand

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life.

• Therefore, it is of great importance to evaluate their emerging abilities.
• In this study, we show that LLMs, most notably GPT-3, exhibit behavior that strikingly resembles human-like intuition -- and the cognitive errors that come with it.
• However, LLMs with higher cognitive capabilities, in particular ChatGPT and GPT-4, learned to avoid succumbing to these errors and perform in a hyperrational manner.