People cannot distinguish GPT-4 from a human in a Turing test

Understand

We evaluated 3 systems (ELIZA, GPT-3.5 and GPT-4) in a randomized, controlled, and preregistered Turing test.

• Human participants had a 5 minute conversation with either a human or an AI, and judged whether or not they thought their interlocutor was human.
• GPT-4 was judged to be a human 54% of the time, outperforming ELIZA (22%) but lagging behind actual humans (67%).
• The results provide the first robust empirical demonstration that any artificial system passes an interactive 2-player Turing test.