Does GPT-4 surpass human performance in linguistic pragmatics?

Understand

As Large Language Models (LLMs) become increasingly integrated into everyday life as general purpose multimodal AI systems, their capabilities to simulate human understanding are under examination.

• This study investigates LLMs ability to interpret linguistic pragmatics, which involves context and implied meanings.
• Using Grice communication principles, we evaluated both LLMs (GPT-2, GPT-3, GPT-3.5, GPT-4, and Bard) and human subjects (N = 147) on dialogue-based tasks.
• Human participants included 71 primarily Serbian students and 76 native English speakers from the United States.