Text Understanding in GPT-4 vs Humans

Understand

We examine whether a leading AI system GPT4 understands text as well as humans do, first using a well-established standardized test of discourse comprehension.

• On this test, GPT4 performs slightly, but not statistically significantly, better than humans given the very high level of human performance.
• Both GPT4 and humans make correct inferences about information that is not explicitly stated in the text, a critical test of understanding.
• Next, we use more difficult passages to determine whether that could allow larger differences between GPT4 and humans.