Sparks of Artificial General Intelligence: Early experiments with GPT-4

Understand

Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition.

• The latest model developed by OpenAI, GPT-4, was trained using an unprecedented scale of compute and data.
• In this paper, we report on our investigation of an early version of GPT-4, when it was still in active development by OpenAI.
• We contend that (this early version of) GPT-4 is part of a new cohort of LLMs (along with ChatGPT and Google's PaLM for example) that exhibit more general intelligence than previous AI models.