ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systems

Understand

The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI), introduced in 2019, established a challenging benchmark for evaluating the general fluid intelligence of artificial systems via a set of unique, novel tasks only requiring minimal prior knowledge.

• While ARC-AGI has spurred significant research activity over the past five years, recent AI progress calls for benchmarks capable of finer-grained evaluation at higher levels of cognitive complexity.
• We introduce ARC-AGI-2, an upgraded version of the benchmark.
• ARC-AGI-2 preserves the input-output pair task format of its predecessor, ensuring continuity for researchers.