GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks

We’d better watch out

Robert M. Solow · 1987

Earlier work this paper cites.

The dynamo and the computer: An historical perspective on the modern productivity paradox

Paul A. David · 1990

Earlier work this paper cites.

Beyond computation: Information technology, organizational transformation and business performance

Erik Brynjolfsson and Lorin M. Hitt · 2000

Earlier work this paper cites.

Measuring massive multitask language understanding

Original

Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt · 2009

Earlier work this paper cites.

Skills, tasks and technologies: Implications for employment and earnings

Daron Acemoglu and David Autor · 2011

Earlier work this paper cites.

Artificial intelligence and the modern productivity paradox: A clash of expectations and statistics

Erik Brynjolfsson, Daniel Rock, and Chad Syverson · 2017

Earlier work this paper cites.

Artificial intelligence (ai): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy

Yogesh K Dwivedi, Laurie Hughes, Elvira Ismagilova, Gert Aarts, Crispin Coombs, Tom Crick, Yanqing Duan, Rohita Dwivedi, John Edwards, Aled Eirug, et al · 2021

Earlier work this paper cites.

Gpts are gpts: An early look at the labor market impact potential of large language models, 2023

Original

Tyna Eloundou, Sam Manning, Pamela Mishkin, and Daniel Rock · 2023

Earlier work this paper cites.

Agentbench: Evaluating llms as agents

Original

Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, and Jie Tang · 2023

Cited alongside, same era.

GPQA: A graduate-level google-proof q&a benchmark

Original

David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman · 2023

Cited alongside, same era.

The rapid adoption of generative ai

Alexander Bick, Adam Blandin, and David J Deming · 2024

Cited alongside, same era.

Llm evaluators recognize and favor their own generations, 2024

Original

Arjun Panickssery, Samuel R. Bowman, and Shi Feng · 2024

Cited alongside, same era.

Clio: Privacy-preserving insights into real-world ai use

How people use chatgpt

Aaron Chatterji, Thomas Cunningham, David J Deming, Zoe Hitzig, Christopher Ong, Carl Yan Shan, and Kevin Wadman · 2025

Closest in time.

Displacement or complementarity?: The labor market impact of generative ai

Wilbur Xinyuan Chen, Suraj Srinivasan, and Saleh Zakerinia · 2025

Closest in time.

Value added by industry as a percentage of gross domestic product

Federal Reserve Bank of St. Louis · 2025

Closest in time.

Swe-lancer: Can frontier LLMs earn $1 million from real-world freelance software engineering?

Original

Samuel Miserendino, Michele Wang, Tejal Patwardhan, and Johannes Heidecke · 2025

Closest in time.

Humanity’s last exam

Original

Long Phan et al · 2025

Closest in time.

Occupational outlook – occupational data