Benchmarking Language Model Creativity: A Case Study on Code Generation

Creativity

J. P. Guilford. 1950 · 1950

Earlier work this paper cites.

Creativity and intelligence: Explorations with gifted students

Robert E. Lee Faris, J. W. Getzels, and Philip W. Jackson. 1962 · 1962

Earlier work this paper cites.

Torrance tests of creative thinking

E Paul Torrance. 1966 · 1966

Earlier work this paper cites.

Intelligence and nonentrenchment

Robert J. Sternberg. 1981 · 1981

Earlier work this paper cites.

Social psychology of creativity: A consensual assessment technique

Teresa M Amabile. 1982 · 1982

Earlier work this paper cites.

Natural, unnatural, and supernatural concepts

Robert J Sternberg. 1982 · 1982

Earlier work this paper cites.

Process analytic models of creative capacities

Michael D. Mumford, Michele I. Mobley, Roni Reiter-Palmon, Charles E. Uhlman, and Lesli M. Doares. 1991 · 1991

Earlier work this paper cites.

An investment theory of creativity and its development

Robert J. Sternberg and Todd I. Lubart. 1991 · 1991

Earlier work this paper cites.

Divergent thinking is not a general trait: A multidomain training experiment

John Baer. 1994 · 1994

Earlier work this paper cites.

Dimensions of creativity

Margaret A Boden et al. 1994 · 1994

Earlier work this paper cites.

Changing the world: A framework for the study of creativity

David Henry Feldman, Mihaly Csikszentmihalyi, and Howard Gardner. 1994 · 1994

Earlier work this paper cites.

Creativity In Context: Update To The Social Psychology Of Creativity

T.M. Amabile. 1996 · 1996

Earlier work this paper cites.

Creativity: Flow and the Psychology of Discovery and Invention

M. Csikszentmihalyi. 1996 · 1996

Earlier work this paper cites.

Creative Cognition: Theory, Research, and Applications

Ronald A. Finke, Thomas B. Ward, and Steven M. Smith. 1996 · 1996

Earlier work this paper cites.

Implications of a Systems Perspective for the Study of Creativity , page 313–336. Cambridge University Press

Mihaly Csikszentmihalyi. 1998 · 1998

Earlier work this paper cites.

The Development of Creativity , page 169–186. Cambridge University Press

David Henry Feldman. 1998 · 1998

Cited alongside, same era.

Scaling laws for neural language models

Original

Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B. Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeff Wu, and Dario Amodei. 2020 · 2001

Cited alongside, same era.

Models of the creative process: Past, present and future

Todd I. Lubart. 2001 · 2001

Cited alongside, same era.

Critical creative processes

Mark A. Runco. 2003 · 2003

Cited alongside, same era.

The Cambridge Handbook of Thinking and Reasoning

K.J. Holyoak and R.G. Morrison. 2005 · 2005

Cited alongside, same era.

The Three-Ring Conception of Giftedness: A Developmental Model for Promoting Creative Productivity , page 246–279. Cambridge University Press

LLaMA: Open and efficient foundation language models

Original

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023 · 2023

Later among the works it cites.

Planning with large language models for code generation

Original

Shun Zhang, Zhenfang Chen, Yikang Shen, Mingyu Ding, Joshua B. Tenenbaum, and Chuang Gan. 2023 · 2023

Later among the works it cites.

A survey of large language models

Original

Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, Yifan Du, Chen Yang, Yushuo Chen, Zhipeng Chen, Jinhao Jiang, Ruiyang Ren, Yifan Li, Xinyu Tang, Zikang Liu, Peiyu Liu, Jian-Yun Nie, and Ji-Rong Wen. 2023 · 2023

Later among the works it cites.

Llama 3 model card

AI@Meta. 2024 · 2024

Closest in time.

The claude 3 model family: Opus, sonnet, haiku