In-Context Learning May Not Elicit Trustworthy Reasoning: A-Not-B Errors in Pretrained Language Models

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Winogrande: An adversarial winograd schema challenge at scale

Original

Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. 2019 · 1907

Earlier work this paper cites.

Delay of gratification in children

Walter Mischel, Yuichi Shoda, and Monica L Rodriguez. 1989 · 1989

Earlier work this paper cites.

Predicting adolescent cognitive and self-regulatory competencies from preschool delay of gratification: Identifying diagnostic conditions

Yuichi Shoda, Walter Mischel, and Philip K Peake. 1990 · 1990

Earlier work this paper cites.

Working memory

Alan Baddeley. 1992 · 1992

Earlier work this paper cites.

Inhibitory control as a contributor to conscience in childhood: From toddler to early school age

Grazyna Kochanska, Kathleen Murray, and Katherine C Coy. 1997 · 1997

Earlier work this paper cites.

Executive function in preschoolers: Links with theory of mind and verbal ability

Claire Hughes. 1998 · 1998

Earlier work this paper cites.

Structural and functional brain development and its relation to cognitive development

BJ Casey, Jay N Giedd, and Kathleen M Thomas. 2000 · 2000

Earlier work this paper cites.

The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis

Akira Miyake, Naomi P Friedman, Michael J Emerson, Alexander H Witzki, Amy Howerter, and Tor D Wager. 2000 · 2000

Earlier work this paper cites.

Development of executive functions through late childhood and adolescence in an australian sample

Vicki A Anderson, Peter Anderson, Elisabeth Northam, Rani Jacobs, and Cathy Catroppa. 2001 · 2001

Earlier work this paper cites.

Individual differences in inhibitory control and children’s theory of mind

Stephanie M Carlson and Louis J Moses. 2001 · 2001

Earlier work this paper cites.

Assessment and development of executive function (ef) during childhood

Peter Anderson. 2002 · 2002

Earlier work this paper cites.

School readiness: Integrating cognition and emotion in a neurobiological conceptualization of children’s functioning at school entry

Clancy Blair. 2002 · 2002

Earlier work this paper cites.

Conditions under which young children can hold two rules in mind and inhibit a prepotent response

Adele Diamond, Natasha Kirkham, and Dima Amso. 2002 · 2002

Earlier work this paper cites.

How Neural Networks Learn from Experience

Geoffrey E. Hinton. 2002 · 2002

Earlier work this paper cites.

Self-discipline outdoes iq in predicting academic performance of adolescents

Angela L Duckworth and Martin EP Seligman. 2005 · 2005

Earlier work this paper cites.

The development of embodied cognition: Six lessons from babies

Linda Smith and Michael Gasser. 2005 · 2005

Earlier work this paper cites.

Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten

Clancy Blair and Rachel Peters Razza. 2007 · 2007

Earlier work this paper cites.

Executive function in preschoolers: a review using an integrative framework

Nancy Garon, Susan E Bryson, and Isabel M Smith. 2008 · 2008

Earlier work this paper cites.

Fundamentals of human neuropsychology

Bryan Kolb and Ian Q Whishaw. 2009 · 2009

Earlier work this paper cites.

A developmental perspective on executive function

John R Best and Patricia H Miller. 2010 · 2010

Earlier work this paper cites.

A delay-discounting primer

Gregory J Madden and Patrick S Johnson. 2010 · 2010

Earlier work this paper cites.

Learning from experience

Jeffrey Yip and Meena Wilson. 2010 · 2010

Earlier work this paper cites.

Investigating how infants learn to search in the a-not-b task

Hanna Popick, Melody Dye, Natasha Kirkham, and Michael Ramscar. 2011 · 2011

Earlier work this paper cites.

The processes underlying flexibility in childhood

Lucy Cragg and Nicolas Chevalier. 2012 · 2012

Earlier work this paper cites.

A-not-b errors: testing the limits of natural pedagogy theory

Marion Vorms. 2012 · 2012

Earlier work this paper cites.

Executive functions

Adele Diamond. 2013 · 2013

Earlier work this paper cites.

Adolescent cognitive control and reward processing: implications for risk taking and substance use

Charles F Geier. 2013 · 2013

Earlier work this paper cites.

Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension

Original

Mandar Joshi, Eunsol Choi, Daniel S. Weld, and Luke Zettlemoyer. 2017 · 2017

Cited alongside, same era.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

Crowdsourcing multiple choice science questions

Original

Johannes Welbl, Nelson F. Liu, and Matt Gardner. 2017 · 2017

Cited alongside, same era.

Think you have solved question answering? try arc, the ai2 reasoning challenge

Original

Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018 · 2018

Cited alongside, same era.

Trajectories of infants’ biobehavioral development: Timing and rate of a-not-b performance gains and eeg maturation

Exploring and improving the spatial reasoning abilities of large language models

Manasi Sharma. 2023 · 2023

Later among the works it cites.

Large language models can be lazy learners: Analyze shortcuts in in-context learning

Original

Ruixiang Tang, Dehan Kong, Longtao Huang, and Hui Xue. 2023 · 2023

Later among the works it cites.

Fast yet effective machine unlearning

Ayush K Tarun, Vikram S Chundawat, Murari Mandal, and Mohan Kankanhalli. 2023 · 2023

Later among the works it cites.

Emergent analogical reasoning in large language models

Taylor Webb, Keith J Holyoak, and Hongjing Lu. 2023 · 2023

Later among the works it cites.

Chain-of-thought prompting elicits reasoning in large language models

Original

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou. 2023 · 2023

Later among the works it cites.