Fetching the paper…
Reading the bibliography…
What can be learned about causality and experimentation from passive data? This question is salient given recent successes of passively-trained language models in interactive domains such as tool use.
Movement-produced stimulation in the development of visually guided behavior
Richard Held and Alan Hein · 1963
Earlier work this paper cites.
The structure and function of explanations
Tania Lombrozo · 2006
Earlier work this paper cites.
Functional explanation and the function of explanation
Tania Lombrozo and Susan Carey · 2006
Earlier work this paper cites.
Intrinsic motivation systems for autonomous mental development
Pierre-Yves Oudeyer, Frdric Kaplan, and Verena V Hafner · 2007
Earlier work this paper cites.
A reduction of imitation learning and structured prediction to no-regret online learning
Stéphane Ross, Geoffrey Gordon, and Drew Bagnell · 2011
Earlier work this paper cites.
Frederick Eberhardt, Clark Glymour, and Richard Scheines · 2012
Earlier work this paper cites.
Self-directed learning: A cognitive and computational perspective
Todd M Gureckis and Douglas B Markant · 2012
Earlier work this paper cites.
Identifiability of causal graphs using functional models
Jonas Peters, Joris Mooij, Dominik Janzing, and Bernhard Schölkopf · 2012
Earlier work this paper cites.
Rectifier nonlinearities improve neural network acoustic models
Andrew L Maas, Awni Y Hannun, Andrew Y Ng, et al · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Is it better to select or to receive? learning via active and passive hypothesis testing
Douglas B Markant and Todd M Gureckis · 2014
Earlier work this paper cites.
Identifiability of gaussian structural equation models with equal error variances
Jonas Peters and Peter Bühlmann · 2014
Earlier work this paper cites.
Causal inference in statistics: A primer
Madelyn Glymour, Judea Pearl, and Nicholas P Jewell · 2016
Earlier work this paper cites.
Interactive perception: Leveraging action in perception and perception in action
Jeannette Bohg, Karol Hausman, Bharath Sankaran, Oliver Brock, Danica Kragic, Stefan Schaal, and Gaurav S Sukhatme · 2017
Earlier work this paper cites.
Deep reinforcement learning from human preferences
Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei · 2017
Earlier work this paper cites.
Building machines that learn and think like people
Brenden M Lake, Tomer D Ullman, Joshua B Tenenbaum, and Samuel J Gershman · 2017
Earlier work this paper cites.
JAX: composable transformations of Python+NumPy programs, 2018
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang · 2018
Earlier work this paper cites.
Patrick Forré and Joris M Mooij · 2018
Earlier work this paper cites.
Theoretical impediments to machine learning with seven sparks from the causal revolution
Judea Pearl · 2018
Earlier work this paper cites.
Transformer-xl: Attentive language models beyond a fixed-length context
Zihang Dai, Zhilin Yang, Yiming Yang, Jaime Carbonell, Quoc V Le, and Ruslan Salakhutdinov · 2019
Earlier work this paper cites.
Causal reasoning from meta-reinforcement learning
Ishita Dasgupta, Jane Wang, Silvia Chiappa, Jovana Mitrovic, Pedro Ortega, David Raposo, Edward Hughes, Peter Battaglia, Matthew Botvinick, and Zeb Kurth-Nelson · 2019
Earlier work this paper cites.
Causal confusion in imitation learning
Pim De Haan, Dinesh Jayaraman, and Sergey Levine · 2019
Earlier work this paper cites.
Off-policy deep reinforcement learning without exploration
Scott Fujimoto, David Meger, and Doina Precup · 2019
Earlier work this paper cites.
Review of causal discovery methods based on graphical models
Clark Glymour, Kun Zhang, and Peter Spirtes · 2019
Earlier work this paper cites.
Stabilizing off-policy q-learning via bootstrapping error reduction
Aviral Kumar, Justin Fu, Matthew Soh, George Tucker, and Sergey Levine · 2019
Cited alongside, same era.
Causal induction from visual observations for goal directed tasks
Suraj Nair, Yuke Zhu, Silvio Savarese, and Li Fei-Fei · 2019
Cited alongside, same era.
The seven tools of causal inference, with reflections on machine learning
Judea Pearl · 2019
Cited alongside, same era.
Reinforcement learning upside down: Don’t predict rewards–just map them to actions
Juergen Schmidhuber · 2019
Cited alongside, same era.
Training agents using upside-down reinforcement learning
Rupesh Kumar Srivastava, Pranav Shyam, Filipe Mutz, Wojciech Jaśkowski, and Jürgen Schmidhuber · 2019
Cited alongside, same era.
Differentiable causal discovery under latent interventions
Gonçalo Rui Alves Faria, Andre Martins, and Mário AT Figueiredo · 2022
Later among the works it cites.
Training compute-optimal large language models
Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, et al · 2022
Later among the works it cites.
Learning to induce causal structure
Nan Rosemary Ke, Silvia Chiappa, Jane Wang, Jorg Bornschein, Theophane Weber, Anirudh Goyal, Matthew Botvinic, Michael Mozer, and Danilo Jimenez Rezende · 2022
Later among the works it cites.
Inference from explanation
Lara Kirfel, Thomas Icard, and Tobias Gerstenberg · 2022
Later among the works it cites.
Large language models are zero-shot reasoners
Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa · 2022
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
An optimistic perspective on offline reinforcement learning
Rishabh Agarwal, Dale Schuurmans, and Mohammad Norouzi · 2020
Cited alongside, same era.
Climbing towards NLU: On meaning, form, and understanding in the age of data
Emily M Bender and Alexander Koller · 2020
Cited alongside, same era.
Haiku: Sonnet for JAX, 2020
Tom Hennigan, Trevor Cai, Tamara Norman, and Igor Babuschkin · 2020
Cited alongside, same era.
The curious case of neural text degeneration
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi · 2020
Cited alongside, same era.
WT5?! training text-to-text models to explain their predictions
Sharan Narang, Colin Raffel, Katherine Lee, Adam Roberts, Noah Fiedel, and Karishma Malkan · 2020
Cited alongside, same era.
Causal imitation learning with unobserved confounders
Junzhe Zhang, Daniel Kumor, and Elias Bareinboim · 2020
Cited alongside, same era.
Foundations of structural causal models with cycles and latent variables
Stephan Bongers, Patrick Forré, Jonas Peters, and Joris M Mooij · 2021
Cited alongside, same era.
Later among the works it cites.
Towards understanding how machines can learn causal overhypotheses
Eliza Kosoy, David M Chan, Adrian Liu, Jasmine Collins, Bryanna Kaufmann, Sandy Han Huang, Jessica B Hamrick, John Canny, Nan Rosemary Ke, and Alison Gopnik · 2022
Later among the works it cites.
Alcohol consumption and cardiovascular health
Chayakrit Krittanawong, Ameesh Isath, Robert S Rosenson, Muzamil Khawaja, Zhen Wang, Sonya E Fogg, Salim S Virani, Lu Qi, Yin Cao, Michelle T Long, et al · 2022
Later among the works it cites.
In-context reinforcement learning with algorithm distillation
Michael Laskin, Luyu Wang, Junhyuk Oh, Emilio Parisotto, Stephen Spencer, Richie Steigerwald, DJ Strouse, Steven Hansen, Angelos Filos, Ethan Brooks, et al · 2022
Later among the works it cites.
Emergent world representations: Exploring a sequence model trained on a synthetic task
Kenneth Li, Aspen K Hopkins, David Bau, Fernanda Viégas, Hanspeter Pfister, and Martin Wattenberg · 2022
Later among the works it cites.
Bayesian learning of causal structure and mechanisms with gflownets and variational bayes
Mizu Nishikawa-Toomey, Tristan Deleu, Jithendaraa Subramanian, Yoshua Bengio, and Laurent Charlin · 2022
Later among the works it cites.
Training language models to follow instructions with human feedback
Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022
Later among the works it cites.
Challenging big-bench tasks and whether chain-of-thought can solve them
Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V Le, Ed H Chi, Denny Zhou, et al · 2022
Later among the works it cites.
Chain of thought prompting elicits reasoning in large language models
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Ed Chi, Quoc Le, and Denny Zhou · 2022
Later among the works it cites.
Teaching algorithmic reasoning via in-context learning
Hattie Zhou, Azade Nova, Hugo Larochelle, Aaron Courville, Behnam Neyshabur, and Hanie Sedghi · 2022
Later among the works it cites.
Grounding large language models in interactive environments with online reinforcement learning
Thomas Carta, Clément Romac, Thomas Wolf, Sylvain Lamprier, Olivier Sigaud, and Pierre-Yves Oudeyer · 2023
Closest in time.
Distilling step-by-step! outperforming larger language models with less training data and smaller model sizes
Cheng-Yu Hsieh, Chun-Liang Li, Chih-Kuan Yeh, Hootan Nakhost, Yasuhisa Fujii, Alexander Ratner, Ranjay Krishna, Chen-Yu Lee, and Tomas Pfister · 2023
Closest in time.
Learning how to infer partial mdps for in-context adaptation and exploration
Chentian Jiang, Nan Rosemary Ke, and Hado van Hasselt · 2023
Closest in time.
Causal reasoning and large language models: Opening a new frontier for causality
Emre Kıcıman, Robert Ness, Amit Sharma, and Chenhao Tan · 2023
Closest in time.
Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig · 2023
Closest in time.
Why think step-by-step? reasoning emerges from the locality of experience
Ben Prystawski and Noah D Goodman · 2023
Closest in time.
Toolformer: Language models can teach themselves to use tools
Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom · 2023
Closest in time.
Causal parrots: Large language models may talk causality but are not causal
Moritz Willig, Matej Zečević, Devendra Singh Dhami, and Kristian Kersting · 2023
Closest in time.
Association between daily alcohol intake and risk of all-cause mortality: A systematic review and meta-analyses
Jinhui Zhao, Tim Stockwell, Tim Naimi, Sam Churchill, James Clay, and Adam Sherk · 2023
Closest in time.
Lima: Less is more for alignment
Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, and Omer Levy · 2023
Closest in time.