Fetching the paper…
Reading the bibliography…
Foundation models are subject to an ongoing heated debate, leaving open the question of progress towards AGI and dividing the community into two camps: the ones who see the arguably impressive results as evidence to the scaling hypothesis, and the others who are worried about the lack of interpretability and reasoning capabilities.
Über formal unentscheidbare sätze der principia mathematica und verwandter systeme i
Kurt Gödel · 1931
Earlier work this paper cites.
On computable numbers, with an application to the entscheidungsproblem
Alan Mathison Turing et al · 1936
Earlier work this paper cites.
The direction of time , volume 65
Hans Reichenbach · 1956
Earlier work this paper cites.
Comparison of treatment of renal calculi by open surgery, percutaneous nephrolithotomy, and extracorporeal shockwave lithotripsy
Clive R Charig, David R Webb, Stephen Richard Payne, and John E Wickham · 1986
Earlier work this paper cites.
Statistics and causal inference
Paul W Holland · 1986
Earlier work this paper cites.
Correlations genuine and spurious in pearson and yule
John Aldrich · 1995
Earlier work this paper cites.
Causality
Judea Pearl · 2009
Earlier work this paper cites.
Chinese room argument
John Searle · 2009
Earlier work this paper cites.
Bayesian artificial intelligence
Kevin B Korb and Ann E Nicholson · 2010
Earlier work this paper cites.
How to grow a mind: Statistics, structure, and abstraction
Joshua B Tenenbaum, Charles Kemp, Thomas L Griffiths, and Noah D Goodman · 2011
Earlier work this paper cites.
The remarkable, yet not extraordinary, human brain as a scaled-up primate brain and its associated cost
Suzana Herculano-Houzel · 2012
Earlier work this paper cites.
Does chocolate consumption really boost nobel award chances? the peril of over-interpreting correlations in health studies
Pierre Maurage, Alexandre Heeren, and Mauro Pesenti · 2013
Earlier work this paper cites.
Distinguishing cause from effect using observational data: methods and benchmarks
Joris M Mooij, Jonas Peters, Dominik Janzing, Jakob Zscheischler, and Bernhard Schölkopf · 2016
Earlier work this paper cites.
Elements of causal inference: foundations and learning algorithms
Jonas Peters, Dominik Janzing, and Bernhard Schölkopf · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Cited alongside, same era.
The 30-year cycle in the ai debate
Jean-Marie Chauvet · 2018
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Cited alongside, same era.
Detecting non-causal artifacts in multivariate linear regression models
Dominik Janzing and Bernhard Schölkopf · 2018
Cited alongside, same era.
On the opportunities and risks of foundation models
Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al · 2021
Later among the works it cites.
Has ai found a new foundation?
Gary Marcus and Ernest Davis · 2021
Later among the works it cites.
Zero-shot text-to-image generation
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever · 2021
Later among the works it cites.
Reward is enough
David Silver, Satinder Singh, Doina Precup, and Richard S Sutton · 2021
Later among the works it cites.
Inferbert: A transformer-based causal inference framework for enhancing pharmacovigilance
Xingqiao Wang, Xiaowei Xu, Weida Tong, Ruth Roberts, and Zhichao Liu · 2021
Later among the works it cites.
Interventional sum-product networks: Causal inference with tractable probabilistic models
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Structural causal bandits with non-manipulable variables
Sanghack Lee and Elias Bareinboim · 2019
Cited alongside, same era.
The bitter lesson
Richard Sutton · 2019
Cited alongside, same era.
1on pearl’s hierarchy and
Elias Bareinboim, Juan D Correa, Duligur Ibeling, and Thomas Icard · 2020
Cited alongside, same era.
The scaling hypothesis
Gwern Branwen · 2020
Cited alongside, same era.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 2020
Cited alongside, same era.
Explainable ai: A review of machine learning interpretability methods
Pantelis Linardatos, Vasilis Papastefanopoulos, and Sotiris Kotsiantis · 2020
Cited alongside, same era.
Artificial intelligence is stupid and causal reasoning will not fix it
J Mark Bishop · 2021
Cited alongside, same era.
Matej Zečević, Devendra Dhami, Athresh Karanam, Sriraam Natarajan, and Kristian Kersting · 2021
Later among the works it cites.
Luminous language model
AlephAlpha · 2022
Closest in time.
Probabilistic and causal inference: The works of judea pearl, 2022
Hector Geffner, Rina Dechter, and Joseph Y Halpern · 2022
Closest in time.
Causal bert: Language models for causality detection between events expressed in text
Vivek Khetan, Roshni Ramnani, Mayuresh Anand, Subhashis Sengupta, and Andrew E Fano · 2022
Closest in time.
Deep learning is hitting a wall
Gary Marcus · 2022
Closest in time.
Causality for machine learning
Bernhard Schölkopf · 2022
Closest in time.
Opt: Open pre-trained transformer language models
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al · 2022
Closest in time.