Neural Language Models are not Born Equal to Fit Brain Data, but Training Helps

Teoria statistica delle classi e calcolo delle probabilita

Bonferroni, C · 1936

Earlier work this paper cites.

Long short-term memory

Hochreiter, S. and Schmidhuber, J · 1997

Earlier work this paper cites.

Mindware: An introduction to the philosophy of cognitive science

Clark, A · 2000

Earlier work this paper cites.

Theoretical neuroscience: computational and mathematical modeling of neural systems

Dayan, P. and Abbott, L. F · 2005

Earlier work this paper cites.

Statistical Parametric Mapping: the analysis of functional brain images

Friston, K. J. (ed.) · 2007

Earlier work this paper cites.

Predicting human brain activity associated with the meanings of nouns

Mitchell, T., Shinkareva, S., Carlson, A., Chang, K.-M., Malave, V., Mason, R., and Just, M · 2008

Earlier work this paper cites.

Encoding and decoding in fMRI

Naselaris, T., Kay, K. N., Nishimoto, S., and Gallant, J. L · 2010

Earlier work this paper cites.

The Little Prince/Le Petit Prince

Eckert-Boulet, N · 2011

Earlier work this paper cites.

Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story

Lerner, Y., Honey, C. J., Silbert, L. J., and Hasson, U · 2011

Earlier work this paper cites.

A review and synthesis of the first 20years of PET and fMRI studies of heard speech, spoken language and reading

Price, C. J · 2012

Earlier work this paper cites.

Selective and Invariant Neural Responses to Spoken and Written Narratives

Regev, M., Honey, C. J., Simony, E., and Hasson, U · 2013

Cited alongside, same era.

Glove: Global Vectors for Word Representation

Pennington, J., Socher, R., and Manning, C · 2014

Cited alongside, same era.

Simultaneously Uncovering the Patterns of Brain Regions Involved in Different Story Reading Subprocesses

Wehbe, L., Murphy, B., Talukdar, P., Fyshe, A., Ramdas, A., and Mitchell, T · 2014

Cited alongside, same era.

A reduced-dimension fmri shared response model

Chen, P.-H. C., Chen, J., Yeshurun, Y., Hasson, U., Haxby, J., and Ramadge, P. J · 2015

Cited alongside, same era.

Neurobiology of language

Hickok, G. and Small, S. L · 2015

Cited alongside, same era.

Natural speech reveals the semantic maps that tile human cerebral cortex

Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., and Gallant, J. L · 2016

Language models are unsupervised multitask learners

Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I., and others · 2019

Later among the works it cites.

Language processing in brains and deep neural networks: computational convergence and its limits

Caucheteux, C. and King, J.-R · 2020

Later among the works it cites.

Thinking ahead: spontaneous prediction in context as a keystone of language in humans and machines

Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., Nastase, S. A., Feder, A., Emanuel, D., Cohen, A., Jansen, A., Gazula, H., Choe, G., Rao, A., Kim, S. C., Casto, C., Fanda, L., Doyle, W., Friedman, D., Dugan, P., Melloni, L., Reichart, R., Devore, S., Flinker, A., Hasenfratz, L., Levy, O., Hassidim, A., Brenner, M., Matias, Y., Norman, K. A., Devinsky, O., and Hasson, U · 2020

Later among the works it cites.

Interpretable multi-timescale models for predicting fmri responses to continuous natural speech

Jain, S., Vo, V. A., Mahto, S., LeBel, A., Turek, J. S., and Huth, A. G · 2020

Later among the works it cites.

Modeling task effects on meaning representation in the brain via zero-shot meg prediction