Fetching the paper…
Reading the bibliography…
The activations of language transformers like GPT-2 have been shown to linearly map onto brain activity during speech comprehension.
Cross-lingual Language Model Pretraining
Lample, G. and Conneau, A · 1901
Earlier work this paper cites.
The emergence of number and syntax units in LSTM language models
Lakretz, Y., Kruszewski, G., Desbordes, T., Hupkes, D., Dehaene, S., and Baroni, M · 1903
Earlier work this paper cites.
Abnar, S., Beinborn, L., Choenni, R., and Zuidema, W · 1906
Earlier work this paper cites.
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., and Le, Q. V · 1906
Earlier work this paper cites.
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V · 1907
Earlier work this paper cites.
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., and Soricut, R · 1909
Earlier work this paper cites.
Reading senseless sentences: Brain potentials reflect semantic incongruity
Kutas, M. and Hillyard, S. A · 1980
Earlier work this paper cites.
Tensor product variable binding and the representation of symbolic structures in connectionist systems
Smolensky, P · 1990
Earlier work this paper cites.
Segregating semantic and syntactic aspects of processing in the human brain: an fmri investigation of different word types
Friederici, A. D., Opitz, B., and Von Cramon, D. Y · 2000
Earlier work this paper cites.
Syntax: an introduction , volume 1
Givón, T · 2001
Earlier work this paper cites.
Foundations of Language: Brain, Meaning, Grammar, Evolution
Jackendoff, R · 2002
Earlier work this paper cites.
Compositionality
Szabó, Z. G · 2004
Earlier work this paper cites.
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., and Amodei, D · 2005
Earlier work this paper cites.
GECToR – Grammatical Error Correction: Tag, Not Rewrite
Omelianchuk, K., Atrasevych, V., Chernodub, A., and Skurzhanskyi, O · 2005
Earlier work this paper cites.
The cortical organization of speech processing
Hickok, G. and Poeppel, D · 2007
Earlier work this paper cites.
Representational similarity analysis - connecting the branches of systems neuroscience
Kriegeskorte, N., Mur, M., and Bandettini, P. A · 2008
Earlier work this paper cites.
Predicting human brain activity associated with the meanings of nouns
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., and Just, M. A · 2008
Earlier work this paper cites.
Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature
Destrieux, C., Fischl, B., Dale, A., and Halgren, E · 2010
Earlier work this paper cites.
New method for fmri investigations of language: defining rois functionally in individual subjects
Fedorenko, E., Hsieh, P.-J., Nieto-Castañón, A., Whitfield-Gabrieli, S., and Kanwisher, N · 2010
Earlier work this paper cites.
The unique role of the visual word form area in reading
Dehaene, S. and Cohen, L · 2011
Earlier work this paper cites.
The Brain Basis of Language Processing: From Structure to Function
Friederici, A. D · 2011
Earlier work this paper cites.
Encoding and decoding in fmri
Naselaris, T., Kay, K. N., Nishimoto, S., and Gallant, J. L · 2011
Earlier work this paper cites.
Cortical representation of the constituent structure of sentences
Pallier, C., Devauchelle, A.-D., and Dehaene, S · 2011
Earlier work this paper cites.
Scikit-learn: Machine learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E · 2011
Cited alongside, same era.
Lexical and syntactic representations in the brain: an fmri investigation with multi-voxel pattern analyses
Fedorenko, E., Nieto-Castanon, A., and Kanwisher, N · 2012
Cited alongside, same era.
MEG and EEG data analysis with MNE-Python
Gramfort, A., Luessi, M., Larson, E., Engemann, D. A., Strohmeier, D., Brodbeck, C., Goj, R., Jas, M., Brooks, T., Parkkonen, L., and Hämäläinen, M · 2013
Cited alongside, same era.
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., and Dean, J · 2013
Cited alongside, same era.
The minimalist program
Chomsky, N · 2014
Cited alongside, same era.
Phonetic feature encoding in human superior temporal gyrus
What Does BERT Learn about the Structure of Language?
Jawahar, G., Sagot, B., and Seddah, D · 2019
Later among the works it cites.
Language models are unsupervised multitask learners
Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., and Sutskever, I · 2019
Later among the works it cites.
fMRI reveals language-specific predictive coding during naturalistic sentence comprehension
Shain, C., Blank, I. A., van Schijndel, M., Schuler, W., and Fedorenko, E · 2019
Later among the works it cites.
Toneva, M. and Wehbe, L · 2019
Later among the works it cites.
Brain2word: Decoding brain activity for language generation
Affolter, N., Egressy, B., Pascual, D., and Wattenhofer, R · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Mesgarani, N., Cheung, C., Johnson, K., and Chang, E. F · 2014
Cited alongside, same era.
Toward a brain-based componential semantic representation
Binder, J. R., Conant, L. L., Humphries, C. J., Fernandino, L., Simons, S. B., Aguilar, M., and Desai, R. H · 2016
Cited alongside, same era.
Naturalistic sentence comprehension in the brain
Brennan, J · 2016
Cited alongside, same era.
Cortical tracking of hierarchical linguistic structures in connected speech
Ding, N., Melloni, L., Zhang, H., Tian, X., and Poeppel, D · 2016
Cited alongside, same era.
Natural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., and Gallant, J. L · 2016
Cited alongside, same era.
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., and Birch, A · 2016
Cited alongside, same era.
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. and DiCarlo, J. J · 2016
Cited alongside, same era.
Linguistic generalization and compositionality in modern artificial neural networks
Baroni, M · 2020
Later among the works it cites.
Language processing in brains and deep neural networks: computational convergence and its limits
Caucheteux, C. and King, J.-R · 2020
Later among the works it cites.
Neural dynamics of phoneme sequencing in real speech jointly encode order and invariant content
Gwilliams, L., King, J.-R., Marantz, A., and Poeppel, D · 2020
Later among the works it cites.
The revolution will not be controlled: natural stimuli in speech neuroscience
Hamilton, L. S. and Huth, A. G · 2020
Later among the works it cites.
A hierarchy of linguistic predictions during natural language comprehension
Heilbron, M., Armeni, K., Schoffelen, J.-M., Hagoort, P., and de Lange, F. P · 2020
Later among the works it cites.
spaCy: Industrial-strength Natural Language Processing in Python, 2020
Honnibal, M., Montani, I., Van Landeghem, S., and Boyd, A · 2020
Later among the works it cites.
What limits our capacity to process nested long-range dependencies in sentence comprehension?
Lakretz, Y., Dehaene, S., and King, J.-R · 2020
Later among the works it cites.
Syntactic structure from deep learning
Linzen, T. and Baroni, M · 2020
Later among the works it cites.
Emergent linguistic structure in artificial neural networks trained by self-supervision
Manning, C. D., Clark, K., Hewitt, J., Khandelwal, U., and Levy, O · 2020
Later among the works it cites.
Narratives: fMRI data for evaluating models of naturalistic language comprehension
Nastase, S. A., Liu, Y.-F., Hillman, H., Zadbood, A., Hasenfratz, L., Keshavarzian, N., Chen, J., Honey, C. J., Yeshurun, Y., Regev, M., Nguyen, M., Chang, C. H. C., Baldassano, C., Lositsky, O., Simony, E., Chow, M. A., Leong, Y. C., Brooks, P. P., Micciche, E., Choe, G., Goldstein, A., Vanderwal, T., Halchenko, Y. O., Norman, K. A., and Hasson, U · 2020
Later among the works it cites.
Syntactic representations in the human brain: beyond effort-based metrics
Reddy, A. J. and Wehbe, L · 2020
Later among the works it cites.
Artificial Neural Networks Accurately Predict Language Processing in the Brain
Schrimpf, M., Blank, I. A., Tuckute, G., Kauf, C., Hosseini, E. A., Kanwisher, N. G., Tenenbaum, J. B., and Fedorenko, E · 2020
Later among the works it cites.
The little prince in 26 languages: Towards a multilingual neuro-cognitive corpus
Stehwien, S., Henke, L., Hale, J., Brennan, J., and Meyer, L · 2020
Later among the works it cites.
Transformers: State-of-the-art natural language processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Scao, T. L., Gugger, S., Drame, M., Lhoest, Q., and Rush, A. M · 2020
Later among the works it cites.
Efficient second-order TreeCRF for neural dependency parsing
Zhang, Y., Li, Z., and Min, Z · 2020
Later among the works it cites.
Gpt-2’s activations predict the degree of semantic comprehension in the human brain
Caucheteux, C., Gramfort, A., and King, J.-R · 2021
Closest in time.
Thinking ahead: prediction in context as a keystone of language in humans and machines
Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., Nastase, S. A., Feder, A., Emanuel, D., Cohen, A., et al · 2021
Closest in time.