Fetching the paper…
Reading the bibliography…
Recent advancements in artificial intelligence have sparked interest in the parallels between large language models (LLMs) and human neural processing, particularly in language comprehension.
A simple sequentially rejective multiple test procedure
Sture Holm · 1979
Earlier work this paper cites.
Natural language and natural selection
Steven Pinker and Paul Bloom · 1990
Earlier work this paper cites.
The symbolic species: The co-evolution of language and the brain
Terrence William Deacon · 1997
Earlier work this paper cites.
Human primary auditory cortex: cytoarchitectonic subdivisions and mapping into a spatial reference system
Patricia Morosan, Jorg Rademacher, Axel Schleicher, Katrin Amunts, Thorsten Schormann, and Karl Zilles · 2001
Earlier work this paper cites.
Automatically parcellating the human cerebral cortex
Bruce Fischl, André Van Der Kouwe, Christophe Destrieux, Eric Halgren, Florent Ségonne, David H Salat, Evelina Busa, Larry J Seidman, Jill Goldstein, David Kennedy, et al · 2004
Earlier work this paper cites.
A systematic review and quantitative appraisal of fmri studies of verbal fluency: role of the left inferior frontal gyrus
Sergi G Costafreda, Cynthia HY Fu, Lucy Lee, Brian Everitt, Michael J Brammer, and Anthony S David · 2006
Earlier work this paper cites.
The cortical organization of speech processing
Gregory Hickok and David Poeppel · 2007
Earlier work this paper cites.
A hierarchy of temporal receptive windows in human cortex
Uri Hasson, Eunice Yang, Ignacio Vallines, David J Heeger, and Nava Rubin · 2008
Earlier work this paper cites.
Spectrotemporal analysis of evoked and induced electroencephalographic responses in primary auditory cortex (a1) of the awake monkey
Mitchell Steinschneider, Yonatan I Fishman, and Joseph C Arezzo · 2008
Earlier work this paper cites.
Comparison of time–frequency responses and the event-related potential to auditory speech stimuli in human cortex
Erik Edwards, Maryam Soltani, Won Kim, Sarang S Dalal, Srikantan S Nagarajan, Mitchel S Berger, and Robert T Knight · 2009
Earlier work this paper cites.
Topographic mapping of a hierarchy of temporal receptive windows using a narrated story
Yulia Lerner, Christopher J Honey, Lauren J Silbert, and Uri Hasson · 2011
Earlier work this paper cites.
Hierarchical representations in the auditory cortex
Tatyana O Sharpee, Craig A Atencio, and Christoph E Schreiner · 2011
Earlier work this paper cites.
Different origins of gamma rhythm and high-gamma activity in macaque visual cortex
Supratim Ray and John HR Maunsell · 2011
Earlier work this paper cites.
Scikit-learn: Machine learning in python
Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al · 2011
Earlier work this paper cites.
A unified framework for the organization of the primate auditory cortex
Simon Baumann, Christopher I Petkov, and Timothy D Griffiths · 2013
Earlier work this paper cites.
Functional organization of human sensorimotor cortex for speech articulation
Kristofer E Bouchard, Nima Mesgarani, Keith Johnson, and Edward F Chang · 2013
Earlier work this paper cites.
Artificial general intelligence: concept, state of the art, and future prospects
Ben Goertzel · 2014
Earlier work this paper cites.
Phonetic feature encoding in human superior temporal gyrus
Nima Mesgarani, Connie Cheung, Keith Johnson, and Edward F Chang · 2014
Earlier work this paper cites.
Deep neural networks: a new framework for modeling biological vision and brain information processing
Nikolaus Kriegeskorte · 2015
Earlier work this paper cites.
Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence
Radoslaw Martin Cichy, Aditya Khosla, Dimitrios Pantazis, Antonio Torralba, and Aude Oliva · 2016
Earlier work this paper cites.
Natural speech reveals the semantic maps that tile human cerebral cortex
Alexander G Huth, Wendy A De Heer, Thomas L Griffiths, Frédéric E Theunissen, and Jack L Gallant · 2016
Earlier work this paper cites.
Characterizing neural entrainment to hierarchical linguistic units using electroencephalography (eeg)
Nai Ding, Lucia Melloni, Aotian Yang, Yu Wang, Wen Zhang, and David Poeppel · 2017
Earlier work this paper cites.
Hierarchical neural representation of dreamed objects revealed by brain decoding with deep neural network features
Tomoyasu Horikawa and Yukiyasu Kamitani · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
The hierarchical cortical organization of human speech processing
Wendy A de Heer, Alexander G Huth, Thomas L Griffiths, Jack L Gallant, and Frédéric E Theunissen · 2017
Earlier work this paper cites.
ielvis: An open source matlab toolbox for localizing and visualizing human intracranial electrode data
David M Groppe, Stephan Bickel, Andrew R Dykstra, Xiuyuan Wang, Pierre Mégevand, Manuel R Mercier, Fred A Lado, Ashesh D Mehta, and Christopher J Honey · 2017
Earlier work this paper cites.
Neural responses to natural and model-matched stimuli reveal distinct computations in primary and nonprimary auditory cortex
Sam V Norman-Haignere and Josh H McDermott · 2018
Earlier work this paper cites.
Know what you don’t know: Unanswerable questions for squad
Pranav Rajpurkar, Robin Jia, and Percy Liang · 2018
Earlier work this paper cites.
Can a suit of armor conduct electricity? a new dataset for open book question answering
Todor Mihaylov, Peter Clark, Tushar Khot, and Ashish Sabharwal · 2018
Earlier work this paper cites.
Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)
Mariya Toneva and Leila Wehbe · 2019
Earlier work this paper cites.
Samira Abnar, Lisa Beinborn, Rochelle Choenni, and Willem Zuidema · 2019
Cited alongside, same era.
Kawin Ethayarajh · 2019
Cited alongside, same era.
Bert rediscovers the classical nlp pipeline
Ian Tenney, Dipanjan Das, and Ellie Pavlick · 2019
Cited alongside, same era.
Similarity of neural network representations revisited
Simon Kornblith, Mohammad Norouzi, Honglak Lee, and Geoffrey Hinton · 2019
Cited alongside, same era.
The cortical maps of hierarchical linguistic structures during speech perception
Jingwei Sheng, Li Zheng, Bingjiang Lyu, Zhehang Cen, Lang Qin, Li Hai Tan, Ming-Xiong Huang, Nai Ding, and Jia-Hong Gao · 2019
Reassessing hierarchical correspondences between brain and deep networks through direct interface
Nicholas J Sexton and Bradley C Love · 2022
Later among the works it cites.
Multiscale temporal integration organizes hierarchical computation in human auditory cortex
Sam V Norman-Haignere, Laura K Long, Orrin Devinsky, Werner Doyle, Ifeoma Irobunda, Edward M Merricks, Neil A Feldstein, Guy M McKhann, Catherine A Schevon, Adeen Flinker, et al · 2022
Later among the works it cites.
Galactica: A large language model for science
Ross Taylor, Marcin Kardas, Guillem Cucurull, Thomas Scialom, Anthony Hartshorn, Elvis Saravia, Andrew Poulton, Viktor Kerkez, and Robert Stojnic · 2022
Later among the works it cites.
Opt: Open pre-trained transformer language models
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al · 2022
Later among the works it cites.
Evidence of a predictive coding hierarchy in the human brain listening to speech
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
What does bert look at? an analysis of bert’s attention
Kevin Clark, Urvashi Khandelwal, Omer Levy, and Christopher D Manning · 2019
Cited alongside, same era.
Huggingface’s transformers: State-of-the-art natural language processing
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al · 2019
Cited alongside, same era.
Boolq: Exploring the surprising difficulty of natural yes/no questions
Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, and Kristina Toutanova · 2019
Cited alongside, same era.
Hellaswag: Can a machine really finish your sentence?
Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi · 2019
Cited alongside, same era.
Language processing in brains and deep neural networks: computational convergence and its limits
Charlotte Caucheteux and Jean-Rémi King · 2020
Cited alongside, same era.
Neural encoding and decoding with distributed sentence representations
Jingyuan Sun, Shaonan Wang, Jiajun Zhang, and Chengqing Zong · 2020
Cited alongside, same era.
Sensory modality-independent activation of the brain network for language
Sophie Arana, André Marquand, Annika Hultén, Peter Hagoort, and Jan-Mathijs Schoffelen · 2020
Cited alongside, same era.
Charlotte Caucheteux, Alexandre Gramfort, and Jean-Rémi King · 2023
Later among the works it cites.
Scaling laws for language encoding models in fmri
Richard Antonello, Aditya Vaidya, and Alexander G Huth · 2023
Later among the works it cites.
Predictive coding or just feature discovery? an alternative account of why language models fit brain data
Richard Antonello and Alexander Huth · 2023
Later among the works it cites.
Llama 2: Open foundation and fine-tuned chat models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023
Later among the works it cites.
Deep neural networks effectively model neural adaptation to changing background noise and suggest nonlinear noise filtering methods in auditory cortex
Gavin Mischler, Menoua Keshishian, Stephan Bickel, Ashesh D Mehta, and Nima Mesgarani · 2023
Later among the works it cites.
Joint, distributed and hierarchically organized encoding of linguistic features in the human auditory cortex
Menoua Keshishian, Serdar Akkol, Jose Herrero, Stephan Bickel, Ashesh D Mehta, and Nima Mesgarani · 2023
Later among the works it cites.
Intermediate acoustic-to-semantic representations link behavioral and neural responses to natural sounds
Bruno L Giordano, Michele Esposito, Giancarlo Valente, and Elia Formisano · 2023
Later among the works it cites.
Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions
Greta Tuckute, Jenelle Feather, Dana Boebinger, and Josh H McDermott · 2023
Later among the works it cites.
Large language models transition from integrating across position-yoked, exponential windows to structure-yoked, power-law windows
David Skrill and Samuel Victor Norman-Haignere · 2023
Later among the works it cites.
Phonemic segmentation of narrative speech in human cerebral cortex
Xue L Gong, Alexander G Huth, Fatma Deniz, Keith Johnson, Jack L Gallant, and Frédéric E Theunissen · 2023
Later among the works it cites.
A comprehensive overview of large language models
Humza Naveed, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Nick Barnes, and Ajmal Mian · 2023
Later among the works it cites.
The spatiotemporal dynamics of semantic integration in the human brain
Elliot Murphy, Kiefer J Forseth, Cristian Donos, Kathryn M Snyder, Patrick S Rollo, and Nitin Tandon · 2023
Later among the works it cites.
Effective long-context scaling of foundation models
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, et al · 2023
Later among the works it cites.
Lost in the middle: How language models use long contexts
Nelson F Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang · 2023
Later among the works it cites.
When brain-inspired ai meets agi
Lin Zhao, Lu Zhang, Zihao Wu, Yuzhong Chen, Haixing Dai, Xiaowei Yu, Zhengliang Liu, Tuo Zhang, Xintao Hu, Xi Jiang, et al · 2023
Later among the works it cites.
A survey of large language models
Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al · 2023
Later among the works it cites.
Cerebras-gpt: Open compute-optimal language models trained on the cerebras wafer-scale cluster
Nolan Dey, Gurpreet Gosal, Hemant Khachane, William Marshall, Ribhu Pathria, Marvin Tom, Joel Hestness, et al · 2023
Later among the works it cites.
Pythia: A suite for analyzing large language models across training and scaling
Stella Biderman, Hailey Schoelkopf, Quentin Gregory Anthony, Herbie Bradley, Kyle O’Brien, Eric Hallahan, Mohammad Aflah Khan, Shivanshu Purohit, USVSN Sai Prashanth, Edward Raff, et al · 2023
Later among the works it cites.
https://huggingface.co/LeoLM/leo-hessianai-13b
Laion leolm: Linguistically enhanced open language model · 2023
Later among the works it cites.
Introducing mpt-7b: A new standard for open-source, commercially usable llms
MosaicML NLP Team · 2023
Later among the works it cites.
The falcon series of open language models
Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Daniel Hesslow, Julien Launay, Quentin Malartic, Daniele Mazzotta, Badreddine Noune, et al · 2023
Later among the works it cites.
Llama: Open and efficient foundation language models
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al · 2023
Later among the works it cites.
https://huggingface.co/Xwin-LM/Xwin-LM-7B-V0.2
Xwin-lm: Powerful, stable, and reproducible llm alignment · 2023
Later among the works it cites.
Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al · 2023
Later among the works it cites.
naplib-python: Neural acoustic data processing and analysis tools in python
Gavin Mischler, Vinay Raghavan, Menoua Keshishian, and Nima Mesgarani · 2023
Later among the works it cites.