Fetching the paper…
Reading the bibliography…
Large Language Models (LLMs) do not differentially represent numbers, which are pervasive in text.
Xlnet: Generalized autoregressive pretraining for language understanding
Zhilin Yang, Zihang Dai, Yiming Yang, Jaime G. Carbonell, Ruslan Salakhutdinov, and Quoc V. Le. 2019 · 1906
Earlier work this paper cites.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, M. Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907
Earlier work this paper cites.
Do NLP models know numbers? probing numeracy in embeddings
Eric Wallace, Yizhong Wang, Sujian Li, Sameer Singh, and Matt Gardner. 2019 · 1909
Earlier work this paper cites.
M. Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 1910
Earlier work this paper cites.
Time required for judgements of numerical inequality
Robert S. Moyer and Thomas K. Landauer. 1967 · 1967
Earlier work this paper cites.
Temporal aspects of digit and letter inequality judgments
John M. Parkman. 1971 · 1971
Earlier work this paper cites.
Cross-linguistic regularities in the frequency of number words
Stanislas Dehaene and Jacques Mehler. 1992 · 1992
Earlier work this paper cites.
The language user as an arithmetician
Thijs Pollmann and Carel Jansen. 1996 · 1996
Earlier work this paper cites.
Decade breaks in the mental number line? Putting the tens and units back in different bins
Hans-Christoph Nuerk, Ulrich Weger, and Klaus Willmes. 2001 · 2001
Earlier work this paper cites.
Coding of Cognitive Magnitude: Compressed Scaling of Numerical Information in the Primate Prefrontal Cortex
Andreas Nieder and Earl K. Miller. 2003 · 2003
Earlier work this paper cites.
Injecting numerical reasoning skills into language models
Mor Geva, Ankit Gupta, and Jonathan Berant. 2020 · 2004
Earlier work this paper cites.
Numerical cognition without words: Evidence from amazonia
Peter Gordon. 2004 · 2004
Earlier work this paper cites.
Exact and approximate arithmetic in an amazonian indigene group
Pierre Pica, Cathy Lemer, Ve’ronique Izard, and Stanislas Dehaene. 2004 · 2004
Earlier work this paper cites.
Wikipedia, the free encyclopedia
Wikipedia contributors. 2004 · 2004
Earlier work this paper cites.
Neural correlates of symbolic number processing in children and adults
Daniel Ansari, Nicolas Garcia, Elizabeth Lucas, Kathleen Hamon, and Bibek Dhital. 2005 · 2005
Earlier work this paper cites.
Modern Multidimensional Scaling: Theory and Applications
I. Borg and P.J.F. Groenen. 2005 · 2005
Cited alongside, same era.
Are numbers special? An overview of chronometric, neuroimaging, developmental and comparative studies of magnitude representation
Roi Cohen Kadosh, Jan Lammertyn, and Veronique Izard. 2008 · 2008
Cited alongside, same era.
Individual differences in non-verbal number acuity correlate with maths achievement
Justin Halberda, Michèle M. M. Mazzocco, and Lisa Feigenson. 2008 · 2008
Cited alongside, same era.
Representation of Number in the Brain
Andreas Nieder and Stanislas Dehaene. 2009 · 2009
Cited alongside, same era.
Using eye tracking to study numerical cognition: The case of the ratio effect
Rebecca Merkley and Daniel Ansari. 2010 · 2010
Cited alongside, same era.
To honor Fechner and obey Stevens: Relationships between psychophysical and neural nonlinearities
Exploring numeracy in word embeddings
Aakanksha Naik, Abhilasha Ravichander, Carolyn Rose, and Eduard Hovy. 2019 · 2019
Later among the works it cites.
Language models are unsupervised multitask learners
Alec Radford, Jeff Wu, R. Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Later among the works it cites.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2019 · 2019
Later among the works it cites.
Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language Models
Bill Yuchen Lin, Seyeon Lee, Rahul Khanna, and Xiang Ren. 2020 · 2020
Later among the works it cites.
Measurement of text similarity: A survey
Jiapeng Wang and Yihong Dong. 2020 · 2020
Later among the works it cites.
Transformers: State-of-the-art natural language processing
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Vincent A. Billock and Brian H. Tsou. 2011 · 2011
Cited alongside, same era.
Math, monkeys, and the developing brain
Jessica F. Cantlon. 2012 · 2012
Cited alongside, same era.
Aligning books and movies: Towards story-like visual explanations by watching movies and reading books
Yukun Zhu, Ryan Kiros, Rich Zemel, Ruslan Salakhutdinov, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015 · 2015
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Cited alongside, same era.
Fundamentals of Applied Multidimensional Scaling for Educational and Psychological Research
Cody S. Ding. 2018 · 2018
Cited alongside, same era.
Numeracy for language models: Evaluating and improving their ability to predict numbers
Georgios P. Spithourakis and Sebastian Riedel. 2018 · 2018
Cited alongside, same era.
Glue: A multi-task benchmark and analysis platform for natural language understanding
Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R. Bowman. 2018 · 2018
Cited alongside, same era.
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander M. Rush. 2020 · 2020
Later among the works it cites.
Do language embeddings capture scales?
Xikun Zhang, Deepak Ramachandran, Ian Tenney, Yanai Elazar, and Dan Roth. 2020 · 2020
Later among the works it cites.
Measuring mathematical problem solving with the MATH dataset
Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021 · 2021
Later among the works it cites.
Word meaning in minds and machines
Brenden M. Lake and Gregory L. Murphy. 2021 · 2021
Later among the works it cites.
Recent advances in natural language processing via large pre-trained language models: A survey
Bonan Min, Hayley Ross, Elior Sulem, Amir Pouran Ben Veyseh, Thien Huu Nguyen, Oscar Sainz, Eneko Agirre, Ilana Heintz, and Dan Roth. 2021 · 2021
Later among the works it cites.
Similarity Judgment Within and Across Categories: A Comprehensive Model Comparison
Russell Richie and Sudeep Bhatia. 2021 · 2021
Later among the works it cites.
Representing numbers in NLP: a survey and a vision
Avijit Thawani, Jay Pujara, Filip Ilievski, and Pedro Szekely. 2021 · 2021
Later among the works it cites.
Transformer networks of human conceptual knowledge
Sudeep Bhatia and Russell Richie. 2022 · 2022
Later among the works it cites.
Symbol grounding problem
Stevan Harnad. 2023 · 2023
Closest in time.