Fetching the paper…
Reading the bibliography…
Large language models (LLMs) achieve impressive results on advanced mathematics benchmarks but sometimes fail on basic arithmetic tasks, raising the question of whether they have truly grasped fundamental arithmetic rules or are merely relying on pattern matching.
Analysing mathematical reasoning abilities of neural models
David Saxton, Edward Grefenstette, Felix Hill, and Pushmeet Kohli. 2019 · 2019
Earlier work this paper cites.
Training verifiers to solve math word problems
Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021 · 2021
Earlier work this paper cites.
Measuring massive multitask language understanding
Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021 · 2021
Earlier work this paper cites.
Grokking: Generalization beyond overfitting on small algorithmic datasets
Alethea Power, Yuri Burda, Harri Edwards, Igor Babuschkin, and Vedant Misra. 2022 · 2022
Earlier work this paper cites.
Direct preference optimization: Your language model is secretly a reward model
Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. 2023 · 2023
Earlier work this paper cites.
Revisiting out-of-distribution robustness in nlp: Benchmarks, analysis, and llms evaluations
Lifan Yuan, Yangyi Chen, Ganqu Cui, Hongcheng Gao, FangYuan Zou, Xingyi Cheng, Heng Ji, Zhiyuan Liu, and Maosong Sun. 2023 · 2023
Earlier work this paper cites.
Marah Abdin, Jyoti Aneja, Harkirat Behl, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Michael Harrison, Russell J. Hewett, Mojan Javaheripi, Piero Kauffmann, James R. Lee, Yin Tat Lee, Yuanzhi Li, Weishung Liu, Caio C. T. Mendes, Anh Nguyen, Eric Price, Gustavo de Rosa, Olli Saarikivi, and 8 others. 2024 · 2024
Earlier work this paper cites.
The reversal curse: LLMs trained on “a is b” fail to learn “b is a”
Lukas Berglund, Meg Tong, Maximilian Kaufmann, Mikita Balesni, Asa Cooper Stickland, Tomasz Korbak, and Owain Evans. 2024 · 2024
Earlier work this paper cites.
Unraveling arithmetic in large language models: The role of algebraic structures
Fu-Chieh Chang and Pei-Yuan Wu. 2024 · 2024
Earlier work this paper cites.
States hidden in hidden states: Llms emerge discrete state representations implicitly
Junhao Chen, Shengding Hu, Zhiyuan Liu, and Maosong Sun. 2024 · 2024
Earlier work this paper cites.
Language models are symbolic learners in arithmetic
Chunyuan Deng, Zhiqi Li, Roy Xie, Ruidi Chang, and Hanjie Chen. 2024 · 2024
Earlier work this paper cites.
Learning mathematical rules with large language models
Antoine Gorceix, Bastien Le Chenadec, Ahmad Rammal, Nelson Vadori, and Manuela Veloso. 2024 · 2024
Cited alongside, same era.
Qintong Li, Leyang Cui, Xueliang Zhao, Lingpeng Kong, and Wei Bi. 2024 · 2024
Cited alongside, same era.
Let’s verify step by step
Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. 2024 · 2024
Cited alongside, same era.
American invitational mathematics examination 2024
MAA. 2024 · 2024
Cited alongside, same era.
Transformers can do arithmetic with the right embeddings
Sean Michael McLeish, Arpit Bansal, Alex Stein, Neel Jain, John Kirchenbauer, Brian R. Bartoldson, Bhavya Kailkhura, Abhinav Bhatele, Jonas Geiping, Avi Schwarzschild, and Tom Goldstein. 2024 · 2024
Cited alongside, same era.
Sglang: Efficient execution of structured language model programs
Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Chuyue Sun, Jeff Huang, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark Barrett, and Ying Sheng. 2024 · 2024
Later among the works it cites.
Qihuang Zhong, Kang Wang, Ziyang Xu, Juhua Liu, Liang Ding, and Bo Du. 2024 · 2024
Later among the works it cites.
Scaling behavior for large language models regarding numeral systems: An example using pythia
Zhejian Zhou, JIayu Wang, Dahua Lin, and Kai Chen. 2024 · 2024
Later among the works it cites.
Vision-language models do not understand negation
Kumail Alhamoud, Shaden Alshammari, Yonglong Tian, Guohao Li, Philip H.S. Torr, Yoon Kim, and Marzyeh Ghassemi. 2025 · 2025
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
LLMs for generating and evaluating counterfactuals: A comprehensive study
Van Bach Nguyen, Paul Youssef, Christin Seifert, and Jörg Schlötterer. 2024 · 2024
Cited alongside, same era.
Openai o1 system card
OpenAI. 2024 · 2024
Cited alongside, same era.
Iterative reasoning preference optimization
Richard Yuanzhe Pang, Weizhe Yuan, He He, Kyunghyun Cho, Sainbayar Sukhbaatar, and Jason Weston. 2024 · 2024
Cited alongside, same era.
Dissecting multiplication in transformers: Insights into llms
Luyu Qiu, Jianing Li, Chi Su, Chen Jason Zhang, and Lei Chen. 2024 · 2024
Cited alongside, same era.
Mr-gsm8k: A meta-reasoning benchmark for large language model evaluation
Zhongshen Zeng, Pengguang Chen, Shu Liu, Haiyun Jiang, and Jiaya Jia. 2024 · 2024
Cited alongside, same era.
Generative verifiers: Reward modeling as next-token prediction
Lunjun Zhang, Arian Hosseini, Hritik Bansal, Mehran Kazemi, Aviral Kumar, and Rishabh Agarwal. 2024 · 2024
Cited alongside, same era.
Ganqu Cui, Lifan Yuan, Zefan Wang, Hanbin Wang, Wendi Li, Bingxiang He, Yuchen Fan, Tianyu Yu, Qixin Xu, Weize Chen, Jiarui Yuan, Huayu Chen, Kaiyan Zhang, Xingtai Lv, Shuo Wang, Yuan Yao, Xu Han, Hao Peng, Yu Cheng, and 4 others. 2025 · 2025
Closest in time.
Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning
DeepSeek-AI. 2025 · 2025
Closest in time.
Humanity-Team. 2025 · 2025
Closest in time.
GSM-symbolic: Understanding the limitations of mathematical reasoning in large language models
Seyed Iman Mirzadeh, Keivan Alizadeh, Hooman Shahrokhi, Oncel Tuzel, Samy Bengio, and Mehrdad Farajtabar. 2025 · 2025
Closest in time.
Arithmetic without algorithms: Language models solve math with a bag of heuristics
Yaniv Nikankin, Anja Reusch, Aaron Mueller, and Yonatan Belinkov. 2025 · 2025
Closest in time.
Controlling out-of-domain gaps in LLMs for genre classification and generated text detection
Dmitri Roussinov, Serge Sharoff, and Nadezhda Puchnina. 2025 · 2025
Closest in time.
Parshin Shojaee, Iman Mirzadeh, Keivan Alizadeh, Maxwell Horton, Samy Bengio, and Mehrdad Farajtabar. 2025 · 2025
Closest in time.