Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap

Analysing mathematical reasoning abilities of neural models

Original

David Saxton, Edward Grefenstette, Felix Hill, and Pushmeet Kohli. 2019 · 1904

Earlier work this paper cites.

Mathqa: Towards interpretable math word problem solving with operation-based formalisms

Original

Aida Amini, Saadia Gabriel, Peter Lin, Rik Koncel-Kedziorski, Yejin Choi, and Hannaneh Hajishirzi. 2019 · 1905

Earlier work this paper cites.

Measuring massive multitask language understanding

Original

Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2020 · 2009

Earlier work this paper cites.

Program induction by rationale generation: Learning to solve and explain algebraic word problems

Original

Wang Ling, Dani Yogatama, Chris Dyer, and Phil Blunsom. 2017 · 2017

Earlier work this paper cites.

The pile: An 800gb dataset of diverse text for language modeling

Original

Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, et al. 2020 · 2020

Earlier work this paper cites.

Zero: Memory optimizations toward training trillion parameter models

Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, and Yuxiong He. 2020 · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. 2021 · 2021

Earlier work this paper cites.

Measuring mathematical problem solving with the math dataset

Original

Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Earlier work this paper cites.

Klue: Korean language understanding evaluation

Original

Sungjoon Park. 2021 · 2021

Earlier work this paper cites.

Are nlp models really able to solve simple math word problems?

Original

Arkil Patel, Satwik Bhattamishra, and Navin Goyal. 2021 · 2021

Earlier work this paper cites.

Minif2f: a cross-system benchmark for formal olympiad-level mathematics

Original

Kunhao Zheng, Jesse Michael Han, and Stanislas Polu. 2021 · 2021

Earlier work this paper cites.

Language models are multilingual chain-of-thought reasoners

Original

Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, et al. 2022 · 2022

Earlier work this paper cites.

Elo uncovered: Robustness and best practices in language model evaluation

Original

Meriem Boubdir, Edward Kim, Beyza Ermis, Sara Hooker, and Marzieh Fadaee. 2023 · 2023

Earlier work this paper cites.

Breaking language barriers in multilingual mathematical reasoning: Insights and observations

Original

Nuo Chen, Zinan Zheng, Ning Wu, Linjun Shou, Ming Gong, Yangqiu Song, Dongmei Zhang, and Jia Li. 2023 · 2023

Earlier work this paper cites.

Investigating data contamination in modern benchmarks for large language models

Original

Chunyuan Deng, Yilun Zhao, Xiangru Tang, Mark Gerstein, and Arman Cohan. 2023 · 2023

Earlier work this paper cites.

Not all languages are created equal in llms: Improving multilingual capability by cross-lingual-thought prompting

Original

Haoyang Huang, Tianyi Tang, Dongdong Zhang, Wayne Xin Zhao, Ting Song, Yan Xia, and Furu Wei. 2023 · 2023

Earlier work this paper cites.

Chatbot arena: Benchmarking llms in the wild with elo ratings

LMSYS. 2023 · 2023

Earlier work this paper cites.

To the cutoff… and beyond? a longitudinal perspective on llm data contamination

Manley Roberts, Himanshu Thakur, Christine Herlihy, Colin White, and Samuel Dooley. 2023 · 2023

Cited alongside, same era.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023 · 2023

Cited alongside, same era.

Plug: Leveraging pivot language in cross-lingual instruction tuning

Original

Zhihan Zhang, Dong-Ho Lee, Yuwei Fang, Wenhao Yu, Mengzhao Jia, Meng Jiang, and Francesco Barbieri. 2023 · 2023

Cited alongside, same era.

Judging llm-as-a-judge with mt-bench and chatbot arena

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al. 2023 · 2023

Cited alongside, same era.

Qwq: Reflect deeply on the boundaries of the unknown

Alibaba. 2024 · 2024

Quantifying multilingual performance of large language models across languages

Original

Zihao Li, Yucheng Shi, Zirui Liu, Fan Yang, Ali Payani, Ninghao Liu, and Mengnan Du. 2024 · 2024

Later among the works it cites.

Llama 3.2: Revolutionizing edge ai and vision with open, customizable models

Meta AI. 2024 · 2024

Later among the works it cites.

Granite code models: A family of open foundation models for code intelligence

Original

Mayank Mishra, Matt Stallone, Gaoyuan Zhang, Yikang Shen, Aditya Prasad, Adriana Meza Soria, Michele Merler, Parameswaran Selvam, Saptha Surendran, Shivdeep Singh, et al. 2024 · 2024

Later among the works it cites.

Scaling neural machine translation to 200 languages

NLLB Team, Marta R. Costa-jussà, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, Anna Sun, Skyler Wang, Guillaume Wenzek, Al Youngblood, Bapi Akula, Loic Barrault, Gabriel Mejia Gonzalez, Prangthip Hansanti, John Hoffman, Semarley Jarrett, Kaushik Ram Sadagopan, Dirk Rowe, Shannon Spruit, Chau Tran, Pierre Andrews, Necip Fazil Ayan, Shruti Bhosale, Sergey Edunov, Angela Fan, Cynthia Gao, Vedanuj Goswami, Francisco Guzmán, Philipp Koehn, Alexandre Mourachko, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, and Jeff Wang. 2024 · 2024