Fetching the paper…
Reading the bibliography…
Recently, long-thought reasoning models achieve strong performance on complex reasoning tasks, but often incur substantial inference overhead, making efficiency a critical concern.
Measuring mathematical problem solving with the math dataset
Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt · 2021
Earlier work this paper cites.
Training verifiers to solve math word problems, 2021
Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman · 2021
Earlier work this paper cites.
Solving quantitative reasoning problems with language models, 2022
Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, and Vedant Misra · 2022
Earlier work this paper cites.
Ties-merging: Resolving interference when merging models, 2023
Prateek Yadav, Derek Tam, Leshem Choshen, Colin Raffel, and Mohit Bansal · 2023
Earlier work this paper cites.
Learning to reason with llms
OpenAI · 2024
Earlier work this paper cites.
Compressed chain of thought: Efficient reasoning through dense representations, 2024
Jeffrey Cheng and Benjamin Van Durme · 2024
Earlier work this paper cites.
Model merging in llms, mllms, and beyond: Methods, theories, applications and opportunities, 2024
Enneng Yang, Li Shen, Guibing Guo, Xingwei Wang, Xiaochun Cao, Jie Zhang, and Dacheng Tao · 2024
Earlier work this paper cites.
Language models are homer simpson! safety re-alignment of fine-tuned language models through task arithmetic, 2024
Rishabh Bhardwaj, Do Duc Anh, and Soujanya Poria · 2024
Earlier work this paper cites.
Language models are super mario: Absorbing abilities from homologous models as a free lunch, 2024
Le Yu, Bowen Yu, Haiyang Yu, Fei Huang, and Yongbin Li · 2024
Earlier work this paper cites.
Adamerging: Adaptive model merging for multi-task learning, 2024
Enneng Yang, Zhenyi Wang, Li Shen, Shiwei Liu, Guibing Guo, Xingwei Wang, and Dacheng Tao · 2024
Earlier work this paper cites.
Training large language models to reason in a continuous latent space, 2024
Shibo Hao, Sainbayar Sukhbaatar, DiJia Su, Xian Li, Zhiting Hu, Jason Weston, and Yuandong Tian · 2024
Earlier work this paper cites.
American invitational mathematics examination - aime
MAA · 2024
Earlier work this paper cites.
Metagpt: Merging large language models using model exclusive task arithmetic, 2024
Yuyan Zhou, Liang Song, Bingning Wang, and Weipeng Chen · 2024
Cited alongside, same era.
Olympiadbench: A challenging benchmark for promoting agi with olympiad-level bilingual multimodal scientific problems, 2024
Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Leng Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, and Maosong Sun · 2024
Cited alongside, same era.
Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning, 2025
DeepSeek-AI team · 2025
Cited alongside, same era.
Do not think that much for 2+3=? on the overthinking of o1-like llms, 2025
Xingyu Chen, Jiahao Xu, Tian Liang, Zhiwei He, Jianhui Pang, Dian Yu, Linfeng Song, Qiuzhi Liu, Mengfei Zhou, Zhuosheng Zhang, Rui Wang, Zhaopeng Tu, Haitao Mi, and Dong Yu · 2025
Cited alongside, same era.
Stop overthinking: A survey on efficient reasoning for large language models, 2025
Yang Sui, Yu-Neng Chuang, Guanchu Wang, Jiamu Zhang, Tianyi Zhang, Jiayi Yuan, Hongyi Liu, Andrew Wen, Shaochen Zhong, Hanjie Chen, and Xia Hu · 2025
Lightthinker: Thinking step-by-step compression, 2025
Jintian Zhang, Yuqi Zhu, Mengshu Sun, Yujie Luo, Shuofei Qiao, Lun Du, Da Zheng, Huajun Chen, and Ningyu Zhang · 2025
Closest in time.
Dynamic early exit in reasoning models, 2025
Chenxu Yang, Qingyi Si, Yongjie Duan, Zheliang Zhu, Chenyu Zhu, Zheng Lin, Li Cao, and Weiping Wang · 2025
Closest in time.
Learning adaptive parallel reasoning with language models, 2025
Jiayi Pan, Xiuyu Li, Long Lian, Charlie Snell, Yifei Zhou, Adam Yala, Trevor Darrell, Kurt Keutzer, and Alane Suhr · 2025
Closest in time.
Reasoning models can be effective without thinking, 2025
Wenjie Ma, Jingxuan He, Charlie Snell, Tyler Griggs, Sewon Min, and Matei Zaharia · 2025
Closest in time.
Concise: Confidence-guided compression in step-by-step efficient reasoning, 2025
Ziqing Qiao, Yongheng Deng, Jiali Zeng, Dong Wang, Lai Wei, Fandong Meng, Jie Zhou, Ju Ren, and Yaoxue Zhang · 2025
Closest in time.
Accelerating chain-of-thought reasoning: When goal-gradient importance meets dynamic skipping, 2025
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
O1-pruner: Length-harmonizing fine-tuning for o1-like reasoning pruning, 2025
Haotian Luo, Li Shen, Haiying He, Yibo Wang, Shiwei Liu, Wei Li, Naiqiang Tan, Xiaochun Cao, and Dacheng Tao · 2025
Cited alongside, same era.
Training language models to reason efficiently, 2025
Daman Arora and Andrea Zanette · 2025
Cited alongside, same era.
Cot-valve: Length-compressible chain-of-thought tuning, 2025
Xinyin Ma, Guangnian Wan, Runpeng Yu, Gongfan Fang, and Xinchao Wang · 2025
Cited alongside, same era.
Mixup model merge: Enhancing model merging performance through randomized linear interpolation, 2025
Yue Zhou, Yi Chang, and Yuan Wu · 2025
Cited alongside, same era.
Self-training elicits concise reasoning in large language models, 2025
Tergel Munkhbat, Namgyu Ho, Seo Hyun Kim, Yongjin Yang, Yujin Kim, and Se-Young Yun · 2025
Cited alongside, same era.
Tokenskip: Controllable chain-of-thought compression in llms, 2025
Heming Xia, Yongqi Li, Chak Tou Leong, Wenjie Wang, and Wenjie Li · 2025
Cited alongside, same era.
Speculative thinking: Enhancing small-model reasoning with large model guidance at inference time, 2025
Wang Yang, Xiang Yue, Vipin Chaudhary, and Xiaotian Han · 2025
Cited alongside, same era.
Ren Zhuang, Ben Wang, and Shuifa Sun · 2025
Closest in time.
Think when you need: Self-adaptive chain-of-thought learning, 2025
Junjie Yang, Ke Lin, and Xing Yu · 2025
Closest in time.
Unlocking efficient long-to-short llm reasoning with model merging, 2025
Han Wu, Yuxuan Yao, Shuqi Liu, Zehua Liu, Xiaojin Fu, Xiongwei Han, Xing Li, Hui-Ling Zhen, Tao Zhong, and Mingxuan Yuan · 2025
Closest in time.
Qwen2.5 technical report, 2025
Qwen, :, An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keming Lu, Keqin Bao, Kexin Yang, Le Yu, Mei Li, Mingfeng Xue, Pei Zhang, Qin Zhu, Rui Men, Runji Lin, Tianhao Li, Tianyi Tang, Tingyu Xia, Xingzhang Ren, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yu Wan, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, and Zihan Qiu · 2025
Closest in time.
s1: Simple test-time scaling, 2025
Niklas Muennighoff, Zitong Yang, Weijia Shi, Xiang Lisa Li, Li Fei-Fei, Hannaneh Hajishirzi, Luke Zettlemoyer, Percy Liang, Emmanuel Candès, and Tatsunori Hashimoto · 2025
Closest in time.
Light-r1: Curriculum sft, dpo and rl for long cot from scratch and beyond, 2025
Liang Wen, Yunke Cai, Fenrui Xiao, Xin He, Qi An, Zhenyu Duan, Yimin Du, Junchen Liu, Lifu Tang, Xiaowei Lv, Haosheng Zou, Yongchao Deng, Shousheng Jia, and Xiangzheng Zhang · 2025
Closest in time.