Marco-o1: Towards Open Reasoning Models for Open-Ended Solutions

Mastering the game of go without human knowledge

D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton, et al · 2017

Earlier work this paper cites.

Training verifiers to solve math word problems, 2021

Original

K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano, C. Hesse, and J. Schulman · 2021

Earlier work this paper cites.

Large language models can self-improve

Original

J. Huang, S. S. Gu, L. Hou, Y. Wu, X. Wang, H. Yu, and J. Han · 2022

Earlier work this paper cites.

Language models are multilingual chain-of-thought reasoners

Original

F. Shi, M. Suzgun, M. Freitag, X. Wang, S. Srivats, S. Vosoughi, H. W. Chung, Y. Tay, S. Ruder, D. Zhou, et al · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou, et al · 2022

Earlier work this paper cites.

Alphazero-like tree-search can guide large language model decoding and training

Original

X. Feng, Z. Wan, M. Wen, S. M. McAleer, Y. Wen, W. Zhang, and J. Wang · 2023

Cited alongside, same era.

Let’s verify step by step

Original

H. Lightman, V. Kosaraju, Y. Burda, H. Edwards, B. Baker, T. Lee, J. Leike, J. Schulman, I. Sutskever, and K. Cobbe · 2023

Cited alongside, same era.

Can large language models really improve by self-critiquing their own plans?

Original

K. Valmeekam, M. Marquez, and S. Kambhampati · 2023

Cited alongside, same era.

Guiding large language models via directional stimulus prompting

Z. Li, B. Peng, P. He, M. Galley, J. Gao, and X. Yan · 2024

Cited alongside, same era.

Self-refine: Iterative refinement with self-feedback

A. Madaan, N. Tandon, P. Gupta, S. Hallinan, L. Gao, S. Wiegreffe, U. Alon, N. Dziri, S. Prabhumoye, Y. Yang, et al · 2024

Closest in time.

Learning to reason with llms

OpenAI · 2024

Closest in time.

Qwen2 technical report

Original

A. Yang, B. Yang, B. Hui, B. Zheng, B. Yu, C. Zhou, C. Li, C. Li, D. Liu, F. Huang, et al · 2024

Closest in time.

Evaluation of openai o1: Opportunities and challenges of agi

Original

T. Zhong, Z. Liu, Y. Pan, Y. Zhang, Y. Zhou, S. Liang, Z. Wu, Y. Lyu, P. Shu, X. Yu, et al · 2024

Closest in time.