OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning

N2n learning: Network to network compression via policy gradient reinforcement learning

Original

Anubhav Ashok, Nicholas Rhinehart, Fares Beainy, and Kris M Kitani · 2017

Earlier work this paper cites.

Proximal policy optimization algorithms

Original

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov · 2017

Earlier work this paper cites.

Decore: Deep compression with reinforcement learning

Manoj Alwani, Yang Wang, and Vashisht Madhavan · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022

Earlier work this paper cites.

Grounding large language models in interactive environments with online reinforcement learning

Thomas Carta, Clément Romac, Thomas Wolf, Sylvain Lamprier, Olivier Sigaud, and Pierre-Yves Oudeyer · 2023

Earlier work this paper cites.

https://github.com/Open-Source-O1/Open-O1/ , 2024

Open o1: A model matching proprietary power with open-source innovation · 2024

Earlier work this paper cites.

Reinforcement learning for fine-tuning text-to-image diffusion models

Ying Fan, Olivia Watkins, Yuqing Du, Hao Liu, Moonkyung Ryu, Craig Boutilier, Pieter Abbeel, Mohammad Ghavamzadeh, Kangwook Lee, and Kimin Lee · 2024

Earlier work this paper cites.

Sciknoweval: Evaluating multi-level scientific knowledge of large language models, 2024

Kehua Feng, Keyan Ding, Weijie Wang, Xiang Zhuang, Zeyuan Wang, Ming Qin, Yu Zhao, Jianhua Yao, Qiang Zhang, and Huajun Chen · 2024

Cited alongside, same era.

Openrlhf: An easy-to-use, scalable and high-performance rlhf framework

Original

Jian Hu, Xibin Wu, Zilin Zhu, Xianyu, Weixun Wang, Dehao Zhang, and Yu Cao · 2024

Cited alongside, same era.

Alr2: A retrieve-then-reason framework for long-context question answering

Original

Huayang Li, Pat Verga, Priyanka Sen, Bowen Yang, Vijay Viswanathan, Patrick Lewis, Taro Watanabe, and Yixuan Su · 2024

Cited alongside, same era.

Reft: Reasoning with reinforced fine-tuning

Original

Trung Quoc Luong, Xinbo Zhang, Zhanming Jie, Peng Sun, Xiaoran Jin, and Hang Li · 2024

Cited alongside, same era.

Skywork-o1 open series

Skywork o1 Team · 2024

Llama-o1: Open large reasoning model frameworks for training, inference and evaluation with pytorch and huggingface

SimpleBerry · 2024

Closest in time.

Openr: An open source framework for advanced reasoning with large language models

Original

Jun Wang, Meng Fang, Ziyu Wan, Muning Wen, Jiachen Zhu, Anjie Liu, Ziqin Gong, Yan Song, Lei Chen, Lionel M Ni, et al · 2024

Closest in time.

Don’t command, cultivate: An exploratory study of system-2 alignment, 2024

Yuhang Wang and Jitao Sang · 2024

Closest in time.

Qwen2 technical report

Original

An Yang, Baosong Yang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Zhou, Chengpeng Li, Chengyuan Li, Dayiheng Liu, Fei Huang, Guanting Dong, Haoran Wei, Huan Lin, Jialong Tang, Jialin Wang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Ma, Jin Xu, Jingren Zhou, Jinze Bai, Jinzheng He, Junyang Lin, Kai Dang, Keming Lu, Keqin Chen, Kexin Yang, Mei Li, Mingfeng Xue, Na Ni, Pei Zhang, Peng Wang, Ru Peng, Rui Men, Ruize Gao, Runji Lin, Shijie Wang, Shuai Bai, Sinan Tan, Tianhang Zhu, Tianhao Li, Tianyu Liu, Wenbin Ge, Xiaodong Deng, Xiaohuan Zhou, Xingzhang Ren, Xinyu Zhang, Xipin Wei, Xuancheng Ren, Yang Fan, Yang Yao, Yichang Zhang, Yu Wan, Yunfei Chu, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, and Zhihao Fan · 2024