Constraint Back-translation Improves Complex Instruction Following of Large Language Models

Mathqa: Towards interpretable math word problem solving with operation-based formalisms

Original

Aida Amini, Saadia Gabriel, Peter Lin, Rik Koncel-Kedziorski, Yejin Choi, and Hannaneh Hajishirzi. 2019 · 1905

Earlier work this paper cites.

Huggingface’s transformers: State-of-the-art natural language processing. arxiv

Original

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al. 2019 · 1910

Earlier work this paper cites.

Nltk: The natural language toolkit

Edward Loper and Steven Bird. 2002 · 2002

Earlier work this paper cites.

Rouge: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

Improving neural machine translation models with monolingual data

Original

Rico Sennrich. 2015 · 2015

Earlier work this paper cites.

Paraphrasing revisited with neural machine translation

Jonathan Mallinson, Rico Sennrich, and Mirella Lapata. 2017 · 2017

Earlier work this paper cites.

Learning paraphrastic sentence embeddings from back-translated bitext

Original

John Wieting, Jonathan Mallinson, and Kevin Gimpel. 2017 · 2017

Earlier work this paper cites.

Think you have solved question answering? Try arc, the ai2 reasoning challenge

Original

Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018 · 2018

Earlier work this paper cites.

Iterative back-translation for neural machine translation

Cong Duy Vu Hoang, Philipp Koehn, Gholamreza Haffari, and Trevor Cohn. 2018 · 2018

Earlier work this paper cites.

Style transfer through back-translation

Original

Shrimai Prabhumoye, Yulia Tsvetkov, Ruslan Salakhutdinov, and Alan W Black. 2018 · 2018

Earlier work this paper cites.

Social IQa: Commonsense reasoning about social interactions

Maarten Sap, Hannah Rashkin, Derek Chen, Ronan Le Bras, and Yejin Choi. 2019 · 2019

Earlier work this paper cites.

HellaSwag: Can a machine really finish your sentence?

Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019 · 2019

Earlier work this paper cites.

Yake! keyword extraction from single documents using multiple local features

Ricardo Campos, Vítor Mangaravite, Arian Pasquali, Alípio Jorge, Célia Nunes, and Adam Jatowt. 2020 · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021 · 2021

Earlier work this paper cites.

Measuring massive multitask language understanding

Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Earlier work this paper cites.

A review of text style transfer using deep learning

Martina Toshevska and Sonja Gievska. 2021 · 2021

Earlier work this paper cites.

Introducing ChatGPT

OpenAI. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022

Earlier work this paper cites.

Finetuned language models are zero-shot learners

Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, and Quoc V. Le. 2022 · 2022

Earlier work this paper cites.

The reversal curse: Llms trained on" a is b" fail to learn" b is a"

Original

Lukas Berglund, Meg Tong, Max Kaufmann, Mikita Balesni, Asa Cooper Stickland, Tomasz Korbak, and Owain Evans. 2023 · 2023

Earlier work this paper cites.

Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E Gonzalez, et al. 2023 · 2023

Cited alongside, same era.

Ultrafeedback: Boosting language models with high-quality feedback

Original

Ganqu Cui, Lifan Yuan, Ning Ding, Guanming Yao, Wei Zhu, Yuan Ni, Guotong Xie, Zhiyuan Liu, and Maosong Sun. 2023 · 2023

Cited alongside, same era.

Orca-chat: A high-quality explanation-style chat dataset

Shahul Es. 2023 · 2023

Cited alongside, same era.

Camels in a changing climate: Enhancing lm adaptation with tulu 2

Original

Hamish Ivison, Yizhong Wang, Valentina Pyatkin, Nathan Lambert, Matthew Peters, Pradeep Dasigi, Joel Jang, David Wadden, Noah A Smith, Iz Beltagy, et al. 2023 · 2023

Cited alongside, same era.

Mistral 7b

Original

Refined direct preference optimization with synthetic data for behavioral alignment of llms

Original

Víctor Gallego. 2024 · 2024

Closest in time.

Reverse training to nurse the reversal curse

Original

Olga Golovneva, Zeyuan Allen-Zhu, Jason Weston, and Sainbayar Sukhbaatar. 2024 · 2024

Closest in time.

From complex to simple: Enhancing multi-constraint complex instruction following ability of large language models

Original

Qianyu He, Jie Zeng, Qianxi He, Jiaqing Liang, and Yanghua Xiao. 2024 · 2024

Closest in time.

Inverse preference learning: Preference-based rl without a reward function

Joey Hejna and Dorsa Sadigh. 2024 · 2024

Closest in time.

FollowBench: A multi-level fine-grained constraints following benchmark for large language models

Yuxin Jiang, Yufei Wang, Xingshan Zeng, Wanjun Zhong, Liangyou Li, Fei Mi, Lifeng Shang, Xin Jiang, Qun Liu, and Wei Wang. 2024 · 2024