Fetching the paper…
Reading the bibliography…
Production-grade LLM systems require robust adherence to dozens or even hundreds of instructions simultaneously.
Cross-task generalization via natural language crowdsourcing instructions, 2022
Swaroop Mishra, Daniel Khashabi, Chitta Baral, and Hannaneh Hajishirzi · 2022
Earlier work this paper cites.
Training language models to follow instructions with human feedback, 2022
Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe · 2022
Earlier work this paper cites.
Multitask prompted training enables zero-shot task generalization, 2022
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Fevry, Jason Alan Fries, Ryan Teehan, Tali Bers, Stella Biderman, Leo Gao, Thomas Wolf, and Alexander M. Rush · 2022
Earlier work this paper cites.
Super-naturalinstructions: Generalization via declarative instructions on 1600+ nlp tasks, 2022
Yizhong Wang, Swaroop Mishra, Pegah Alipoormolabashi, Yeganeh Kordi, Amirreza Mirzaei, Anjana Arunkumar, Arjun Ashok, Arut Selvan Dhanasekaran, Atharva Naik, David Stap, Eshaan Pathak, Giannis Karamanolakis, Haizhi Gary Lai, Ishan Purohit, Ishani Mondal, Jacob Anderson, Kirby Kuznia, Krima Doshi, Maitreya Patel, Kuntal Kumar Pal, Mehrad Moradshahi, Mihir Parmar, Mirali Purohit, Neeraj Varshney, Phani Rohitha Kaza, Pulkit Verma, Ravsehaj Singh Puri, Rushang Karia, Shailaja Keyur Sampat, Savan Doshi, Siddhartha Mishra, Sujan Reddy, Sumanta Patro, Tanay Dixit, Xudong Shen, Chitta Baral, Yejin Choi, Noah A. Smith, Hannaneh Hajishirzi, and Daniel Khashabi · 2022
Earlier work this paper cites.
Finetuned language models are zero-shot learners, 2022
Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, and Quoc V. Le · 2022
Earlier work this paper cites.
Yimin Jing, Renren Jin, Jiahao Hu, Huishi Qiu, Xiaohua Wang, Peng Wang, and Deyi Xiong · 2023
Earlier work this paper cites.
Self-refine: Iterative refinement with self-feedback, 2023
Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark · 2023
Earlier work this paper cites.
Dynamic multi-reward weighting for multi-style controllable generation, 2024
Karin de Langis, Ryan Koo, and Dongyeop Kang · 2024
Earlier work this paper cites.
Serial position effects of large language models, 2024
Xiaobo Guo and Soroush Vosoughi · 2024
Earlier work this paper cites.
Multi-if: Benchmarking llms on multi-turn and multilingual instructions following, 2024
Yun He, Di Jin, Chaoqi Wang, Chloe Bi, Karishma Mandyam, Hejia Zhang, Chen Zhu, Ning Li, Tengyu Xu, Hongjiang Lv, Shruti Bhosale, Chenguang Zhu, Karthik Abinav Sankararaman, Eryk Helenowski, Melanie Kambadur, Aditya Tayade, Hao Ma, Han Fang, and Sinong Wang · 2024
Earlier work this paper cites.
Yuxin Jiang, Yufei Wang, Xingshan Zeng, Wanjun Zhong, Liangyou Li, Fei Mi, Lifeng Shang, Xin Jiang, Qun Liu, and Wei Wang · 2024
Cited alongside, same era.
Large language model instruction following: A survey of progresses and challenges, 2024
Renze Lou, Kai Zhang, and Wenpeng Yin · 2024
Cited alongside, same era.
The death of schema linking? text-to-sql in the age of well-reasoned language models, 2024
Karime Maamari, Fadhil Abubaker, Daniel Jaroslawicz, and Amine Mhedhbi · 2024
Cited alongside, same era.
OpenAI · 2024
Cited alongside, same era.
InFoBench: Evaluating instruction following ability in large language models
Don’t do rag: When cache-augmented generation is all you need for knowledge tasks
Brian J. Chan, Chao-Ting Chen, Jui-Hung Cheng, and Hen-Hsen Huang · 2025
Closest in time.
Is long context all you need? leveraging llm’s extended context for nl2sql, 2025
Yeounoh Chung, Gaurav T. Kakkar, Yu Gan, Brenton Milne, and Fatma Ozcan · 2025
Closest in time.
Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning, 2025
DeepSeek-AI · 2025
Closest in time.
Llm agents display human biases but exhibit distinct learning patterns, 2025
Idan Horowitz and Ori Plonsky · 2025
Closest in time.
Llms can be easily confused by instructional distractions, 2025
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, and Dong Yu · 2024
Cited alongside, same era.
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context, 2024
Gemini Team · 2024
Cited alongside, same era.
Benchmarking complex instruction-following with multiple constraints composition, 2024
Bosi Wen, Pei Ke, Xiaotao Gu, Lindong Wu, Hao Huang, Jinfeng Zhou, Wenchuang Li, Binxin Hu, Wendy Gao, Jiaxin Xu, Yiming Liu, Jie Tang, Hongning Wang, and Minlie Huang · 2024
Cited alongside, same era.
Dc-instruct: An effective framework for generative multi-intent spoken language understanding
Bowen Xing, Lizi Liao, Minlie Huang, and Ivor W. Tsang · 2024
Cited alongside, same era.
Evaluating large language models at evaluating instruction following, 2024
Zhiyuan Zeng, Jiatong Yu, Tianyu Gao, Yu Meng, Tanya Goyal, and Danqi Chen · 2024
Cited alongside, same era.
Unibias: Unveiling and mitigating llm bias through internal attention and ffn manipulation, 2024
Hanzhang Zhou, Zijian Feng, Zixiao Zhu, Junlang Qian, and Kezhi Mao · 2024
Cited alongside, same era.
Yerin Hwang, Yongil Kim, Jahyun Koo, Taegwan Kang, Hyunkyung Bae, and Kyomin Jung · 2025
Closest in time.
Agent-s: Llm agentic workflow to automate standard operating procedures, 2025
Mandar Kulkarni · 2025
Closest in time.
ReIFE: Re-evaluating instruction-following evaluation
Yixin Liu, Kejian Shi, Alexander Fabbri, Yilun Zhao, PeiFeng Wang, Chien-Sheng Wu, Shafiq Joty, and Arman Cohan · 2025
Closest in time.
Dynamics of instruction fine-tuning for chinese large language models, 2025
Chiyu Song, Zhanchao Zhou, Jianhao Yan, Yuejiao Fei, Zhenzhong Lan, and Yue Zhang · 2025
Closest in time.
A-mem: Agentic memory for llm agents, 2025
Wujiang Xu, Kai Mei, Hang Gao, Juntao Tan, Zujie Liang, and Yongfeng Zhang · 2025
Closest in time.
Order matters: Investigate the position bias in multi-constraint instruction following, 2025
Jie Zeng, Qianyu He, Qingyu Ren, Jiaqing Liang, Yanghua Xiao, Weikang Zhou, Zeye Sun, and Fei Yu · 2025
Closest in time.