Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMs

LoRA: Low-rank adaptation of large language models

Edward J Hu, yelong shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022 · 2022

Earlier work this paper cites.

Large language models are zero-shot reasoners

Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022

Earlier work this paper cites.

Chain of thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou. 2022 · 2022

Earlier work this paper cites.

From sparse to dense: GPT-4 summarization with chain of density prompting

Griffin Adams, Alex Fabbri, Faisal Ladhak, Eric Lehman, and Noémie Elhadad. 2023 · 2023

Earlier work this paper cites.

Can knowledge graphs reduce hallucinations in llms?: A survey

Original

Garima Agrawal, Tharindu Kumarage, Zeyad Alghami, and Huan Liu. 2023 · 2023

Earlier work this paper cites.

Red-teaming large language models using chain of utterances for safety-alignment

Original

Rishabh Bhardwaj and Soujanya Poria. 2023 · 2023

Earlier work this paper cites.

A survey on evaluation of large language models

Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, et al. 2023 · 2023

Earlier work this paper cites.

ChatCoT: Tool-augmented chain-of-thought reasoning on chat-based large language models

Zhipeng Chen, Kun Zhou, Beichen Zhang, Zheng Gong, Xin Zhao, and Ji-Rong Wen. 2023b · 2023

Earlier work this paper cites.

Chain-of-verification reduces hallucination in large language models

Original

Shehzaad Dhuliawala, Mojtaba Komeili, Jing Xu, Roberta Raileanu, Xian Li, Asli Celikyilmaz, and Jason Weston. 2023 · 2023

Earlier work this paper cites.

Choire: Characterizing and predicting human opinions with chain of opinion reasoning

Original

Xuan Long Do, Kenji Kawaguchi, Min Yen Kan, and Nancy F Chen. 2023 · 2023

Earlier work this paper cites.

Coascore: Chain-of-aspects prompting for nlg evaluation

Original

Peiyuan Gong and Jiaxin Mao. 2023 · 2023

Earlier work this paper cites.

Distilling step-by-step! outperforming larger language models with less training data and smaller model sizes

Cheng-Yu Hsieh, Chun-Liang Li, Chih-kuan Yeh, Hootan Nakhost, Yasuhisa Fujii, Alex Ratner, Ranjay Krishna, Chen-Yu Lee, and Tomas Pfister. 2023 · 2023

Earlier work this paper cites.

Chain of explanation: New prompting method to generate quality natural language explanation for implicit hate speech

Fan Huang, Haewoon Kwak, and Jisun An. 2023 · 2023

Earlier work this paper cites.

Towards reasoning in large language models: A survey

Jie Huang and Kevin Chen-Chuan Chang. 2023 · 2023

Earlier work this paper cites.

MultiTool-CoT: GPT-3 can use multiple external tools with chain of thought prompting

Tatsuro Inaba, Hirokazu Kiyomaru, Fei Cheng, and Sadao Kurohashi. 2023 · 2023

Earlier work this paper cites.

Chain of reference prompting helps llm to think like a lawyer

Aditya Kuppa, Nikon Rasumov-Rahe, and Marc Voses. 2023 · 2023

Earlier work this paper cites.

Chain of natural language inference for reducing large language model ungrounded hallucinations

Original

Deren Lei, Yaxi Li, Mingyu Wang, Vincent Yun, Emily Ching, Eslam Kamal, et al. 2023 · 2023

Earlier work this paper cites.

Deductive verification of chain-of-thought reasoning

Zhan Ling, Yunhao Fang, Xuanlin Li, Zhiao Huang, Mingu Lee, Roland Memisevic, and Hao Su. 2023 · 2023

Earlier work this paper cites.

LogiCoT: Logical chain-of-thought instruction tuning

Hanmeng Liu, Zhiyang Teng, Leyang Cui, Chaoli Zhang, Qiji Zhou, and Yue Zhang. 2023 · 2023

Earlier work this paper cites.

Chain-of-dictionary prompting elicits translation in large language models

Original

Hongyuan Lu, Haoyang Huang, Dongdong Zhang, Haoran Yang, Wai Lam, and Furu Wei. 2023 · 2023

Earlier work this paper cites.

Faithful chain-of-thought reasoning

Qing Lyu, Shreya Havaldar, Adam Stein, Li Zhang, Delip Rao, Eric Wong, Marianna Apidianaki, and Chris Callison-Burch. 2023 · 2023

Earlier work this paper cites.

Large language models play starcraft ii: Benchmarks and a chain of summarization approach

Original

Weiyu Ma, Qirui Mi, Xue Yan, Yuqiao Wu, Runji Lin, Haifeng Zhang, and Jun Wang. 2023 · 2023

Earlier work this paper cites.

Self-refine: Iterative refinement with self-feedback

Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark. 2023 · 2023

Earlier work this paper cites.

Chain of images for intuitively reasoning

Original

Fanxu Meng, Haotong Yang, Yiding Wang, and Muhan Zhang. 2023 · 2023

Cited alongside, same era.

Measuring and narrowing the compositionality gap in language models

Ofir Press, Muru Zhang, Sewon Min, Ludwig Schmidt, Noah Smith, and Mike Lewis. 2023 · 2023

Cited alongside, same era.

Interleaving retrieval with chain-of-thought reasoning for knowledge-intensive multi-step questions

Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal. 2023 · 2023

Cited alongside, same era.

Cue-CoT: Chain-of-thought prompting for responding to in-depth dialogue questions with LLMs

Hongru Wang, Rui Wang, Fei Mi, Yang Deng, Zezhong Wang, Bin Liang, Ruifeng Xu, and Kam-Fai Wong. 2023c · 2023

Cited alongside, same era.

PsyCoT: Psychological questionnaire as powerful chain-of-thought for personality detection

Tao Yang, Tianyuan Shi, Fanqi Wan, Xiaojun Quan, Qifan Wang, Bingzhe Wu, and Jiaxiang Wu. 2023 · 2023

Generalizing visual question answering from synthetic to human-written questions via a chain of qa with a large language model

Original

Taehee Kim, Yeongjae Cho, Heejun Shin, Yohan Jo, and Dongmyung Shin. 2024 · 2024

Closest in time.

Code simulation challenges for large language models

Original

Emanuele La Malfa, Christoph Weinhuber, Orazio Torre, Fangru Lin, Anthony Cohn, Nigel Shadbolt, and Michael Wooldridge. 2024 · 2024

Closest in time.

Codechain: Towards modular code generation through chain of self-revisions with representative sub-modules

Hung Le, Hailin Chen, Amrita Saha, Akash Gokul, Doyen Sahoo, and Shafiq Joty. 2024 · 2024

Closest in time.

Chain of history: Learning and forecasting with llms for temporal knowledge graph completion

Original

Ruilin Luo, Tianle Gu, Haoling Li, Junzhe Li, Zicheng Lin, Jiayi Li, and Yujiu Yang. 2024 · 2024

Closest in time.