Towards Rationality in Language and Multimodal Agents: A Survey

Clutrr: A diagnostic benchmark for inductive reasoning from text

Original

Koustuv Sinha, Shagun Sodhani, Jin Dong, Joelle Pineau, and William L Hamilton. 2019 · 1908

Earlier work this paper cites.

Vl-bert: Pre-training of generic visual-linguistic representations

Original

Weijie Su, Xizhou Zhu, Yue Cao, Bin Li, Lewei Lu, Furu Wei, and Jifeng Dai. 2019 · 1908

Earlier work this paper cites.

Organizations

James G March and Herbert A Simon. 1958 · 1958

Earlier work this paper cites.

Rational choice and the framing of decisions

Amos Tversky and Daniel Kahneman. 1988 · 1988

Earlier work this paper cites.

Bounded rationality

Reinhard Selten. 1990 · 1990

Earlier work this paper cites.

Learning to reason

Roni Khardon and Dan Roth. 1997 · 1997

Earlier work this paper cites.

Transformers as soft reasoners over language

Original

Peter Clark, Oyvind Tafjord, and Kyle Richardson. 2020 · 2002

Earlier work this paper cites.

Theory of games and economic behavior: 60th anniversary commemorative edition

John Von Neumann and Oskar Morgenstern. 2007 · 2007

Earlier work this paper cites.

Rational choice in an uncertain world: The psychology of judgment and decision making

Reid Hastie and Robyn M Dawes. 2009 · 2009

Earlier work this paper cites.

Rational decision making

Franz Eisenführ, Martin Weber, and Thomas Langer. 2010 · 2010

Earlier work this paper cites.

Artificial Intelligence: foundations of computational agents

David L Poole and Alan K Mackworth. 2010 · 2010

Earlier work this paper cites.

Thinking, fast and slow

Daniel Kahneman. 2011 · 2011

Earlier work this paper cites.

Towards ai-complete question answering: A set of prerequisite toy tasks

Original

Jason Weston, Antoine Bordes, Sumit Chopra, Alexander M Rush, Bart Van Merriënboer, Armand Joulin, and Tomas Mikolov. 2015 · 2015

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Object hallucination in image captioning

Original

Anna Rohrbach, Lisa Anne Hendricks, Kaylee Burns, Trevor Darrell, and Kate Saenko. 2018 · 2018

Earlier work this paper cites.

Hotpotqa: A dataset for diverse, explainable multi-hop question answering

Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D Manning. 2018 · 2018

Earlier work this paper cites.

Neural-symbolic vqa: Disentangling reasoning from vision and language understanding

Kexin Yi, Jiajun Wu, Chuang Gan, Antonio Torralba, Pushmeet Kohli, and Josh Tenenbaum. 2018 · 2018

Earlier work this paper cites.

Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks

Jiasen Lu, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019 · 2019

Earlier work this paper cites.

Commonsenseqa: A question answering challenge targeting commonsense knowledge

Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. 2019 · 2019

Earlier work this paper cites.

Hybridqa: A dataset of multi-hop question answering over tabular and textual data

Wenhu Chen, Hanwen Zha, Zhiyu Chen, Wenhan Xiong, Hong Wang, and William Yang Wang. 2020 · 2020

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive nlp tasks

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020 · 2020

Earlier work this paper cites.

Learning to summarize with human feedback

Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. 2020 · 2020

Earlier work this paper cites.

On the opportunities and risks of foundation models

Original

Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. 2021 · 2021

Earlier work this paper cites.

Hallucinated but factual! inspecting the factuality of hallucinations in abstractive summarization

Original

Meng Cao, Yue Dong, and Jackie Chi Kit Cheung. 2021 · 2021

Earlier work this paper cites.

Dialfact: A benchmark for fact-checking in dialogue

Original

Prakhar Gupta, Chien-Sheng Wu, Wenhao Liu, and Caiming Xiong. 2021 · 2021

Earlier work this paper cites.

Measuring mathematical problem solving with the math dataset

Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Earlier work this paper cites.

Knowledge graphs

Aidan Hogan, Eva Blomqvist, Michael Cochez, Claudia d’Amato, Gerard De Melo, Claudio Gutierrez, Sabrina Kirrane, José Emilio Labra Gayo, Roberto Navigli, Sebastian Neumaier, et al. 2021 · 2021

Earlier work this paper cites.

Logiqa: a challenge dataset for machine reading comprehension with logical reasoning

Jian Liu, Leyang Cui, Hanmeng Liu, Dandan Huang, Yile Wang, and Yue Zhang. 2021 · 2021

Earlier work this paper cites.

Fantastically ordered prompts and where to find them: Overcoming few-shot prompt order sensitivity

Original

Yao Lu, Max Bartolo, Alastair Moore, Sebastian Riedel, and Pontus Stenetorp. 2021 · 2021

Earlier work this paper cites.

Krisp: Integrating implicit and symbolic knowledge for open-domain knowledge-based vqa

Kenneth Marino, Xinlei Chen, Devi Parikh, Abhinav Gupta, and Marcus Rohrbach. 2021 · 2021

Earlier work this paper cites.

Webgpt: Browser-assisted question-answering with human feedback

Original

Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, et al. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021 · 2021

Earlier work this paper cites.

Do prompt-based models really understand the meaning of their prompts?

Original

Albert Webson and Ellie Pavlick. 2021 · 2021

Earlier work this paper cites.

Flamingo: a visual language model for few-shot learning

Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, et al. 2022 · 2022

Earlier work this paper cites.

Conformal risk control

Original

Anastasios N Angelopoulos, Stephen Bates, Adam Fisch, Lihua Lei, and Tal Schuster. 2022 · 2022

Earlier work this paper cites.

Training a helpful and harmless assistant with reinforcement learning from human feedback

Original

Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, et al. 2022 · 2022

Earlier work this paper cites.

Vlmo: Unified vision-language pre-training with mixture-of-modality-experts

Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Subhojit Som, Songhao Piao, and Furu Wei. 2022 · 2022

Earlier work this paper cites.

Let there be a clock on the beach: Reducing object hallucination in image captioning

Ali Furkan Biten, Lluís Gómez, and Dimosthenis Karatzas. 2022 · 2022

Earlier work this paper cites.

Pali: A jointly-scaled multilingual language-image model

Original

Xi Chen, Xiao Wang, Soravit Changpinyo, AJ Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, et al. 2022 · 2022

Earlier work this paper cites.

Binding language models in symbolic languages

Original

Zhoujun Cheng, Tianbao Xie, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, et al. 2022 · 2022

Earlier work this paper cites.

Towards reasoning in large language models: A survey

Original

Jie Huang and Kevin Chen-Chuan Chang. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022

Earlier work this paper cites.

Reasoning with language model prompting: A survey

Original

Shuofei Qiao, Yixin Ou, Ningyu Zhang, Xiang Chen, Yunzhi Yao, Shumin Deng, Chuanqi Tan, Fei Huang, and Huajun Chen. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022 · 2022

Earlier work this paper cites.

Uncertainty quantification with pre-trained language models: A large-scale empirical analysis

Original

Yuxin Xiao, Paul Pu Liang, Umang Bhatt, Willie Neiswanger, Ruslan Salakhutdinov, and Louis-Philippe Morency. 2022 · 2022

Earlier work this paper cites.

Webshop: Towards scalable real-world web interaction with grounded language agents

Shunyu Yao, Howard Chen, John Yang, and Karthik Narasimhan. 2022 · 2022

Earlier work this paper cites.

Llm-deliberation: Evaluating llms with interactive multi-agent negotiation games

Original

Sahar Abdelnabi, Amr Gomaa, Sarath Sivaprasad, Lea Schönherr, and Mario Fritz. 2023 · 2023

Earlier work this paper cites.

Openflamingo: An open-source framework for training large autoregressive vision-language models

Original

Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Gadre, Shiori Sagawa, et al. 2023 · 2023

Earlier work this paper cites.

Qwen-vl: A frontier large vision-language model with versatile abilities

Original

Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou. 2023 · 2023

Earlier work this paper cites.

A multitask, multilingual, multimodal evaluation of chatgpt on reasoning, hallucination, and interactivity

Original

Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, Wenliang Dai, Dan Su, Bryan Wilie, Holy Lovenia, Ziwei Ji, Tiezheng Yu, Willy Chung, et al. 2023 · 2023

Earlier work this paper cites.

Using cognitive psychology to understand gpt-3

Marcel Binz and Eric Schulz. 2023 · 2023

Earlier work this paper cites.

Audiolm: a language modeling approach to audio generation

Zalán Borsos, Raphaël Marinier, Damien Vincent, Eugene Kharitonov, Olivier Pietquin, Matt Sharifi, Dominik Roblek, Olivier Teboul, David Grangier, Marco Tagliasacchi, et al. 2023 · 2023

Earlier work this paper cites.

Sparks of artificial general intelligence: Early experiments with gpt-4

Original

Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023 · 2023

Earlier work this paper cites.

Chateval: Towards better llm-based evaluators through multi-agent debate

Original

Chi-Min Chan, Weize Chen, Yusheng Su, Jianxuan Yu, Wei Xue, Shanghang Zhang, Jie Fu, and Zhiyuan Liu. 2023 · 2023

Earlier work this paper cites.

Lm vs lm: Detecting factual errors via cross examination

Original

Roi Cohen, May Hamri, Mor Geva, and Amir Globerson. 2023 · 2023

Earlier work this paper cites.

Diving deep into modes of fact hallucinations in dialogue systems

Original

Souvik Das, Sougata Saha, and Rohini K Srihari. 2023 · 2023

Earlier work this paper cites.

Improving factuality and reasoning in language models through multiagent debate

Original

Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch. 2023 · 2023

Earlier work this paper cites.

Gptscore: Evaluate as you desire

Original

Jinlan Fu, See-Kiong Ng, Zhengbao Jiang, and Pengfei Liu. 2023 · 2023

Cited alongside, same era.

Text-to-audio generation using instruction-tuned llm and latent diffusion model

Original

Deepanway Ghosal, Navonil Majumder, Ambuj Mehrish, and Soujanya Poria. 2023 · 2023

Cited alongside, same era.

Hallucinations in large multilingual translation models

Nuno M Guerreiro, Duarte M Alves, Jonas Waldendorf, Barry Haddow, Alexandra Birch, Pierre Colombo, and André FT Martins. 2023 · 2023

Cited alongside, same era.

Visual programming: Compositional visual reasoning without training

Tanmay Gupta and Aniruddha Kembhavi. 2023 · 2023

Cited alongside, same era.

A real-world webagent with planning, long context understanding, and program synthesis

Original

Izzeddin Gur, Hiroki Furuta, Austin Huang, Mustafa Safdari, Yutaka Matsuo, Douglas Eck, and Aleksandra Faust. 2023 · 2023

Muffin or chihuahua? challenging multimodal large language models with multipanel vqa

Yue Fan, Jing Gu, Kaiwen Zhou, Qianqi Yan, Shan Jiang, Ching-Chen Kuo, Yang Zhao, Xinze Guan, and Xin Wang. 2024 · 2024

Closest in time.

Large language models are neurosymbolic reasoners

Original

Meng Fang, Shilong Deng, Yudi Zhang, Zijing Shi, Ling Chen, Mykola Pechenizkiy, and Jun Wang. 2024 · 2024

Closest in time.

Blink: Multimodal large language models can see but not perceive

Original

Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A Smith, Wei-Chiu Ma, and Ranjay Krishna. 2024 · 2024

Closest in time.

Puzzle solving using reasoning of large language models: A survey

Original

Panagiotis Giadikiaroglou, Maria Lymperaiou, Giorgos Filandrianos, and Giorgos Stamou. 2024 · 2024

Closest in time.

Conformal alignment: Knowing when to trust foundation models with guarantees